Sep 10 22:18:18.340335 ip-10-0-132-115 systemd[1]: Starting Kubernetes Kubelet...
Sep 10 22:18:18.735966 ip-10-0-132-115 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:18:18.735966 ip-10-0-132-115 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 10 22:18:18.735966 ip-10-0-132-115 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:18:18.735966 ip-10-0-132-115 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 10 22:18:18.735966 ip-10-0-132-115 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 10 22:18:18.737774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.737683    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 10 22:18:18.741488 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741472    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:18.741488 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741488    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741493    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741497    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741499    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741510    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741513    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741516    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741519    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741521    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741524    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741527    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741530    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741532    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741536    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741538    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741541    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741543    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741546    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741549    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:18.741555 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741551    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741554    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741557    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741559    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741562    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741565    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741568    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741571    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741573    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741576    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741579    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741581    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741585    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741589    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741592    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741594    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741597    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741600    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741603    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741606    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:18.742036 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741608    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741611    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741613    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741616    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741618    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741621    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741623    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741626    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741628    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741632    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741635    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741637    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741640    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741642    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741646    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741651    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741655    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741658    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741662    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741665    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:18.742534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741668    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741670    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741673    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741676    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741678    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741681    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741683    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741686    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741688    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741691    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741694    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741697    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741700    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741702    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741705    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741707    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741710    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741713    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741716    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741719    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:18.743076 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741721    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741724    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741727    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741729    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741732    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741734    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741738    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741741    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741744    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741746    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741749    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741753    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741756    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741759    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741762    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741765    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741768    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741770    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.741773    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:18.743885 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742467    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742474    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742477    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742481    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742485    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742488    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742491    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742494    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742496    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742499    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742502    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742506    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742509    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742511    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742514    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742516    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742519    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742522    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742525    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742528    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:18.744553 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742531    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742534    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742537    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742539    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742543    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742546    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742549    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742552    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742554    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742557    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742560    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742562    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742565    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742568    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742572    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742576    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742580    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742584    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742587    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:18.745077 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742591    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742594    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742598    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742601    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742604    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742607    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742609    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742613    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742616    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742619    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742621    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742624    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742627    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742630    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742632    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742635    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742638    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742640    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742643    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:18.745544 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742646    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742649    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742651    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742654    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742657    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742659    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742662    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742665    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742668    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742670    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742673    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742675    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742678    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742681    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742684    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742686    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742689    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742691    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742694    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742696    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:18.746008 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742699    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742702    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742705    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742708    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742710    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742717    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742720    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742723    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742726    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742728    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742731    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742734    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742736    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742739    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742741    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742744    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742747    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742749    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742752    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742754    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:18.746605 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.742757    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744687    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744700    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744703    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744706    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744710    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744712    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744715    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744718    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744720    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744724    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744726    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744728    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744731    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744734    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744736    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744739    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744741    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744744    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744747    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:18.747135 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744750    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744753    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744755    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744758    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744761    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744763    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744766    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744769    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744771    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744774    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744778    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744783    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744786    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744794    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744798    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744803    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744806    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744810    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744813    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:18.747640 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744815    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744818    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744821    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744824    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744826    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744829    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744832    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744834    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744837    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744840    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744842    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744845    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744847    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744850    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744853    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744855    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744858    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744860    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744863    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744866    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:18.748133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744868    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744871    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744873    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744876    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744879    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744882    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744884    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744888    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744891    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744893    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744896    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744899    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744901    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744904    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744906    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744909    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744911    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744914    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744917    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744919    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:18.748662 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744922    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744925    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744927    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744930    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744932    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744936    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744940    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744944    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744948    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744950    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744954    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744956    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744959    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744961    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744964    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744966    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744969    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744971    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744974    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:18.749169 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744977    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.744980    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745071    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745106    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745113    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745117    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745122    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745125    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745129    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745134    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745137    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745140    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745143    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745147    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745150    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745153    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745156    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745159    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745162    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745166    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745171    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745174    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745178    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745181    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 10 22:18:18.749625 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745184    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745188    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745191    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745194    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745197    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745200    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745203    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745206    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745212    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745215    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745219    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745222    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745226    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745229    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745232    2582 flags.go:64] FLAG: --enable-server="true"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745235    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745239    2582 flags.go:64] FLAG: --event-burst="100"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745242    2582 flags.go:64] FLAG: --event-qps="50"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745245    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745249    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745252    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745255    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745258    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745261    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745264    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 10 22:18:18.750222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745267    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745270    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745273    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745277    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745280    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745283    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745285    2582 flags.go:64] FLAG: --feature-gates=""
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745289    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745292    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745295    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745298    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745301    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745304    2582 flags.go:64] FLAG: --help="false"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745307    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-132-115.ec2.internal"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745310    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745315    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745318    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745321    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745324    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745327    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745330    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745333    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745336    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 10 22:18:18.750825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745338    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745341    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745344    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745347    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745350    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745353    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745357    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745360    2582 flags.go:64] FLAG: --lock-file=""
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745363    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745366    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745369    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745379    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745382    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745385    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745388    2582 flags.go:64] FLAG: --logging-format="text"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745391    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745394    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745397    2582 flags.go:64] FLAG: --manifest-url=""
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745400    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745404    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745407    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745411    2582 flags.go:64] FLAG: --max-pods="110"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745414    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745417    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745421    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 10 22:18:18.751437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745424    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745428    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745431    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745434    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745441    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745445    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745448    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745451    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745453    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745459    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745462    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745465    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745468    2582 flags.go:64] FLAG: --port="10250"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745472    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745475    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d7d1dd91cd5f37d9"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745478    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745481    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745484    2582 flags.go:64] FLAG: --register-node="true"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745487    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745491    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745494    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745497    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745500    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745503    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745506    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 10 22:18:18.752102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745509    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745512    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745515    2582 flags.go:64] FLAG: --runonce="false"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745518    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745521    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745524    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745527    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745531    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745534    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745538    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745540    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745543    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745546    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745549    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745552    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745556    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745559    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745561    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745568    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745571    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745575    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745579    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745582    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745585    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745588    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 10 22:18:18.752727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745591    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745594    2582 flags.go:64] FLAG: --v="2"
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745598    2582 flags.go:64] FLAG: --version="false"
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745602    2582 flags.go:64] FLAG: --vmodule=""
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745608    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.745611    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745719    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745724    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745729    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745733    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745736    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745739    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745742    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745745    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745748    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745751    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745754    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745757    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745760    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745763    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745765    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:18.753362 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745768    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745771    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745773    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745776    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745789    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745792    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745796    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745799    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745802    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745804    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745808    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745812    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745815    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745817    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745820    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745823    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745826    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745828    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745831    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:18.753888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745833    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745836    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745839    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745842    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745844    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745847    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745849    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745852    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745855    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745858    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745860    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745863    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745866    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745868    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745871    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745873    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745876    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745878    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745881    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745885    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:18.754372 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745888    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745890    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745893    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745897    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745900    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745904    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745906    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745909    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745912    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745914    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745918    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745920    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745923    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745926    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745929    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745932    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745934    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745937    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745939    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:18.754861 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745942    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745945    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745947    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745950    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745953    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745955    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745958    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745960    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745963    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745965    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745968    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745970    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745974    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745976    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745979    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745981    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745984    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745987    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745989    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:18.755415 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745992    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745994    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745997    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.745999    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.746001    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.746004    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.746007    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.746745    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.753991    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.754007    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.754685    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.754695    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754754    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754759    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754762    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:18.755874 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754765    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754768    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754772    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754775    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754778    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754780    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754784    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754787    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754790    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754792    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754795    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754798    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754801    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754803    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754806    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754808    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754811    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754814    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754816    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754819    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:18.756284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754822    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754825    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754828    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754831    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754833    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754836    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754840    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754842    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754845    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754848    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754850    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754853    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754855    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754858    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754861    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754863    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754866    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754869    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754872    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754875    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:18.756763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754877    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754880    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754883    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754886    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754888    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754891    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754893    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754896    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754898    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754901    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754903    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754906    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754908    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754911    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754913    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754917    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754920    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754922    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754926    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754929    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:18.757276 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754931    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754935    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754939    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754942    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754945    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754948    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754951    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754954    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754957    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754960    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754962    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754965    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754967    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754970    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754973    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754975    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754978    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754982    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754985    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:18.757823 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754987    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754990    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754994    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.754997    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755000    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755003    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755005    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755024    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755029    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755033    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755036    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755039    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755043    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755046    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755050    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755054    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:18.758305 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755057    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.755062    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755176    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755180    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755183    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755186    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755190    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755193    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755195    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755199    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755202    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755205    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755208    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755210    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755213    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 10 22:18:18.758718 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755216    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755219    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755221    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755224    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755227    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755229    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755232    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755234    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755237    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755240    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755243    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755246    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755249    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755253    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755256    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755259    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755261    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755265    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755267    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 10 22:18:18.759118 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755270    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755273    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755275    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755278    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755280    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755283    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755285    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755288    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755291    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755293    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755296    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755298    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755301    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755304    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755306    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755309    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755312    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755316    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755320    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 10 22:18:18.759599 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755323    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755326    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755329    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755332    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755335    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755337    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755340    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755343    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755346    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755348    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755351    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755354    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755356    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755359    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755361    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755364    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755367    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755370    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755372    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755375    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 10 22:18:18.760091 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755378    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755380    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755383    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755386    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755388    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755391    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755394    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755396    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755399    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755401    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755404    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755407    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755409    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755412    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755416    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755419    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755423    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755426    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755429    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 10 22:18:18.760582 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755433    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755436    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755439    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755441    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755444    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755447    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755450    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755453    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:18.755456    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.755461    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.755564    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.757684    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.758659    2582 server.go:1019] "Starting client certificate rotation"
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.758754    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:18:18.761093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.759517    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 10 22:18:18.761437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.761111    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:18:18.762218 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.762199    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 10 22:18:18.771863 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.771843    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 10 22:18:18.774915 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.774900    2582 log.go:25] "Validated CRI v1 image API"
Sep 10 22:18:18.776021 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.775988    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 10 22:18:18.779874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.779853    2582 fs.go:135] Filesystem UUIDs: map[10c4e467-b172-4e08-bbf8-cd4748a404aa:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d45b8899-e8ef-4b89-9914-0050fd14f4fe:/dev/nvme0n1p4]
Sep 10 22:18:18.779964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.779873    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 10 22:18:18.788490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.788366    2582 manager.go:216] Machine: {Timestamp:2026-09-10 22:18:18.787078803 +0000 UTC m=+0.328810116 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3123067 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f29da946e892401f6a7097384f400 SystemUUID:ec2f29da-946e-8924-01f6-a7097384f400 BootID:20a3497d-cf34-49bc-9fce-a8e0157fd09f Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:de:7e:d4:4c:7b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:de:7e:d4:4c:7b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:5a:16:0d:91:1f:a8 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 10 22:18:18.788490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.788477    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 10 22:18:18.788632 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.788560    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 10 22:18:18.789712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.789694    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:18:18.790952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.790920    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 10 22:18:18.791112 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.790955    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-115.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 10 22:18:18.791695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.791683    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 10 22:18:18.791695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.791695    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 10 22:18:18.791774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.791704    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:18:18.793108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.793097    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 10 22:18:18.793901 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.793892    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 10 22:18:18.797659 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797647    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:18:18.797785 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797776    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 10 22:18:18.797819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797812    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 10 22:18:18.797846 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797830    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 10 22:18:18.797846 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797845    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 10 22:18:18.797895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797854    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 10 22:18:18.797895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.797864    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 10 22:18:18.798242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.798230    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:18:18.798302 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.798248    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 10 22:18:18.800389 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.800372    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 10 22:18:18.802129 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.802117    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 10 22:18:18.802173 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.802147    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 10 22:18:18.803707 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803695    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803711    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803717    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803721    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803730    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803735    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803749    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803754    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803761    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803766    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803775    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 10 22:18:18.803792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.803781    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 10 22:18:18.804586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.804575    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 10 22:18:18.804586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.804584    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 10 22:18:18.807785 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.807763    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 10 22:18:18.807850 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.807768    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 10 22:18:18.807850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.807800    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-115.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 10 22:18:18.809116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.809103    2582 server.go:1268] "Started kubelet"
Sep 10 22:18:18.809197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.809171    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 10 22:18:18.809256 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.809230    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 10 22:18:18.809327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.809314    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 10 22:18:18.809996 ip-10-0-132-115 systemd[1]: Started Kubernetes Kubelet.
Sep 10 22:18:18.811108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.811093    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 10 22:18:18.811169 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.811136    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 10 22:18:18.814869 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.813740    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-115.ec2.internal.18d41598fdbba361  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-115.ec2.internal,UID:ip-10-0-132-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-115.ec2.internal,},FirstTimestamp:2026-09-10 22:18:18.809074529 +0000 UTC m=+0.350805822,LastTimestamp:2026-09-10 22:18:18.809074529 +0000 UTC m=+0.350805822,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-115.ec2.internal,}"
Sep 10 22:18:18.815105 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.815078    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 10 22:18:18.815252 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815237    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 10 22:18:18.815317 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815247    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 10 22:18:18.815317 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.815309    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:18.815894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815872    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 10 22:18:18.815894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815882    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 10 22:18:18.816029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815917    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 10 22:18:18.816029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815973    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 10 22:18:18.816029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.815981    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 10 22:18:18.816815 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.816793    2582 factory.go:55] Registering systemd factory
Sep 10 22:18:18.816891 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.816840    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 10 22:18:18.817117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.817098    2582 factory.go:153] Registering CRI-O factory
Sep 10 22:18:18.817181 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.817122    2582 factory.go:223] Registration of the crio container factory successfully
Sep 10 22:18:18.817236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.817196    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 10 22:18:18.817236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.817214    2582 factory.go:103] Registering Raw factory
Sep 10 22:18:18.817236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.817231    2582 manager.go:1196] Started watching for new ooms in manager
Sep 10 22:18:18.817764 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.817746    2582 manager.go:349] Starting recovery of all containers
Sep 10 22:18:18.820151 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.820028    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2l2g2"
Sep 10 22:18:18.821566 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.821542    2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 10 22:18:18.821679 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.821568    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 10 22:18:18.826912 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.826887    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2l2g2"
Sep 10 22:18:18.830417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.830383    2582 manager.go:354] Recovery completed
Sep 10 22:18:18.835554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.835541    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:18.837423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.837405    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:18.837495 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.837438    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:18.837495 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.837448    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:18.838208 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.838083    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 10 22:18:18.838208 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.838091    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 10 22:18:18.838208 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.838106    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 10 22:18:18.838208 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.838105    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:18.838992 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.838977    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:18.839087 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.839042    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:18.839087 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.839055    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:18.839212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.839201    2582 policy_none.go:49] "None policy: Start"
Sep 10 22:18:18.839246 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.839217    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 10 22:18:18.839246 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.839228    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 10 22:18:18.840369 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.840358    2582 policy_none.go:47] "Start"
Sep 10 22:18:18.840716 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.840623    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-115.ec2.internal.18d41598ff6c34ab  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-115.ec2.internal,UID:ip-10-0-132-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-115.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-115.ec2.internal,},FirstTimestamp:2026-09-10 22:18:18.837423275 +0000 UTC m=+0.379154571,LastTimestamp:2026-09-10 22:18:18.837423275 +0000 UTC m=+0.379154571,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-115.ec2.internal,}"
Sep 10 22:18:18.876628 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.876607    2582 manager.go:337] "Starting Device Plugin manager"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.876661    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.876674    2582 server.go:87] "Starting device plugin registration server"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.877058    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.877069    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.877173    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.877269    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.877283    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.877879    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 10 22:18:18.887519 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.877933    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:18.913233 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.913197    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 10 22:18:18.914633 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.914611    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 10 22:18:18.914722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.914667    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 10 22:18:18.914722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.914689    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 10 22:18:18.914800 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.914733    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 10 22:18:18.918381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.918359    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:18.977646 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.977615    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:18.978652 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.978631    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:18.978768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.978665    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:18.978768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.978674    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:18.978768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.978698    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-115.ec2.internal"
Sep 10 22:18:18.987462 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:18.987376    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-115.ec2.internal"
Sep 10 22:18:18.987462 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:18.987402    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-115.ec2.internal\": node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.006650 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.006628    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.015694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.015669    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"]
Sep 10 22:18:19.015749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.015744    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:19.016153 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.016124    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0826cbfd7ed35407941cad387421f809-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal\" (UID: \"0826cbfd7ed35407941cad387421f809\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.016237 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.016168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0826cbfd7ed35407941cad387421f809-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal\" (UID: \"0826cbfd7ed35407941cad387421f809\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.017265 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.017244    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:19.017333 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.017278    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:19.017333 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.017287    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:19.019518 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.019506    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:19.019667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.019647    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.019715 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.019684    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:19.020287 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.020270    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:19.020363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.020304    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:19.020363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.020318    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:19.020363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.020320    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:19.020363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.020339    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:19.020363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.020357    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:19.022399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.022383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.022472 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.022410    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:19.023086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.023071    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:19.023150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.023104    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:19.023150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.023119    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:19.044790 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.044763    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-115.ec2.internal\" not found" node="ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.049216 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.049200    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-115.ec2.internal\" not found" node="ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.107078 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.107044    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.116366 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.116341    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0826cbfd7ed35407941cad387421f809-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal\" (UID: \"0826cbfd7ed35407941cad387421f809\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.116502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.116368    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0826cbfd7ed35407941cad387421f809-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal\" (UID: \"0826cbfd7ed35407941cad387421f809\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.116502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.116440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0826cbfd7ed35407941cad387421f809-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal\" (UID: \"0826cbfd7ed35407941cad387421f809\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.116502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.116450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0826cbfd7ed35407941cad387421f809-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal\" (UID: \"0826cbfd7ed35407941cad387421f809\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.207851 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.207810    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.217115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.217094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82fcad01bd7bd54ee0f5340fe75828b3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-115.ec2.internal\" (UID: \"82fcad01bd7bd54ee0f5340fe75828b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.308579 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.308513    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.317866 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.317839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82fcad01bd7bd54ee0f5340fe75828b3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-115.ec2.internal\" (UID: \"82fcad01bd7bd54ee0f5340fe75828b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.317924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.317891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82fcad01bd7bd54ee0f5340fe75828b3-config\") pod \"kube-apiserver-proxy-ip-10-0-132-115.ec2.internal\" (UID: \"82fcad01bd7bd54ee0f5340fe75828b3\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.347027 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.346983    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.353429 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.353406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:19.409262 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.409228    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.509744 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.509708    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.610367 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.610280    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.710859 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.710823    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.758375 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.758345    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 10 22:18:19.758776 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.758496    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 10 22:18:19.811067 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.811038    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.812833 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.812813    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:19.832607 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.832571    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-09 22:13:19 +0000 UTC" deadline="2028-03-14 05:59:18.366798121 +0000 UTC"
Sep 10 22:18:19.832607 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.832602    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13207h40m58.53419883s"
Sep 10 22:18:19.911974 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:19.911900    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:19.948210 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:19.948164    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0826cbfd7ed35407941cad387421f809.slice/crio-ffa092e1c389dbce31576fee0e8675a866b3a61646ab0537fff6bfb60c3a2497 WatchSource:0}: Error finding container ffa092e1c389dbce31576fee0e8675a866b3a61646ab0537fff6bfb60c3a2497: Status 404 returned error can't find the container with id ffa092e1c389dbce31576fee0e8675a866b3a61646ab0537fff6bfb60c3a2497
Sep 10 22:18:19.948674 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:19.948648    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82fcad01bd7bd54ee0f5340fe75828b3.slice/crio-2ea492edb38331165e1b4a4df5eae813373c8d4abf6566f2ea2f9a5a7fcb9196 WatchSource:0}: Error finding container 2ea492edb38331165e1b4a4df5eae813373c8d4abf6566f2ea2f9a5a7fcb9196: Status 404 returned error can't find the container with id 2ea492edb38331165e1b4a4df5eae813373c8d4abf6566f2ea2f9a5a7fcb9196
Sep 10 22:18:19.953155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:19.953141    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:18:20.012505 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:20.012471    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:20.041076 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.041051    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 10 22:18:20.042215 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.042194    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientMemory"
Sep 10 22:18:20.042348 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.042227    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasNoDiskPressure"
Sep 10 22:18:20.042348 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.042238    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeHasSufficientPID"
Sep 10 22:18:20.113536 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:20.113495    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-115.ec2.internal\" not found"
Sep 10 22:18:20.183311 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.183222    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:20.216266 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.216244    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:20.237789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.237762    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:18:20.238814 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.238798    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal"
Sep 10 22:18:20.246751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:20.246733    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 10 22:18:21.478095 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.478066    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:21.930246 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.930214    2582 apiserver.go:52] "Watching apiserver"
Sep 10 22:18:21.938804 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.938766    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 10 22:18:21.939188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.939162    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-gksvb","kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4","openshift-cluster-node-tuning-operator/tuned-s27ds","openshift-network-diagnostics/network-check-target-2bz7m","openshift-network-operator/iptables-alerter-xxf84","openshift-ovn-kubernetes/ovnkube-node-lhn65","kube-system/global-pull-secret-syncer-mbgnw","kube-system/konnectivity-agent-pk8xd","openshift-dns/node-resolver-6vhxd","openshift-image-registry/node-ca-5n2rf","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal","openshift-multus/multus-additional-cni-plugins-wdm9n","openshift-multus/multus-qxlr8"]
Sep 10 22:18:21.942153 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.942125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.945063 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.945038    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.945359 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.945336    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.946512 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.946207    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 10 22:18:21.946512 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.946236    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 10 22:18:21.946512 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.946287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 10 22:18:21.946512 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.946292    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5pksw\""
Sep 10 22:18:21.946868 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.946573    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.946868 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.946809    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 10 22:18:21.947068 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.947047    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 10 22:18:21.947448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.947425    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.953422 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.953398    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.953694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.953679    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 10 22:18:21.953989 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.953962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 10 22:18:21.954172 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.953966    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 10 22:18:21.954284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.954263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:21.954359 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.954346    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.954414 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:21.954384    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:21.954573 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.954553    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 10 22:18:21.954701 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.954680    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:21.954701 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.954688    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.954956 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.954939    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.955116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.955101    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5b4mw\""
Sep 10 22:18:21.955352 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.955339    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-57pdx\""
Sep 10 22:18:21.956706 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.956680    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:21.956952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.956929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d118144-0889-4a3b-bda2-cb77b2f26856-ovn-node-metrics-cert\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.957038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.956984    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-socket-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.957038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-device-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.957148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-systemd-units\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.957148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-run-netns\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.957148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957099    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.957148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.957148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cc9l\" (UniqueName: \"kubernetes.io/projected/6d118144-0889-4a3b-bda2-cb77b2f26856-kube-api-access-8cc9l\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.957380 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cnibin\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.957380 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957204    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84z8p\" (UniqueName: \"kubernetes.io/projected/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-kube-api-access-84z8p\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.957380 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957236    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-registration-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.958109 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.957287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4b8qn\" (UniqueName: \"kubernetes.io/projected/ff6bb313-d57b-4bdb-9753-c528432b1210-kube-api-access-4b8qn\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.958219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-slash\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958177    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-lplpg\""
Sep 10 22:18:21.958219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958182    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.958219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-systemd\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958229    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-ovn\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958244    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-node-log\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-ovnkube-script-lib\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-etc-selinux\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958300    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-kubelet\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958358    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-cni-bin\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-cni-netd\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958410    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-sys-fs\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.958423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958423    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958453    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-var-lib-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958515    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-log-socket\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958611    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958666    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-system-cni-dir\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958672    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-env-overrides\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958731    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-etc-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.958777    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-ovnkube-config\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:21.959133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.959026    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:21.960226 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.960204    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.960416 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.960396    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 10 22:18:21.960585 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.960567    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s8xk7\""
Sep 10 22:18:21.960831 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.960806    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 10 22:18:21.961108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.961063    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rj4cd\""
Sep 10 22:18:21.961327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.961309    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 10 22:18:21.961390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.961370    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 10 22:18:21.961746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.961727    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:21.961838 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:21.961817    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:21.965499 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.965479    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:21.968044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.967642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-l2nxd\""
Sep 10 22:18:21.968044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.967902    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 10 22:18:21.968314 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.968298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:21.970804 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.970686    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.970804 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.970759    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:21.970930 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.970890    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.971000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.970980    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-858hx\""
Sep 10 22:18:21.973248 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.973227    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:21.973349 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:21.973304    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:21.974210 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.974185    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 10 22:18:21.974895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.974466    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c8wjg\""
Sep 10 22:18:21.974895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.974520    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 10 22:18:21.974895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.974758    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 10 22:18:21.987217 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.987192    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqwvb"
Sep 10 22:18:21.995388 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:21.995368    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pqwvb"
Sep 10 22:18:22.048426 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.048394    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 10 22:18:22.051299 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.051252    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal" event={"ID":"82fcad01bd7bd54ee0f5340fe75828b3","Type":"ContainerStarted","Data":"2ea492edb38331165e1b4a4df5eae813373c8d4abf6566f2ea2f9a5a7fcb9196"}
Sep 10 22:18:22.052489 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.052455    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal" event={"ID":"0826cbfd7ed35407941cad387421f809","Type":"ContainerStarted","Data":"ffa092e1c389dbce31576fee0e8675a866b3a61646ab0537fff6bfb60c3a2497"}
Sep 10 22:18:22.059148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-run-netns\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059269 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-kubelet\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.059269 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysctl-d\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.059379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4b8qn\" (UniqueName: \"kubernetes.io/projected/ff6bb313-d57b-4bdb-9753-c528432b1210-kube-api-access-4b8qn\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.059379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f80cdeb-4835-4ee5-81f0-916e465a2bf2-konnectivity-ca\") pod \"konnectivity-agent-pk8xd\" (UID: \"8f80cdeb-4835-4ee5-81f0-916e465a2bf2\") " pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.059379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-multus-certs\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.059379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059366    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-socket-dir-parent\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.059379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-run-netns\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysconfig\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed634a41-32e8-43ad-b284-b5b4bb343000-tmp-dir\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059447    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7m2pr\" (UniqueName: \"kubernetes.io/projected/ed634a41-32e8-43ad-b284-b5b4bb343000-kube-api-access-7m2pr\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-ovn\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-etc-selinux\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-sys\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059521    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-kubelet\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059530    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-ovn\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059541    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-cni-bin\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059574    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-cni-netd\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059584    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-cni-bin\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.059597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059589    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-kubelet\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059613    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-etc-selinux\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059642    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-cni-netd\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059603    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-sys-fs\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-cnibin\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059689    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-conf-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059692    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-sys-fs\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08d93491-1457-452a-9960-94f5e6368c19-host\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08d93491-1457-452a-9960-94f5e6368c19-serviceca\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-var-lib-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059809    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-system-cni-dir\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059835    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059876    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-system-cni-dir\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059878    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-var-lib-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-run-ovn-kubernetes\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059895    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-netns\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-var-lib-kubelet\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059943    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9flqt\" (UniqueName: \"kubernetes.io/projected/492072de-e0ad-4717-a43c-032e0642242d-kube-api-access-9flqt\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-env-overrides\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.059993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysctl-conf\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060029    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed634a41-32e8-43ad-b284-b5b4bb343000-hosts-file\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060527    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-ovnkube-config\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060691    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-socket-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060738    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-device-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060775    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f80cdeb-4835-4ee5-81f0-916e465a2bf2-agent-certs\") pod \"konnectivity-agent-pk8xd\" (UID: \"8f80cdeb-4835-4ee5-81f0-916e465a2bf2\") " pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2dhg\" (UniqueName: \"kubernetes.io/projected/08d93491-1457-452a-9960-94f5e6368c19-kube-api-access-k2dhg\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060834    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-modprobe-d\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-socket-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.060888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060870    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-systemd-units\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060938    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-device-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.060971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-systemd-units\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061108    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cc9l\" (UniqueName: \"kubernetes.io/projected/6d118144-0889-4a3b-bda2-cb77b2f26856-kube-api-access-8cc9l\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cnibin\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-system-cni-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061287    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-env-overrides\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-ovnkube-config\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d9ca26-d608-4e13-bfcf-2498ef70565c-tmp\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cnibin\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkkvs\" (UniqueName: \"kubernetes.io/projected/12d9ca26-d608-4e13-bfcf-2498ef70565c-kube-api-access-hkkvs\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.061554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84z8p\" (UniqueName: \"kubernetes.io/projected/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-kube-api-access-84z8p\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-registration-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-daemon-config\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-registration-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061781    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/492072de-e0ad-4717-a43c-032e0642242d-host-slash\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061810    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-slash\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-cni-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-hostroot\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.061978    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-host-slash\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062026    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-systemd\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-lib-modules\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-systemd\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-node-log\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-ovnkube-script-lib\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.062234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062286    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-tuned\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062316    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5cddcb1-7bef-4658-896f-0ab5438faf04-dbus\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062405    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ff6bb313-d57b-4bdb-9753-c528432b1210-kubelet-dir\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062433    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-cni-multus\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062499    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-kubernetes\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062531    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-run\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-systemd\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/492072de-e0ad-4717-a43c-032e0642242d-iptables-alerter-script\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062585    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-node-log\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-log-socket\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909fbf1f-b42a-4c59-91cf-c857341897ac-cni-binary-copy\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062742    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-log-socket\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-k8s-cni-cncf-io\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062818    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-etc-kubernetes\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggkcp\" (UniqueName: \"kubernetes.io/projected/bb2c383e-17d3-4fca-8318-263477372340-kube-api-access-ggkcp\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062892    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-cni-bin\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062919    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5nxv\" (UniqueName: \"kubernetes.io/projected/909fbf1f-b42a-4c59-91cf-c857341897ac-kube-api-access-v5nxv\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.062976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-etc-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d118144-0889-4a3b-bda2-cb77b2f26856-ovn-node-metrics-cert\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-host\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/6d118144-0889-4a3b-bda2-cb77b2f26856-ovnkube-script-lib\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5cddcb1-7bef-4658-896f-0ab5438faf04-kubelet-config\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063208    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-run-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/6d118144-0889-4a3b-bda2-cb77b2f26856-etc-openvswitch\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.063909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.063896    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 10 22:18:22.068754 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.068554    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/6d118144-0889-4a3b-bda2-cb77b2f26856-ovn-node-metrics-cert\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.072910 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.072886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cc9l\" (UniqueName: \"kubernetes.io/projected/6d118144-0889-4a3b-bda2-cb77b2f26856-kube-api-access-8cc9l\") pod \"ovnkube-node-lhn65\" (UID: \"6d118144-0889-4a3b-bda2-cb77b2f26856\") " pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.073083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.072894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4b8qn\" (UniqueName: \"kubernetes.io/projected/ff6bb313-d57b-4bdb-9753-c528432b1210-kube-api-access-4b8qn\") pod \"aws-ebs-csi-driver-node-n75l4\" (UID: \"ff6bb313-d57b-4bdb-9753-c528432b1210\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.073083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.072894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84z8p\" (UniqueName: \"kubernetes.io/projected/9d7b9f91-5cd3-431b-aa58-4988c9a4a316-kube-api-access-84z8p\") pod \"multus-additional-cni-plugins-wdm9n\" (UID: \"9d7b9f91-5cd3-431b-aa58-4988c9a4a316\") " pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.086220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.086172    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 10 22:18:22.163421 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163389    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysctl-conf\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed634a41-32e8-43ad-b284-b5b4bb343000-hosts-file\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163457    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f80cdeb-4835-4ee5-81f0-916e465a2bf2-agent-certs\") pod \"konnectivity-agent-pk8xd\" (UID: \"8f80cdeb-4835-4ee5-81f0-916e465a2bf2\") " pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2dhg\" (UniqueName: \"kubernetes.io/projected/08d93491-1457-452a-9960-94f5e6368c19-kube-api-access-k2dhg\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163511    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-modprobe-d\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163536    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-system-cni-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed634a41-32e8-43ad-b284-b5b4bb343000-hosts-file\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d9ca26-d608-4e13-bfcf-2498ef70565c-tmp\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163576    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkkvs\" (UniqueName: \"kubernetes.io/projected/12d9ca26-d608-4e13-bfcf-2498ef70565c-kube-api-access-hkkvs\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-daemon-config\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.163611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163599    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysctl-conf\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-system-cni-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/492072de-e0ad-4717-a43c-032e0642242d-host-slash\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163817    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-cni-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-hostroot\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-systemd\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-lib-modules\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163913    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-tuned\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163937    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5cddcb1-7bef-4658-896f-0ab5438faf04-dbus\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.163989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-cni-multus\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-kubernetes\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164037    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-run\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/492072de-e0ad-4717-a43c-032e0642242d-iptables-alerter-script\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164090    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909fbf1f-b42a-4c59-91cf-c857341897ac-cni-binary-copy\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164114    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-k8s-cni-cncf-io\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164136    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-etc-kubernetes\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggkcp\" (UniqueName: \"kubernetes.io/projected/bb2c383e-17d3-4fca-8318-263477372340-kube-api-access-ggkcp\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-cni-bin\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v5nxv\" (UniqueName: \"kubernetes.io/projected/909fbf1f-b42a-4c59-91cf-c857341897ac-kube-api-access-v5nxv\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-host\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164263    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5cddcb1-7bef-4658-896f-0ab5438faf04-kubelet-config\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164291    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-kubelet\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.164326    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.164404    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:22.664381485 +0000 UTC m=+3.075505582 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164444    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysctl-d\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164492    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-cni-multus\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-daemon-config\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-kubernetes\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-systemd\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164652    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-run\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-modprobe-d\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.164922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164686    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/492072de-e0ad-4717-a43c-032e0642242d-host-slash\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164720    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-cni-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164727    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f5cddcb1-7bef-4658-896f-0ab5438faf04-dbus\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.164738    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-hostroot\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-cni-bin\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.164795    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:22.664780001 +0000 UTC m=+3.075904092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164314    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysctl-d\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164832    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f80cdeb-4835-4ee5-81f0-916e465a2bf2-konnectivity-ca\") pod \"konnectivity-agent-pk8xd\" (UID: \"8f80cdeb-4835-4ee5-81f0-916e465a2bf2\") " pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164856    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-multus-certs\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-socket-dir-parent\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysconfig\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed634a41-32e8-43ad-b284-b5b4bb343000-tmp-dir\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-host\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.164978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7m2pr\" (UniqueName: \"kubernetes.io/projected/ed634a41-32e8-43ad-b284-b5b4bb343000-kube-api-access-7m2pr\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-sys\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-cnibin\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-conf-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.165761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08d93491-1457-452a-9960-94f5e6368c19-host\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08d93491-1457-452a-9960-94f5e6368c19-serviceca\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165102    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-netns\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-var-lib-kubelet\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9flqt\" (UniqueName: \"kubernetes.io/projected/492072de-e0ad-4717-a43c-032e0642242d-kube-api-access-9flqt\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165181    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/492072de-e0ad-4717-a43c-032e0642242d-iptables-alerter-script\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165249    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-var-lib-kubelet\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165531    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-etc-kubernetes\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165593    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-sys\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165651    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-multus-certs\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165670    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/909fbf1f-b42a-4c59-91cf-c857341897ac-cni-binary-copy\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-socket-dir-parent\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165858    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-cnibin\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165897    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-multus-conf-dir\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-k8s-cni-cncf-io\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/08d93491-1457-452a-9960-94f5e6368c19-host\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.165976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed634a41-32e8-43ad-b284-b5b4bb343000-tmp-dir\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.166576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-sysconfig\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166062    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f5cddcb1-7bef-4658-896f-0ab5438faf04-kubelet-config\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166092    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/909fbf1f-b42a-4c59-91cf-c857341897ac-host-run-netns\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-var-lib-kubelet\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/08d93491-1457-452a-9960-94f5e6368c19-serviceca\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12d9ca26-d608-4e13-bfcf-2498ef70565c-tmp\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8f80cdeb-4835-4ee5-81f0-916e465a2bf2-konnectivity-ca\") pod \"konnectivity-agent-pk8xd\" (UID: \"8f80cdeb-4835-4ee5-81f0-916e465a2bf2\") " pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166719    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12d9ca26-d608-4e13-bfcf-2498ef70565c-lib-modules\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.167448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.166795    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8f80cdeb-4835-4ee5-81f0-916e465a2bf2-agent-certs\") pod \"konnectivity-agent-pk8xd\" (UID: \"8f80cdeb-4835-4ee5-81f0-916e465a2bf2\") " pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.168830 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.168809    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12d9ca26-d608-4e13-bfcf-2498ef70565c-etc-tuned\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.171435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.171415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2dhg\" (UniqueName: \"kubernetes.io/projected/08d93491-1457-452a-9960-94f5e6368c19-kube-api-access-k2dhg\") pod \"node-ca-5n2rf\" (UID: \"08d93491-1457-452a-9960-94f5e6368c19\") " pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.173407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.173351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkkvs\" (UniqueName: \"kubernetes.io/projected/12d9ca26-d608-4e13-bfcf-2498ef70565c-kube-api-access-hkkvs\") pod \"tuned-s27ds\" (UID: \"12d9ca26-d608-4e13-bfcf-2498ef70565c\") " pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.174775 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.174755    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5nxv\" (UniqueName: \"kubernetes.io/projected/909fbf1f-b42a-4c59-91cf-c857341897ac-kube-api-access-v5nxv\") pod \"multus-qxlr8\" (UID: \"909fbf1f-b42a-4c59-91cf-c857341897ac\") " pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.174931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.174906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7m2pr\" (UniqueName: \"kubernetes.io/projected/ed634a41-32e8-43ad-b284-b5b4bb343000-kube-api-access-7m2pr\") pod \"node-resolver-6vhxd\" (UID: \"ed634a41-32e8-43ad-b284-b5b4bb343000\") " pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.176122 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.176103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggkcp\" (UniqueName: \"kubernetes.io/projected/bb2c383e-17d3-4fca-8318-263477372340-kube-api-access-ggkcp\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:22.176517 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.176497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9flqt\" (UniqueName: \"kubernetes.io/projected/492072de-e0ad-4717-a43c-032e0642242d-kube-api-access-9flqt\") pod \"iptables-alerter-xxf84\" (UID: \"492072de-e0ad-4717-a43c-032e0642242d\") " pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.179798 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.179774    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:22.179891 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.179803    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:22.179891 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.179817    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:22.179891 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.179879    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:18:22.679861244 +0000 UTC m=+3.090985333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:22.257916 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.257835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:22.268931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.268902    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wdm9n"
Sep 10 22:18:22.275540 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.275516    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4"
Sep 10 22:18:22.281327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.281303    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qxlr8"
Sep 10 22:18:22.289049 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.289032    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s27ds"
Sep 10 22:18:22.295605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.295584    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xxf84"
Sep 10 22:18:22.302268 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.302243    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:22.308957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.308938    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6vhxd"
Sep 10 22:18:22.314710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.314690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5n2rf"
Sep 10 22:18:22.668167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.668076    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:22.668167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.668123    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:22.668361 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.668229    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:22.668361 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.668229    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:22.668361 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.668288    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:23.668270766 +0000 UTC m=+4.079394841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:22.668361 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.668302    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:23.668295536 +0000 UTC m=+4.079419610 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:22.769376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.769342    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:22.769530 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.769493    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:22.769530 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.769509    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:22.769530 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.769518    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:22.769651 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:22.769573    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:18:23.769557941 +0000 UTC m=+4.180682018 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:22.949377 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.949352    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909fbf1f_b42a_4c59_91cf_c857341897ac.slice/crio-657fb3be84acf8c02731644219a9a152a17a5ed3a7bc7d0b3e5e316375179146 WatchSource:0}: Error finding container 657fb3be84acf8c02731644219a9a152a17a5ed3a7bc7d0b3e5e316375179146: Status 404 returned error can't find the container with id 657fb3be84acf8c02731644219a9a152a17a5ed3a7bc7d0b3e5e316375179146
Sep 10 22:18:22.954044 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.954015    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded634a41_32e8_43ad_b284_b5b4bb343000.slice/crio-dde40fe78abde460146d3d8fe6fc03a0d46912c3b59259f7f721bbc586d75dd5 WatchSource:0}: Error finding container dde40fe78abde460146d3d8fe6fc03a0d46912c3b59259f7f721bbc586d75dd5: Status 404 returned error can't find the container with id dde40fe78abde460146d3d8fe6fc03a0d46912c3b59259f7f721bbc586d75dd5
Sep 10 22:18:22.956868 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.956845    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d118144_0889_4a3b_bda2_cb77b2f26856.slice/crio-bc6f9dc588018caccd0bc16cf4722f728c4ca76ab136ca7dfac2d6054424ccb8 WatchSource:0}: Error finding container bc6f9dc588018caccd0bc16cf4722f728c4ca76ab136ca7dfac2d6054424ccb8: Status 404 returned error can't find the container with id bc6f9dc588018caccd0bc16cf4722f728c4ca76ab136ca7dfac2d6054424ccb8
Sep 10 22:18:22.959315 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.959126    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12d9ca26_d608_4e13_bfcf_2498ef70565c.slice/crio-0a1cf6064d22815cb1b4a4cddc6ea095a4623fe9adca830dd6e0cf9ffc43deae WatchSource:0}: Error finding container 0a1cf6064d22815cb1b4a4cddc6ea095a4623fe9adca830dd6e0cf9ffc43deae: Status 404 returned error can't find the container with id 0a1cf6064d22815cb1b4a4cddc6ea095a4623fe9adca830dd6e0cf9ffc43deae
Sep 10 22:18:22.960083 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.960062    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod492072de_e0ad_4717_a43c_032e0642242d.slice/crio-51e73aeac649392eaa282a57c0422e927badbee22650c716b4378d9cf33b9489 WatchSource:0}: Error finding container 51e73aeac649392eaa282a57c0422e927badbee22650c716b4378d9cf33b9489: Status 404 returned error can't find the container with id 51e73aeac649392eaa282a57c0422e927badbee22650c716b4378d9cf33b9489
Sep 10 22:18:22.961113 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.960990    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff6bb313_d57b_4bdb_9753_c528432b1210.slice/crio-bcec3636332cc376cf2733c84566e50b3c36014f9ae0c3a42efe345edfb40024 WatchSource:0}: Error finding container bcec3636332cc376cf2733c84566e50b3c36014f9ae0c3a42efe345edfb40024: Status 404 returned error can't find the container with id bcec3636332cc376cf2733c84566e50b3c36014f9ae0c3a42efe345edfb40024
Sep 10 22:18:22.961425 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.961390    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08d93491_1457_452a_9960_94f5e6368c19.slice/crio-581037f3053eb607d17a2d4b71f59f02e0cff5571adfad92376a913fb0725b67 WatchSource:0}: Error finding container 581037f3053eb607d17a2d4b71f59f02e0cff5571adfad92376a913fb0725b67: Status 404 returned error can't find the container with id 581037f3053eb607d17a2d4b71f59f02e0cff5571adfad92376a913fb0725b67
Sep 10 22:18:22.962744 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:22.962720    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7b9f91_5cd3_431b_aa58_4988c9a4a316.slice/crio-32f11531fea71bfe10aca6d573771a7415134e8d85fd5dc8cef7e7fb11515ab1 WatchSource:0}: Error finding container 32f11531fea71bfe10aca6d573771a7415134e8d85fd5dc8cef7e7fb11515ab1: Status 404 returned error can't find the container with id 32f11531fea71bfe10aca6d573771a7415134e8d85fd5dc8cef7e7fb11515ab1
Sep 10 22:18:22.998845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.998764    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:13:21 +0000 UTC" deadline="2028-05-04 19:59:40.444184899 +0000 UTC"
Sep 10 22:18:22.998845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:22.998803    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14445h41m17.445385666s"
Sep 10 22:18:23.046360 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.046337    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:23.046499 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.046452    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:23.058101 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.058068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerStarted","Data":"32f11531fea71bfe10aca6d573771a7415134e8d85fd5dc8cef7e7fb11515ab1"}
Sep 10 22:18:23.060487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.060465    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5n2rf" event={"ID":"08d93491-1457-452a-9960-94f5e6368c19","Type":"ContainerStarted","Data":"581037f3053eb607d17a2d4b71f59f02e0cff5571adfad92376a913fb0725b67"}
Sep 10 22:18:23.061831 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.061806    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4" event={"ID":"ff6bb313-d57b-4bdb-9753-c528432b1210","Type":"ContainerStarted","Data":"bcec3636332cc376cf2733c84566e50b3c36014f9ae0c3a42efe345edfb40024"}
Sep 10 22:18:23.066822 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.066800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s27ds" event={"ID":"12d9ca26-d608-4e13-bfcf-2498ef70565c","Type":"ContainerStarted","Data":"0a1cf6064d22815cb1b4a4cddc6ea095a4623fe9adca830dd6e0cf9ffc43deae"}
Sep 10 22:18:23.068497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.068474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk8xd" event={"ID":"8f80cdeb-4835-4ee5-81f0-916e465a2bf2","Type":"ContainerStarted","Data":"3679fbb1e215be7fb16f308df5cafaba6eb65f2ba27d4fc8ebfa21a06c6b7435"}
Sep 10 22:18:23.070760 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.070727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vhxd" event={"ID":"ed634a41-32e8-43ad-b284-b5b4bb343000","Type":"ContainerStarted","Data":"dde40fe78abde460146d3d8fe6fc03a0d46912c3b59259f7f721bbc586d75dd5"}
Sep 10 22:18:23.072742 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.072719    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal" event={"ID":"82fcad01bd7bd54ee0f5340fe75828b3","Type":"ContainerStarted","Data":"871001ae8c3261309158534afbc6a8caa50de0105cc203886dddfd0ae65ddfd3"}
Sep 10 22:18:23.073964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.073944    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xxf84" event={"ID":"492072de-e0ad-4717-a43c-032e0642242d","Type":"ContainerStarted","Data":"51e73aeac649392eaa282a57c0422e927badbee22650c716b4378d9cf33b9489"}
Sep 10 22:18:23.075093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.075074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"bc6f9dc588018caccd0bc16cf4722f728c4ca76ab136ca7dfac2d6054424ccb8"}
Sep 10 22:18:23.076230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.076196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qxlr8" event={"ID":"909fbf1f-b42a-4c59-91cf-c857341897ac","Type":"ContainerStarted","Data":"657fb3be84acf8c02731644219a9a152a17a5ed3a7bc7d0b3e5e316375179146"}
Sep 10 22:18:23.087551 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.087510    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-115.ec2.internal" podStartSLOduration=2.087498431 podStartE2EDuration="2.087498431s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:23.086850347 +0000 UTC m=+3.497974471" watchObservedRunningTime="2026-09-10 22:18:23.087498431 +0000 UTC m=+3.498622527"
Sep 10 22:18:23.676413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.676373    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:23.676600 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.676436    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:23.676688 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.676597    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:23.676688 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.676673    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:25.676655025 +0000 UTC m=+6.087779107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:23.677160 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.677141    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:23.677227 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.677199    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:25.677182609 +0000 UTC m=+6.088306691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:23.777124 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.777063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:23.777426 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.777406    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:23.777500 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.777435    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:23.777500 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.777448    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:23.777592 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:23.777579    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:18:25.777491195 +0000 UTC m=+6.188615289 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:24.000078 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.999916    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-09 22:13:21 +0000 UTC" deadline="2028-06-16 04:55:40.156945248 +0000 UTC"
Sep 10 22:18:24.000078 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:23.999978    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15462h37m16.156971372s"
Sep 10 22:18:24.048774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:24.048733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:24.048934 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:24.048857    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:24.049194 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:24.048733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:24.049314 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:24.049291    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:24.088491 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:24.088458    2582 generic.go:356] "Generic (PLEG): container finished" podID="0826cbfd7ed35407941cad387421f809" containerID="4a1a9fece61f77c3c6784d7cc25cc7de08af067ab2dfbd9a8b9d9f5e8db4d4d7" exitCode=0
Sep 10 22:18:24.088757 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:24.088691    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal" event={"ID":"0826cbfd7ed35407941cad387421f809","Type":"ContainerDied","Data":"4a1a9fece61f77c3c6784d7cc25cc7de08af067ab2dfbd9a8b9d9f5e8db4d4d7"}
Sep 10 22:18:25.045824 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:25.045780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:25.046305 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.045917    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:25.117155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:25.117115    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal" event={"ID":"0826cbfd7ed35407941cad387421f809","Type":"ContainerStarted","Data":"6e09c388bbe120759d3742b2be68c69b7815b22fe189712c7e09bc9f2689b05e"}
Sep 10 22:18:25.692732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:25.692695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:25.692916 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:25.692752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:25.692974 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.692926    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:25.693031 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.692991    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:29.69297309 +0000 UTC m=+10.104097173 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:25.693402 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.693377    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:25.693490 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.693439    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:29.693423835 +0000 UTC m=+10.104547915 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:25.794366 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:25.793918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:25.794366 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.794075    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:25.794366 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.794095    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:25.794366 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.794109    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:25.794366 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:25.794168    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:18:29.794150849 +0000 UTC m=+10.205274937 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:26.047420 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:26.046763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:26.047420 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:26.046903    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:26.050225 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:26.048055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:26.050225 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:26.048172    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:27.046855 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:27.046338    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:27.046855 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:27.046465    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:28.045854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:28.045819    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:28.046299 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:28.045963    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:28.046299 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:28.045990    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:28.046299 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:28.046125    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:29.046166 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:29.046068    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:29.046697 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.046201    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:29.731165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:29.731122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:29.731341 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:29.731175    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:29.731341 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.731336    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:29.731459 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.731397    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:37.731379934 +0000 UTC m=+18.142504014 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:29.731809 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.731791    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:29.731881 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.731846    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:37.731830679 +0000 UTC m=+18.142954758 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:29.832442 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:29.832394    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:29.832654 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.832596    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:29.832654 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.832616    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:29.832654 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.832646    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:29.832825 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:29.832700    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:18:37.832683843 +0000 UTC m=+18.243807938 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:30.047188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:30.047099    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:30.047188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:30.047153    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:30.047654 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:30.047265    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:30.047654 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:30.047422    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:31.046133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:31.045875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:31.046314 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:31.046241    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:32.046399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:32.046365    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:32.046920 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:32.046420    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:32.046920 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:32.046515    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:32.046920 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:32.046671    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:33.045811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:33.045772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:33.046017 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:33.045895    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:34.045981 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:34.045942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:34.046448 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:34.046075    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:34.046580 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:34.046562    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:34.046717 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:34.046699    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:35.045818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:35.045775    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:35.045996 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:35.045890    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:36.045530 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:36.045496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:36.045999 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:36.045496    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:36.045999 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:36.045651    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:36.045999 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:36.045730    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:37.045995 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:37.045957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:37.046450 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.046064    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:37.790307 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:37.790272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:37.790307 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:37.790318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:37.790524 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.790430    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:37.790524 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.790443    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:37.790524 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.790509    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:53.790486974 +0000 UTC m=+34.201611051 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:37.790672 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.790530    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:53.790520492 +0000 UTC m=+34.201644570 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:37.891381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:37.891351    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:37.891557 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.891525    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:37.891557 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.891546    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:37.891557 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.891556    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:37.891714 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:37.891611    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:18:53.891594255 +0000 UTC m=+34.302718330 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:38.045783 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:38.045688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:38.045783 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:38.045738    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:38.045995 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:38.045827    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:38.045995 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:38.045967    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:39.045732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:39.045694    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:39.045936 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:39.045825    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:40.047305 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:40.047273    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:40.047778 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:40.047402    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:40.047778 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:40.047450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:40.047778 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:40.047588    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:41.046307 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:41.046278    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:41.046505 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:41.046391    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:42.046446 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.046400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:42.047382 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:42.046513    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:42.047382 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.046563    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:42.047382 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:42.046686    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:42.163289 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.163244    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"f91501c22fbbc577f382b7fec28dae87564d0f8c640e27fef2be88fdbcfeef18"}
Sep 10 22:18:42.163453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.163331    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"e50ce542c5c02a481b9c33d601cd1a133b4f8fc1e8031196d8f8941d0e69f62c"}
Sep 10 22:18:42.163453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.163379    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"acd8433bb6b0a5a4a4282331208520dd28530320fe571521df18e84ab5c9defa"}
Sep 10 22:18:42.163453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.163419    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"44fb3a1873d68b698ee662fdbe10e426f74b5f6f4d3d91b15693d8038fb6e6f6"}
Sep 10 22:18:42.163595 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.163460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"7115dd9953a8aeabda9af1ffcb34b817f5a06c8b55f3b552ab24f08ee125459d"}
Sep 10 22:18:42.163595 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.163506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"522ac65d5b59300227a9f858419c098e13796534f2e2b178c9823600b018ff3c"}
Sep 10 22:18:42.165009 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.164975    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qxlr8" event={"ID":"909fbf1f-b42a-4c59-91cf-c857341897ac","Type":"ContainerStarted","Data":"6c12d2b85e6fa3290d4671605df02a87b505ca1dfbd870eb12aea2b6cf0912a3"}
Sep 10 22:18:42.166746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.166719    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d7b9f91-5cd3-431b-aa58-4988c9a4a316" containerID="a66456b596ffb7e26257af42e71cd4382c0f105fae80be62615d97a6c8aa0d04" exitCode=0
Sep 10 22:18:42.166859 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.166813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerDied","Data":"a66456b596ffb7e26257af42e71cd4382c0f105fae80be62615d97a6c8aa0d04"}
Sep 10 22:18:42.168664 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.168639    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5n2rf" event={"ID":"08d93491-1457-452a-9960-94f5e6368c19","Type":"ContainerStarted","Data":"5530ea5a7126ddb31c9c61aa9445adac74a1c237c2c3097937d169435661e6bd"}
Sep 10 22:18:42.170492 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.170467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4" event={"ID":"ff6bb313-d57b-4bdb-9753-c528432b1210","Type":"ContainerStarted","Data":"68b4e6880f05702f9a4b511a37e2cb9da0125e4448e005952c3a7b405141f3b7"}
Sep 10 22:18:42.172117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.172090    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s27ds" event={"ID":"12d9ca26-d608-4e13-bfcf-2498ef70565c","Type":"ContainerStarted","Data":"cd38479949f2eb7248ee34532c199568184ccf8992f8b46aa201ce876d579d27"}
Sep 10 22:18:42.177399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.177086    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-pk8xd" event={"ID":"8f80cdeb-4835-4ee5-81f0-916e465a2bf2","Type":"ContainerStarted","Data":"28dbd7cdda724a2a26f51fc09f80772e89ae9c180fbbd8f02efe5ff5895a0c89"}
Sep 10 22:18:42.178592 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.178557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6vhxd" event={"ID":"ed634a41-32e8-43ad-b284-b5b4bb343000","Type":"ContainerStarted","Data":"313e1614d99c6ba427d3d09c4cc9d1bbe031f0295182d6cce67881556e5a5845"}
Sep 10 22:18:42.181363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.181315    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-115.ec2.internal" podStartSLOduration=21.181303731 podStartE2EDuration="21.181303731s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:25.132796539 +0000 UTC m=+5.543920653" watchObservedRunningTime="2026-09-10 22:18:42.181303731 +0000 UTC m=+22.592427827"
Sep 10 22:18:42.181486 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.181465    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qxlr8" podStartSLOduration=4.007288847 podStartE2EDuration="22.181459609s" totalImagesPullingTime="18.174170762s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:42.180964303 +0000 UTC m=+22.592088413" watchObservedRunningTime="2026-09-10 22:18:42.181459609 +0000 UTC m=+22.592583705"
Sep 10 22:18:42.214494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.214442    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s27ds" podStartSLOduration=4.105798723 podStartE2EDuration="22.214427105s" totalImagesPullingTime="18.108628382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:42.214285425 +0000 UTC m=+22.625409547" watchObservedRunningTime="2026-09-10 22:18:42.214427105 +0000 UTC m=+22.625551202"
Sep 10 22:18:42.231940 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.231878    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-pk8xd" podStartSLOduration=11.526453186 podStartE2EDuration="22.231856929s" totalImagesPullingTime="10.705403743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:42.231784839 +0000 UTC m=+22.642908958" watchObservedRunningTime="2026-09-10 22:18:42.231856929 +0000 UTC m=+22.642981029"
Sep 10 22:18:42.262705 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.262653    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6vhxd" podStartSLOduration=4.150933369 podStartE2EDuration="22.262637196s" totalImagesPullingTime="18.111703827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:42.249267479 +0000 UTC m=+22.660391594" watchObservedRunningTime="2026-09-10 22:18:42.262637196 +0000 UTC m=+22.673761330"
Sep 10 22:18:42.262874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.262729    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5n2rf" podStartSLOduration=4.159295365 podStartE2EDuration="22.262725177s" totalImagesPullingTime="18.103429812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:42.26269689 +0000 UTC m=+22.673821006" watchObservedRunningTime="2026-09-10 22:18:42.262725177 +0000 UTC m=+22.673849274"
Sep 10 22:18:42.564787 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:42.564538    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 10 22:18:43.028267 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.028166    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-10T22:18:42.56478269Z","UUID":"096a9186-2b76-4dc2-969b-42296a23924e","Handler":null,"Name":"","Endpoint":""}
Sep 10 22:18:43.029975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.029944    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 10 22:18:43.029975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.029974    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 10 22:18:43.046229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.046203    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:43.046393 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:43.046315    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:43.184025 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.183982    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4" event={"ID":"ff6bb313-d57b-4bdb-9753-c528432b1210","Type":"ContainerStarted","Data":"84f69bfa9c444e75c43bd06c1575999aa30ddb1310eb376b3f52af2d235316dd"}
Sep 10 22:18:43.186017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.185992    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xxf84" event={"ID":"492072de-e0ad-4717-a43c-032e0642242d","Type":"ContainerStarted","Data":"5ba383ed171b1d5c2b908132b06cc6d4e0316c4db03603c24181343037bece23"}
Sep 10 22:18:43.680306 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.680279    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:43.680876 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.680857    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:43.697745 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:43.697687    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xxf84" podStartSLOduration=5.592782721 podStartE2EDuration="23.697667279s" totalImagesPullingTime="18.104884558s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:43.20089534 +0000 UTC m=+23.612019461" watchObservedRunningTime="2026-09-10 22:18:43.697667279 +0000 UTC m=+24.108791377"
Sep 10 22:18:44.045983 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.045952    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:44.046182 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:44.046083    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:44.046182 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.046131    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:44.046298 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:44.046220    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:44.192076 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.192042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"1baa79a163b8933ae27f3a8899a9abdbcac733b8679ac2208f248929eeef2c6e"}
Sep 10 22:18:44.194829 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.194798    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4" event={"ID":"ff6bb313-d57b-4bdb-9753-c528432b1210","Type":"ContainerStarted","Data":"78cc253f877842ea919e6f157bcb90a6ef2b8f47cc96ed4c7c91f87e72e2b335"}
Sep 10 22:18:44.195168 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.195069    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:44.195684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.195669    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-pk8xd"
Sep 10 22:18:44.213083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:44.213028    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-n75l4" podStartSLOduration=3.878344712 podStartE2EDuration="24.21300782s" totalImagesPullingTime="20.334663108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:44.212523419 +0000 UTC m=+24.623647537" watchObservedRunningTime="2026-09-10 22:18:44.21300782 +0000 UTC m=+24.624131919"
Sep 10 22:18:45.046507 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:45.046473    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:45.046697 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:45.046586    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:46.049751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:46.049714    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:46.049751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:46.049726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:46.050253 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:46.049835    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:46.050253 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:46.049951    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:47.046357 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:47.046330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:47.046547 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:47.046431    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:48.049173 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.048998    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:48.049592 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.049060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:48.049592 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:48.049246    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:48.049592 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:48.049322    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:48.205933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.205900    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d7b9f91-5cd3-431b-aa58-4988c9a4a316" containerID="fba332493957e95dec5d8ba0fa4b0a73e64ccf0e37463a47747e43d258f25c65" exitCode=0
Sep 10 22:18:48.206100 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.205988    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerDied","Data":"fba332493957e95dec5d8ba0fa4b0a73e64ccf0e37463a47747e43d258f25c65"}
Sep 10 22:18:48.210037 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.210010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" event={"ID":"6d118144-0889-4a3b-bda2-cb77b2f26856","Type":"ContainerStarted","Data":"52a297ec19254f8c6ee4f6795fccd76bdf7ca9eb0d5189e263308af6b18b6899"}
Sep 10 22:18:48.210327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.210309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:48.225952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.225927    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:48.268882 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:48.268836    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65" podStartSLOduration=10.107390122 podStartE2EDuration="28.268820725s" totalImagesPullingTime="18.161430603s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:48.267523597 +0000 UTC m=+28.678647706" watchObservedRunningTime="2026-09-10 22:18:48.268820725 +0000 UTC m=+28.679944821"
Sep 10 22:18:49.045863 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.045686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:49.045995 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:49.045941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:49.110800 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.110580    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbgnw"]
Sep 10 22:18:49.110800 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.110760    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:49.111557 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:49.110875    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:49.111557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.111285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2bz7m"]
Sep 10 22:18:49.111916 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.111890    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gksvb"]
Sep 10 22:18:49.112052 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.111984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:49.112111 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:49.112079    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:49.215020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.214910    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d7b9f91-5cd3-431b-aa58-4988c9a4a316" containerID="27a93ed1d64f0bcab747d4c373932dd422fbdba9721dedf891b7198d7bcdcc9f" exitCode=0
Sep 10 22:18:49.215020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.214995    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerDied","Data":"27a93ed1d64f0bcab747d4c373932dd422fbdba9721dedf891b7198d7bcdcc9f"}
Sep 10 22:18:49.215243 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.215228    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:49.216192 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:49.215573    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:49.216192 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.215608    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:49.216192 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.215700    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:49.232396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:49.232370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:18:50.220008 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:50.219970    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d7b9f91-5cd3-431b-aa58-4988c9a4a316" containerID="bb8703552ac2ad1b8dc2b770795e3297de3c70e97aa3c3b795057c8ba54bce30" exitCode=0
Sep 10 22:18:50.220438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:50.220054    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerDied","Data":"bb8703552ac2ad1b8dc2b770795e3297de3c70e97aa3c3b795057c8ba54bce30"}
Sep 10 22:18:51.046051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:51.046014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:51.046051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:51.046029    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:51.046260 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:51.046134    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:51.046260 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:51.046233    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:51.046368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:51.046301    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:51.046414 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:51.046380    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:53.046494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.046456    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:53.046494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.046486    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:53.047042 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.046501    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:53.047042 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.046593    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mbgnw" podUID="f5cddcb1-7bef-4658-896f-0ab5438faf04"
Sep 10 22:18:53.047042 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.046742    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2bz7m" podUID="2b3d146b-ce42-47d1-9bb4-327b763a655c"
Sep 10 22:18:53.047042 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.046839    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gksvb" podUID="bb2c383e-17d3-4fca-8318-263477372340"
Sep 10 22:18:53.801712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.801663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:53.801900 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.801773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:53.801900 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.801798    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:53.801900 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.801876    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:53.802042 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.801879    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret podName:f5cddcb1-7bef-4658-896f-0ab5438faf04 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:25.801858767 +0000 UTC m=+66.212982860 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret") pod "global-pull-secret-syncer-mbgnw" (UID: "f5cddcb1-7bef-4658-896f-0ab5438faf04") : object "kube-system"/"original-pull-secret" not registered
Sep 10 22:18:53.802042 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.801974    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs podName:bb2c383e-17d3-4fca-8318-263477372340 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:25.801930702 +0000 UTC m=+66.213054784 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs") pod "network-metrics-daemon-gksvb" (UID: "bb2c383e-17d3-4fca-8318-263477372340") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 10 22:18:53.852542 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.852464    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-115.ec2.internal" event="NodeReady"
Sep 10 22:18:53.852715 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.852640    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 10 22:18:53.902109 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.902075    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bn5nb"]
Sep 10 22:18:53.902375 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.902346    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:53.902514 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.902495    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 10 22:18:53.902575 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.902516    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 10 22:18:53.902575 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.902529    2582 projected.go:196] Error preparing data for projected volume kube-api-access-8wvn7 for pod openshift-network-diagnostics/network-check-target-2bz7m: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:53.902692 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:53.902597    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7 podName:2b3d146b-ce42-47d1-9bb4-327b763a655c nodeName:}" failed. No retries permitted until 2026-09-10 22:19:25.902579209 +0000 UTC m=+66.313703302 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8wvn7" (UniqueName: "kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7") pod "network-check-target-2bz7m" (UID: "2b3d146b-ce42-47d1-9bb4-327b763a655c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 10 22:18:53.966571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.966520    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-hjfcn"]
Sep 10 22:18:53.966758 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.966684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:53.969037 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.969008    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 10 22:18:53.969175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.969051    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-bjgt9\""
Sep 10 22:18:53.969175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.969057    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 10 22:18:53.982339 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.982310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bn5nb"]
Sep 10 22:18:53.982476 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.982356    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjfcn"]
Sep 10 22:18:53.982476 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.982434    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:53.985021 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.984999    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 10 22:18:53.985021 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.985015    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 10 22:18:53.985021 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.985033    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 10 22:18:53.985293 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:53.985095    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fp646\""
Sep 10 22:18:54.103942 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.103870    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mspmj\" (UniqueName: \"kubernetes.io/projected/0103b04b-e98c-4304-ad80-622fa351b2f5-kube-api-access-mspmj\") pod \"ingress-canary-hjfcn\" (UID: \"0103b04b-e98c-4304-ad80-622fa351b2f5\") " pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.103942 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.103911    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgdz5\" (UniqueName: \"kubernetes.io/projected/03779c95-773d-48f1-96c3-00d2e4807249-kube-api-access-kgdz5\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.104324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.103970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03779c95-773d-48f1-96c3-00d2e4807249-config-volume\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.104324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.103987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03779c95-773d-48f1-96c3-00d2e4807249-tmp-dir\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.104324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.104034    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.104324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.104065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0103b04b-e98c-4304-ad80-622fa351b2f5-cert\") pod \"ingress-canary-hjfcn\" (UID: \"0103b04b-e98c-4304-ad80-622fa351b2f5\") " pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.204456 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.204413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mspmj\" (UniqueName: \"kubernetes.io/projected/0103b04b-e98c-4304-ad80-622fa351b2f5-kube-api-access-mspmj\") pod \"ingress-canary-hjfcn\" (UID: \"0103b04b-e98c-4304-ad80-622fa351b2f5\") " pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.204456 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.204460    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgdz5\" (UniqueName: \"kubernetes.io/projected/03779c95-773d-48f1-96c3-00d2e4807249-kube-api-access-kgdz5\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.204752 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.204642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03779c95-773d-48f1-96c3-00d2e4807249-config-volume\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.204752 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.204671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03779c95-773d-48f1-96c3-00d2e4807249-tmp-dir\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.204752 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.204689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.204752 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.204706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0103b04b-e98c-4304-ad80-622fa351b2f5-cert\") pod \"ingress-canary-hjfcn\" (UID: \"0103b04b-e98c-4304-ad80-622fa351b2f5\") " pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.204936 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:54.204813    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:54.204936 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:54.204904    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls podName:03779c95-773d-48f1-96c3-00d2e4807249 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:54.704885618 +0000 UTC m=+35.116009699 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls") pod "dns-default-bn5nb" (UID: "03779c95-773d-48f1-96c3-00d2e4807249") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:54.205123 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.205049    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03779c95-773d-48f1-96c3-00d2e4807249-tmp-dir\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.205266 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.205244    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/03779c95-773d-48f1-96c3-00d2e4807249-config-volume\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.209313 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.209283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0103b04b-e98c-4304-ad80-622fa351b2f5-cert\") pod \"ingress-canary-hjfcn\" (UID: \"0103b04b-e98c-4304-ad80-622fa351b2f5\") " pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.213454 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.213431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgdz5\" (UniqueName: \"kubernetes.io/projected/03779c95-773d-48f1-96c3-00d2e4807249-kube-api-access-kgdz5\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.213559 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.213480    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mspmj\" (UniqueName: \"kubernetes.io/projected/0103b04b-e98c-4304-ad80-622fa351b2f5-kube-api-access-mspmj\") pod \"ingress-canary-hjfcn\" (UID: \"0103b04b-e98c-4304-ad80-622fa351b2f5\") " pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.294119 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.294065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-hjfcn"
Sep 10 22:18:54.590448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.590267    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-hjfcn"]
Sep 10 22:18:54.593987 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:54.593954    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0103b04b_e98c_4304_ad80_622fa351b2f5.slice/crio-4e60e2a70150996f54f335def7b5ccea9b6f6852e37780e7644b1d7f499f53d7 WatchSource:0}: Error finding container 4e60e2a70150996f54f335def7b5ccea9b6f6852e37780e7644b1d7f499f53d7: Status 404 returned error can't find the container with id 4e60e2a70150996f54f335def7b5ccea9b6f6852e37780e7644b1d7f499f53d7
Sep 10 22:18:54.707587 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:54.707556    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:54.707786 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:54.707738    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:54.707840 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:54.707828    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls podName:03779c95-773d-48f1-96c3-00d2e4807249 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:55.707809487 +0000 UTC m=+36.118933566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls") pod "dns-default-bn5nb" (UID: "03779c95-773d-48f1-96c3-00d2e4807249") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:55.046149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.046107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:18:55.046149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.046133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:18:55.046459 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.046125    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:18:55.048581 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.048556    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:18:55.048738 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.048588    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:18:55.049760 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.049429    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4rw4f\""
Sep 10 22:18:55.049760 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.049445    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:18:55.049760 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.049546    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sd8gj\""
Sep 10 22:18:55.049760 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.049395    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:18:55.233810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.233770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjfcn" event={"ID":"0103b04b-e98c-4304-ad80-622fa351b2f5","Type":"ContainerStarted","Data":"4e60e2a70150996f54f335def7b5ccea9b6f6852e37780e7644b1d7f499f53d7"}
Sep 10 22:18:55.237188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.237164    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d7b9f91-5cd3-431b-aa58-4988c9a4a316" containerID="b7c933d2319ce0c16f8c8db7989ba61b97e8cd6583cd984871f0948a08948d76" exitCode=0
Sep 10 22:18:55.237319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.237211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerDied","Data":"b7c933d2319ce0c16f8c8db7989ba61b97e8cd6583cd984871f0948a08948d76"}
Sep 10 22:18:55.716165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:55.716072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:55.716299 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:55.716241    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:55.716347 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:55.716321    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls podName:03779c95-773d-48f1-96c3-00d2e4807249 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:57.7162999 +0000 UTC m=+38.127423980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls") pod "dns-default-bn5nb" (UID: "03779c95-773d-48f1-96c3-00d2e4807249") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:56.242783 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:56.242742    2582 generic.go:356] "Generic (PLEG): container finished" podID="9d7b9f91-5cd3-431b-aa58-4988c9a4a316" containerID="1e78104c15bae4ee5f9e372d80ddf3f801ee94cb806ff68aa3dda0c407957de1" exitCode=0
Sep 10 22:18:56.243332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:56.242813    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerDied","Data":"1e78104c15bae4ee5f9e372d80ddf3f801ee94cb806ff68aa3dda0c407957de1"}
Sep 10 22:18:57.249259 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:57.249158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" event={"ID":"9d7b9f91-5cd3-431b-aa58-4988c9a4a316","Type":"ContainerStarted","Data":"00afa7cdfd93bd6be3f7a23acc106add8b454e6d17e6ca26f19ef5da05eee822"}
Sep 10 22:18:57.250798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:57.250766    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-hjfcn" event={"ID":"0103b04b-e98c-4304-ad80-622fa351b2f5","Type":"ContainerStarted","Data":"5d80b00c6428465ed1357cda5e2ad84308c2a023da1ff0936ae529111ff8491a"}
Sep 10 22:18:57.270051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:57.270001    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wdm9n" podStartSLOduration=8.519809285000001 podStartE2EDuration="37.269986625s" totalImagesPullingTime="28.75017734s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:57.269212001 +0000 UTC m=+37.680336126" watchObservedRunningTime="2026-09-10 22:18:57.269986625 +0000 UTC m=+37.681110721"
Sep 10 22:18:57.283964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:57.283902    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-hjfcn" podStartSLOduration=1.9207881489999998 podStartE2EDuration="4.283885964s" totalImagesPullingTime="2.363097815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:18:57.283192025 +0000 UTC m=+37.694316122" watchObservedRunningTime="2026-09-10 22:18:57.283885964 +0000 UTC m=+37.695010060"
Sep 10 22:18:57.729436 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:57.729402    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:18:57.729589 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:57.729514    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:18:57.729589 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:57.729567    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls podName:03779c95-773d-48f1-96c3-00d2e4807249 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:01.729554931 +0000 UTC m=+42.140679005 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls") pod "dns-default-bn5nb" (UID: "03779c95-773d-48f1-96c3-00d2e4807249") : secret "dns-default-metrics-tls" not found
Sep 10 22:18:58.118983 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.118906    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-lkwmm"]
Sep 10 22:18:58.125865 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.125833    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.128783 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.128761    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 10 22:18:58.128920 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.128852    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 10 22:18:58.128920 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.128869    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 10 22:18:58.128920 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.128899    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 10 22:18:58.129446 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.129428    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27trn\""
Sep 10 22:18:58.136513 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.136338    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lkwmm"]
Sep 10 22:18:58.233108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.233077    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.233257 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.233137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b340d25-776a-4978-a434-d25b18d4f326-crio-socket\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.233257 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.233153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b340d25-776a-4978-a434-d25b18d4f326-data-volume\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.233257 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.233209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.233257 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.233226    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zf5xk\" (UniqueName: \"kubernetes.io/projected/3b340d25-776a-4978-a434-d25b18d4f326-kube-api-access-zf5xk\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.334474 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.334474 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334476    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zf5xk\" (UniqueName: \"kubernetes.io/projected/3b340d25-776a-4978-a434-d25b18d4f326-kube-api-access-zf5xk\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b340d25-776a-4978-a434-d25b18d4f326-crio-socket\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334604    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b340d25-776a-4978-a434-d25b18d4f326-data-volume\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.334606    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.334645    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.334708    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:58.834688543 +0000 UTC m=+39.245812629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.334727    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:58.83471818 +0000 UTC m=+39.245842256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3b340d25-776a-4978-a434-d25b18d4f326-crio-socket\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.335057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.334957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3b340d25-776a-4978-a434-d25b18d4f326-data-volume\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.344067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.344043    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zf5xk\" (UniqueName: \"kubernetes.io/projected/3b340d25-776a-4978-a434-d25b18d4f326-kube-api-access-zf5xk\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.837863 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.837824    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.837863 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.837865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:58.838123 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.837932    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.838123 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.837988    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:59.837972261 +0000 UTC m=+40.249096338 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : configmap "kube-rbac-proxy" not found
Sep 10 22:18:58.838123 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.837998    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.838123 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:58.838063    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:18:59.838044258 +0000 UTC m=+40.249168341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:58.855680 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.855643    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"]
Sep 10 22:18:58.878434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.878401    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"]
Sep 10 22:18:58.878567 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.878509    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"
Sep 10 22:18:58.880773 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.880749    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 10 22:18:58.881704 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.881684    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 10 22:18:58.881808 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:58.881684    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l6xmn\""
Sep 10 22:18:59.040100 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.040063    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vjpl\" (UniqueName: \"kubernetes.io/projected/363926c5-121f-4403-8437-fe358372e1c0-kube-api-access-9vjpl\") pod \"migrator-8b4d697c5-rp9lg\" (UID: \"363926c5-121f-4403-8437-fe358372e1c0\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"
Sep 10 22:18:59.140533 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.140487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vjpl\" (UniqueName: \"kubernetes.io/projected/363926c5-121f-4403-8437-fe358372e1c0-kube-api-access-9vjpl\") pod \"migrator-8b4d697c5-rp9lg\" (UID: \"363926c5-121f-4403-8437-fe358372e1c0\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"
Sep 10 22:18:59.151979 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.151946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vjpl\" (UniqueName: \"kubernetes.io/projected/363926c5-121f-4403-8437-fe358372e1c0-kube-api-access-9vjpl\") pod \"migrator-8b4d697c5-rp9lg\" (UID: \"363926c5-121f-4403-8437-fe358372e1c0\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"
Sep 10 22:18:59.187815 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.187779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"
Sep 10 22:18:59.469515 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.469425    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg"]
Sep 10 22:18:59.474064 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:18:59.474038    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod363926c5_121f_4403_8437_fe358372e1c0.slice/crio-bd92365065323a2dd132832b8cdede86f0a628f111023b4c288f36d6daf6c0f8 WatchSource:0}: Error finding container bd92365065323a2dd132832b8cdede86f0a628f111023b4c288f36d6daf6c0f8: Status 404 returned error can't find the container with id bd92365065323a2dd132832b8cdede86f0a628f111023b4c288f36d6daf6c0f8
Sep 10 22:18:59.846341 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.846296    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:59.846550 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.846391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:18:59.846550 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:59.846437    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:18:59.846550 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:59.846480    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:59.846550 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:59.846520    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:01.846498064 +0000 UTC m=+42.257622163 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : configmap "kube-rbac-proxy" not found
Sep 10 22:18:59.846550 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:18:59.846539    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:01.846530904 +0000 UTC m=+42.257654982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:18:59.863460 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:18:59.863432    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vhxd_ed634a41-32e8-43ad-b284-b5b4bb343000/dns-node-resolver/0.log"
Sep 10 22:19:00.258817 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:00.258777    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg" event={"ID":"363926c5-121f-4403-8437-fe358372e1c0","Type":"ContainerStarted","Data":"bd92365065323a2dd132832b8cdede86f0a628f111023b4c288f36d6daf6c0f8"}
Sep 10 22:19:00.865393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:00.865369    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5n2rf_08d93491-1457-452a-9960-94f5e6368c19/node-ca/0.log"
Sep 10 22:19:01.662980 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:01.662951    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjfcn_0103b04b-e98c-4304-ad80-622fa351b2f5/serve-healthcheck-canary/0.log"
Sep 10 22:19:01.759187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:01.759152    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:19:01.759346 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:01.759326    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 10 22:19:01.759428 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:01.759406    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls podName:03779c95-773d-48f1-96c3-00d2e4807249 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:09.759385553 +0000 UTC m=+50.170509628 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls") pod "dns-default-bn5nb" (UID: "03779c95-773d-48f1-96c3-00d2e4807249") : secret "dns-default-metrics-tls" not found
Sep 10 22:19:01.860410 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:01.860371    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:01.860574 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:01.860421    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:01.860574 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:01.860532    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:01.860574 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:01.860551    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:19:01.860747 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:01.860600    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:05.860582477 +0000 UTC m=+46.271706556 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:01.860747 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:01.860616    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:05.860609594 +0000 UTC m=+46.271733668 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : configmap "kube-rbac-proxy" not found
Sep 10 22:19:02.265642 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:02.265596    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg" event={"ID":"363926c5-121f-4403-8437-fe358372e1c0","Type":"ContainerStarted","Data":"fcfa88a248db1526604ea86ec37b74120531a99d9c131fabf47c6ef66dad74b1"}
Sep 10 22:19:02.266066 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:02.265673    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg" event={"ID":"363926c5-121f-4403-8437-fe358372e1c0","Type":"ContainerStarted","Data":"f095a371ec79abe332bb34d0ac67ec668e4e5400ca39807b3afbdd22e8d60993"}
Sep 10 22:19:02.283667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:02.283598    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-rp9lg" podStartSLOduration=2.556142588 podStartE2EDuration="4.28357949s" totalImagesPullingTime="1.727436902s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:02.282880104 +0000 UTC m=+42.694004230" watchObservedRunningTime="2026-09-10 22:19:02.28357949 +0000 UTC m=+42.694703587"
Sep 10 22:19:05.890788 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:05.890743    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:05.891316 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:05.890848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:05.891316 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:05.890883    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 10 22:19:05.891316 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:05.890936    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:05.891316 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:05.890959    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:13.890941841 +0000 UTC m=+54.302065920 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : configmap "kube-rbac-proxy" not found
Sep 10 22:19:05.891316 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:05.890978    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:13.890966509 +0000 UTC m=+54.302090584 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:09.820480 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:09.820450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:19:09.823272 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:09.823252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/03779c95-773d-48f1-96c3-00d2e4807249-metrics-tls\") pod \"dns-default-bn5nb\" (UID: \"03779c95-773d-48f1-96c3-00d2e4807249\") " pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:19:09.877646 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:09.877594    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:19:10.165310 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:10.165230    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bn5nb"]
Sep 10 22:19:10.168636 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:10.168588    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03779c95_773d_48f1_96c3_00d2e4807249.slice/crio-ae72208bb439e03b48c6546adcac2a1db7cbe9e78d18db0e85eca5d2e5720d73 WatchSource:0}: Error finding container ae72208bb439e03b48c6546adcac2a1db7cbe9e78d18db0e85eca5d2e5720d73: Status 404 returned error can't find the container with id ae72208bb439e03b48c6546adcac2a1db7cbe9e78d18db0e85eca5d2e5720d73
Sep 10 22:19:10.286729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:10.286687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bn5nb" event={"ID":"03779c95-773d-48f1-96c3-00d2e4807249","Type":"ContainerStarted","Data":"ae72208bb439e03b48c6546adcac2a1db7cbe9e78d18db0e85eca5d2e5720d73"}
Sep 10 22:19:13.295789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.295754    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bn5nb" event={"ID":"03779c95-773d-48f1-96c3-00d2e4807249","Type":"ContainerStarted","Data":"b8f1372d8e98337095e1745058ad7b47baca760e554ff70da274192ca47d12cd"}
Sep 10 22:19:13.296197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.295802    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bn5nb" event={"ID":"03779c95-773d-48f1-96c3-00d2e4807249","Type":"ContainerStarted","Data":"722decdf5381d85dc8c198ec265576402f31b5b54ee8cf39797715ff623eed8f"}
Sep 10 22:19:13.296197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.295879    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:19:13.314296 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.314248    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-bn5nb" podStartSLOduration=18.151779618 podStartE2EDuration="20.314230849s" totalImagesPullingTime="2.162451231s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:13.313190575 +0000 UTC m=+53.724314671" watchObservedRunningTime="2026-09-10 22:19:13.314230849 +0000 UTC m=+53.725354945"
Sep 10 22:19:13.952810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.952770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:13.952810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.952816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:13.953028 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:13.952936    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:13.953028 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:19:13.953006    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls podName:3b340d25-776a-4978-a434-d25b18d4f326 nodeName:}" failed. No retries permitted until 2026-09-10 22:19:29.952989357 +0000 UTC m=+70.364113435 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls") pod "insights-runtime-extractor-lkwmm" (UID: "3b340d25-776a-4978-a434-d25b18d4f326") : secret "insights-runtime-extractor-tls" not found
Sep 10 22:19:13.953298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:13.953282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3b340d25-776a-4978-a434-d25b18d4f326-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:21.235165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:21.235137    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-lhn65"
Sep 10 22:19:23.300532 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.300497    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bn5nb"
Sep 10 22:19:23.403543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.403511    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"]
Sep 10 22:19:23.406562 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.406541    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"]
Sep 10 22:19:23.406729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.406695    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.408709 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.408683    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.409471 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.409446    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 10 22:19:23.409588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.409446    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gzrjs\""
Sep 10 22:19:23.411588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.411569    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 10 22:19:23.412521 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.412500    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 10 22:19:23.412654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.412538    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 10 22:19:23.412654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.412642    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 10 22:19:23.412784 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.412671    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 10 22:19:23.412842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.412801    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 10 22:19:23.412936 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.412919    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 10 22:19:23.431247 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.431222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"]
Sep 10 22:19:23.432589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.432572    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"]
Sep 10 22:19:23.523870 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.523836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fcc5cd2-6e28-4ae9-b152-01a3294f46da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55f488547d-lgj8g\" (UID: \"1fcc5cd2-6e28-4ae9-b152-01a3294f46da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.523870 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.523873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-ca\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.524086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.523966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-hub\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.524086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.524008    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.524086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.524045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9cbcl\" (UniqueName: \"kubernetes.io/projected/2781e584-541e-42ff-b05a-3093db10fa9b-kube-api-access-9cbcl\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.524086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.524087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-24fnz\" (UniqueName: \"kubernetes.io/projected/1fcc5cd2-6e28-4ae9-b152-01a3294f46da-kube-api-access-24fnz\") pod \"managed-serviceaccount-addon-agent-55f488547d-lgj8g\" (UID: \"1fcc5cd2-6e28-4ae9-b152-01a3294f46da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.524223 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.524114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.524223 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.524155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2781e584-541e-42ff-b05a-3093db10fa9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.624565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9cbcl\" (UniqueName: \"kubernetes.io/projected/2781e584-541e-42ff-b05a-3093db10fa9b-kube-api-access-9cbcl\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.624565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624516    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-24fnz\" (UniqueName: \"kubernetes.io/projected/1fcc5cd2-6e28-4ae9-b152-01a3294f46da-kube-api-access-24fnz\") pod \"managed-serviceaccount-addon-agent-55f488547d-lgj8g\" (UID: \"1fcc5cd2-6e28-4ae9-b152-01a3294f46da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.624565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624547    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.624565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2781e584-541e-42ff-b05a-3093db10fa9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.624926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624589    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fcc5cd2-6e28-4ae9-b152-01a3294f46da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55f488547d-lgj8g\" (UID: \"1fcc5cd2-6e28-4ae9-b152-01a3294f46da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.624926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-ca\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.624926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624696    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-hub\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.624926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.624731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.625506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.625429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/2781e584-541e-42ff-b05a-3093db10fa9b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.627510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.627476    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.628023 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.627996    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-hub\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.628134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.628035    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.628134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.628045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/1fcc5cd2-6e28-4ae9-b152-01a3294f46da-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-55f488547d-lgj8g\" (UID: \"1fcc5cd2-6e28-4ae9-b152-01a3294f46da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.628134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.628057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/2781e584-541e-42ff-b05a-3093db10fa9b-ca\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.662793 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.662762    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-24fnz\" (UniqueName: \"kubernetes.io/projected/1fcc5cd2-6e28-4ae9-b152-01a3294f46da-kube-api-access-24fnz\") pod \"managed-serviceaccount-addon-agent-55f488547d-lgj8g\" (UID: \"1fcc5cd2-6e28-4ae9-b152-01a3294f46da\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.663367 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.663348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9cbcl\" (UniqueName: \"kubernetes.io/projected/2781e584-541e-42ff-b05a-3093db10fa9b-kube-api-access-9cbcl\") pod \"cluster-proxy-proxy-agent-77dbcb79f9-rsczw\" (UID: \"2781e584-541e-42ff-b05a-3093db10fa9b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:23.726132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.726091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"
Sep 10 22:19:23.730546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:23.730525    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"
Sep 10 22:19:24.020059 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:24.020030    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw"]
Sep 10 22:19:24.023191 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:24.023166    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2781e584_541e_42ff_b05a_3093db10fa9b.slice/crio-b3fa88c12eb7a8bcc849328d8752d843d8a79dd75baa9d1d22644623a32f98ab WatchSource:0}: Error finding container b3fa88c12eb7a8bcc849328d8752d843d8a79dd75baa9d1d22644623a32f98ab: Status 404 returned error can't find the container with id b3fa88c12eb7a8bcc849328d8752d843d8a79dd75baa9d1d22644623a32f98ab
Sep 10 22:19:24.025470 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:24.025235    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g"]
Sep 10 22:19:24.028928 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:24.028905    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1fcc5cd2_6e28_4ae9_b152_01a3294f46da.slice/crio-f566142ff48b9ec7f93128fcd8ce81ad94cfa26892795d1061c7d8d78f1c4994 WatchSource:0}: Error finding container f566142ff48b9ec7f93128fcd8ce81ad94cfa26892795d1061c7d8d78f1c4994: Status 404 returned error can't find the container with id f566142ff48b9ec7f93128fcd8ce81ad94cfa26892795d1061c7d8d78f1c4994
Sep 10 22:19:24.326721 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:24.326608    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw" event={"ID":"2781e584-541e-42ff-b05a-3093db10fa9b","Type":"ContainerStarted","Data":"b3fa88c12eb7a8bcc849328d8752d843d8a79dd75baa9d1d22644623a32f98ab"}
Sep 10 22:19:24.327733 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:24.327709    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g" event={"ID":"1fcc5cd2-6e28-4ae9-b152-01a3294f46da","Type":"ContainerStarted","Data":"f566142ff48b9ec7f93128fcd8ce81ad94cfa26892795d1061c7d8d78f1c4994"}
Sep 10 22:19:25.844483 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.844129    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:19:25.844483 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.844184    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:19:25.846780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.846753    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 10 22:19:25.847580 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.847432    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 10 22:19:25.858175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.858122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f5cddcb1-7bef-4658-896f-0ab5438faf04-original-pull-secret\") pod \"global-pull-secret-syncer-mbgnw\" (UID: \"f5cddcb1-7bef-4658-896f-0ab5438faf04\") " pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:19:25.858977 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.858932    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bb2c383e-17d3-4fca-8318-263477372340-metrics-certs\") pod \"network-metrics-daemon-gksvb\" (UID: \"bb2c383e-17d3-4fca-8318-263477372340\") " pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:19:25.944761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.944718    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:19:25.947651 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.947605    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 10 22:19:25.958128 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.958096    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 10 22:19:25.960004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.959985    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-4rw4f\""
Sep 10 22:19:25.968207 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.968186    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gksvb"
Sep 10 22:19:25.969798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.969776    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvn7\" (UniqueName: \"kubernetes.io/projected/2b3d146b-ce42-47d1-9bb4-327b763a655c-kube-api-access-8wvn7\") pod \"network-check-target-2bz7m\" (UID: \"2b3d146b-ce42-47d1-9bb4-327b763a655c\") " pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:19:25.972426 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:25.972400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mbgnw"
Sep 10 22:19:26.268502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:26.268465    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sd8gj\""
Sep 10 22:19:26.276538 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:26.276514    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:19:28.144852 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.144832    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2bz7m"]
Sep 10 22:19:28.146850 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:28.146822    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b3d146b_ce42_47d1_9bb4_327b763a655c.slice/crio-d7b95cddeb3ac048d1fd6d0cd08f05ff8e61aac34c7ca9b6e9e9182c237d5c9f WatchSource:0}: Error finding container d7b95cddeb3ac048d1fd6d0cd08f05ff8e61aac34c7ca9b6e9e9182c237d5c9f: Status 404 returned error can't find the container with id d7b95cddeb3ac048d1fd6d0cd08f05ff8e61aac34c7ca9b6e9e9182c237d5c9f
Sep 10 22:19:28.158460 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.158439    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gksvb"]
Sep 10 22:19:28.161410 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:28.161387    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb2c383e_17d3_4fca_8318_263477372340.slice/crio-6b8cd67657ee0b53bfc4e9cc6c350652c89e5b55c376d2b20276c5eeadc5a048 WatchSource:0}: Error finding container 6b8cd67657ee0b53bfc4e9cc6c350652c89e5b55c376d2b20276c5eeadc5a048: Status 404 returned error can't find the container with id 6b8cd67657ee0b53bfc4e9cc6c350652c89e5b55c376d2b20276c5eeadc5a048
Sep 10 22:19:28.167303 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.167276    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mbgnw"]
Sep 10 22:19:28.170234 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:28.170210    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cddcb1_7bef_4658_896f_0ab5438faf04.slice/crio-6c755b72f9156e1e3a50bb40c2651e5a7a8823bd549f506a6bfc2e3c5fdaf931 WatchSource:0}: Error finding container 6c755b72f9156e1e3a50bb40c2651e5a7a8823bd549f506a6bfc2e3c5fdaf931: Status 404 returned error can't find the container with id 6c755b72f9156e1e3a50bb40c2651e5a7a8823bd549f506a6bfc2e3c5fdaf931
Sep 10 22:19:28.342207 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.342168    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbgnw" event={"ID":"f5cddcb1-7bef-4658-896f-0ab5438faf04","Type":"ContainerStarted","Data":"6c755b72f9156e1e3a50bb40c2651e5a7a8823bd549f506a6bfc2e3c5fdaf931"}
Sep 10 22:19:28.343383 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.343355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gksvb" event={"ID":"bb2c383e-17d3-4fca-8318-263477372340","Type":"ContainerStarted","Data":"6b8cd67657ee0b53bfc4e9cc6c350652c89e5b55c376d2b20276c5eeadc5a048"}
Sep 10 22:19:28.345347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.345323    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw" event={"ID":"2781e584-541e-42ff-b05a-3093db10fa9b","Type":"ContainerStarted","Data":"3d3149670ea9b68a036db97a294b382f40b93ffe762810fd0836940f203d001b"}
Sep 10 22:19:28.345477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.345362    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw" event={"ID":"2781e584-541e-42ff-b05a-3093db10fa9b","Type":"ContainerStarted","Data":"c0d388ad847eeed7d5183de1d207be00707a92c2af7723aaa8e3135956166ab6"}
Sep 10 22:19:28.345477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.345380    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw" event={"ID":"2781e584-541e-42ff-b05a-3093db10fa9b","Type":"ContainerStarted","Data":"33224ca876b657b3752e01b24caf8bf2bbff125d14e5af3336f6b64476b36cde"}
Sep 10 22:19:28.346513 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.346491    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2bz7m" event={"ID":"2b3d146b-ce42-47d1-9bb4-327b763a655c","Type":"ContainerStarted","Data":"d7b95cddeb3ac048d1fd6d0cd08f05ff8e61aac34c7ca9b6e9e9182c237d5c9f"}
Sep 10 22:19:28.348075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.348056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g" event={"ID":"1fcc5cd2-6e28-4ae9-b152-01a3294f46da","Type":"ContainerStarted","Data":"459496d2de5f188bdc9b0a946277e0d6b186bc2dcf3ab022ef0caf4ab20c891d"}
Sep 10 22:19:28.367108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.367060    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77dbcb79f9-rsczw" podStartSLOduration=1.497419481 podStartE2EDuration="5.367044654s" totalImagesPullingTime="3.869625173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:28.365503043 +0000 UTC m=+68.776627140" watchObservedRunningTime="2026-09-10 22:19:28.367044654 +0000 UTC m=+68.778168750"
Sep 10 22:19:28.383118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:28.383073    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-55f488547d-lgj8g" podStartSLOduration=1.543051478 podStartE2EDuration="5.383057378s" totalImagesPullingTime="3.8400059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:28.38287176 +0000 UTC m=+68.793995851" watchObservedRunningTime="2026-09-10 22:19:28.383057378 +0000 UTC m=+68.794181474"
Sep 10 22:19:29.355602 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:29.355553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gksvb" event={"ID":"bb2c383e-17d3-4fca-8318-263477372340","Type":"ContainerStarted","Data":"f718015345450943ba7a3a4163739c79db02587b949a8fffa4e5a04af1334654"}
Sep 10 22:19:29.980243 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:29.980205    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:29.983260 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:29.983235    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3b340d25-776a-4978-a434-d25b18d4f326-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-lkwmm\" (UID: \"3b340d25-776a-4978-a434-d25b18d4f326\") " pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:30.238844 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:30.238752    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-27trn\""
Sep 10 22:19:30.246293 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:30.246033    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-lkwmm"
Sep 10 22:19:30.362847 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:30.362804    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gksvb" event={"ID":"bb2c383e-17d3-4fca-8318-263477372340","Type":"ContainerStarted","Data":"3adc48ab78a020583ab99f096ecb618e989f4a4cf5f278f1326fe9289c7c62a8"}
Sep 10 22:19:30.396041 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:30.395982    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gksvb" podStartSLOduration=69.388284409 podStartE2EDuration="1m10.395965487s" totalImagesPullingTime="1.007681078s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:30.38929655 +0000 UTC m=+70.800420666" watchObservedRunningTime="2026-09-10 22:19:30.395965487 +0000 UTC m=+70.807089583"
Sep 10 22:19:30.535798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:30.535768    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-lkwmm"]
Sep 10 22:19:30.537737 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:30.537703    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b340d25_776a_4978_a434_d25b18d4f326.slice/crio-2b66a2b1db7cc72ae56ae7594243e853f01528694ee4932b208b6db543be0dbe WatchSource:0}: Error finding container 2b66a2b1db7cc72ae56ae7594243e853f01528694ee4932b208b6db543be0dbe: Status 404 returned error can't find the container with id 2b66a2b1db7cc72ae56ae7594243e853f01528694ee4932b208b6db543be0dbe
Sep 10 22:19:31.368565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:31.368526    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lkwmm" event={"ID":"3b340d25-776a-4978-a434-d25b18d4f326","Type":"ContainerStarted","Data":"76803489495e1a04a7c3cbeb4d0c47d42cde901f92741ac2dae8bcd029643d07"}
Sep 10 22:19:31.369054 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:31.368606    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lkwmm" event={"ID":"3b340d25-776a-4978-a434-d25b18d4f326","Type":"ContainerStarted","Data":"2b66a2b1db7cc72ae56ae7594243e853f01528694ee4932b208b6db543be0dbe"}
Sep 10 22:19:33.376918 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:33.376882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2bz7m" event={"ID":"2b3d146b-ce42-47d1-9bb4-327b763a655c","Type":"ContainerStarted","Data":"e698e3e68602b10d6fb44097186afe3f5016275330b6d10b05579f9d4b1e83bb"}
Sep 10 22:19:33.377350 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:33.376949    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:19:33.378814 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:33.378783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lkwmm" event={"ID":"3b340d25-776a-4978-a434-d25b18d4f326","Type":"ContainerStarted","Data":"d3d8e70b93085ce7a81a910108dcaee540c41d291993abd8c2498fce1323be0c"}
Sep 10 22:19:33.380320 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:33.380295    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mbgnw" event={"ID":"f5cddcb1-7bef-4658-896f-0ab5438faf04","Type":"ContainerStarted","Data":"9f3b5e4f11b73292d130c8e5868a75948dbec9e58872e8191fa62051a2bce15d"}
Sep 10 22:19:33.392972 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:33.392935    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2bz7m" podStartSLOduration=68.539889733 podStartE2EDuration="1m13.392919896s" totalImagesPullingTime="4.853030163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:33.392688865 +0000 UTC m=+73.803812982" watchObservedRunningTime="2026-09-10 22:19:33.392919896 +0000 UTC m=+73.804043992"
Sep 10 22:19:33.410503 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:33.410453    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mbgnw" podStartSLOduration=68.573564445 podStartE2EDuration="1m13.410435741s" totalImagesPullingTime="4.836871296s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:33.409838414 +0000 UTC m=+73.820962537" watchObservedRunningTime="2026-09-10 22:19:33.410435741 +0000 UTC m=+73.821559895"
Sep 10 22:19:35.170434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.170395    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nmdwj"]
Sep 10 22:19:35.173526 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.173506    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.178944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.178920    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 10 22:19:35.179492 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.179336    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 10 22:19:35.179492 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.179361    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 10 22:19:35.179492 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.179475    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 10 22:19:35.179713 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.179609    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 10 22:19:35.180029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.180014    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 10 22:19:35.183370 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.183351    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tmkzm\""
Sep 10 22:19:35.215036 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215010    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-tls\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215179 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-accelerators-collector-config\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215179 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215312 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-root\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215312 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-sys\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-wtmp\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215365    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-textfile\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09a67ff0-e2f1-49fa-a681-9437849d6d90-metrics-client-ca\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.215413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.215409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6sk5\" (UniqueName: \"kubernetes.io/projected/09a67ff0-e2f1-49fa-a681-9437849d6d90-kube-api-access-n6sk5\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316370 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-root\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316404    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-sys\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316448    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-sys\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-root\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316504    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-wtmp\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-textfile\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316577    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09a67ff0-e2f1-49fa-a681-9437849d6d90-metrics-client-ca\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316594    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6sk5\" (UniqueName: \"kubernetes.io/projected/09a67ff0-e2f1-49fa-a681-9437849d6d90-kube-api-access-n6sk5\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-tls\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316687    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-accelerators-collector-config\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.316884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.316653    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-wtmp\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.317106 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.317020    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-textfile\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.317244 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.317226    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/09a67ff0-e2f1-49fa-a681-9437849d6d90-metrics-client-ca\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.317732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.317709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-accelerators-collector-config\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.318915 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.318895    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.319017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.318997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/09a67ff0-e2f1-49fa-a681-9437849d6d90-node-exporter-tls\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.326212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.326187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6sk5\" (UniqueName: \"kubernetes.io/projected/09a67ff0-e2f1-49fa-a681-9437849d6d90-kube-api-access-n6sk5\") pod \"node-exporter-nmdwj\" (UID: \"09a67ff0-e2f1-49fa-a681-9437849d6d90\") " pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.390388 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.390348    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-lkwmm" event={"ID":"3b340d25-776a-4978-a434-d25b18d4f326","Type":"ContainerStarted","Data":"2d45d0970663f918d28fe81da8383ae5b7f6cfac98f1230f7536a247f8ed2439"}
Sep 10 22:19:35.416393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.416337    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-lkwmm" podStartSLOduration=33.551061274 podStartE2EDuration="37.416320563s" totalImagesPullingTime="3.865259289s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:18:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:35.415970842 +0000 UTC m=+75.827094939" watchObservedRunningTime="2026-09-10 22:19:35.416320563 +0000 UTC m=+75.827444694"
Sep 10 22:19:35.482319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:35.482286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nmdwj"
Sep 10 22:19:35.493799 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:35.493769    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a67ff0_e2f1_49fa_a681_9437849d6d90.slice/crio-df2b71715751e5f5c2c5666c3b5d690dadf1827caefaa6a9658357200779bb14 WatchSource:0}: Error finding container df2b71715751e5f5c2c5666c3b5d690dadf1827caefaa6a9658357200779bb14: Status 404 returned error can't find the container with id df2b71715751e5f5c2c5666c3b5d690dadf1827caefaa6a9658357200779bb14
Sep 10 22:19:36.397124 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:36.397051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmdwj" event={"ID":"09a67ff0-e2f1-49fa-a681-9437849d6d90","Type":"ContainerStarted","Data":"df2b71715751e5f5c2c5666c3b5d690dadf1827caefaa6a9658357200779bb14"}
Sep 10 22:19:37.402458 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:37.402421    2582 generic.go:356] "Generic (PLEG): container finished" podID="09a67ff0-e2f1-49fa-a681-9437849d6d90" containerID="499c4995b73a03ce18092c6dc92391b8fce136748e6aa75727a6a119e156a450" exitCode=0
Sep 10 22:19:37.402857 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:37.402467    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmdwj" event={"ID":"09a67ff0-e2f1-49fa-a681-9437849d6d90","Type":"ContainerDied","Data":"499c4995b73a03ce18092c6dc92391b8fce136748e6aa75727a6a119e156a450"}
Sep 10 22:19:38.412093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:38.412056    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmdwj" event={"ID":"09a67ff0-e2f1-49fa-a681-9437849d6d90","Type":"ContainerStarted","Data":"d18bd4ccf3e71b79d07272b20052840f70c0fe1ab83c33c1e3a08c2821dec698"}
Sep 10 22:19:38.412470 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:38.412137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nmdwj" event={"ID":"09a67ff0-e2f1-49fa-a681-9437849d6d90","Type":"ContainerStarted","Data":"c4de683ca7ec241db0523c3462ebc01fecaa1efb2d5bc6dd6399940f704efe9c"}
Sep 10 22:19:38.431907 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:38.431859    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nmdwj" podStartSLOduration=2.078182772 podStartE2EDuration="3.431842907s" totalImagesPullingTime="1.284849556s" totalInitContainerRuntime="68.810579ms" isStatefulPod=true podCreationTimestamp="2026-09-10 22:19:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:38.430278088 +0000 UTC m=+78.841402201" watchObservedRunningTime="2026-09-10 22:19:38.431842907 +0000 UTC m=+78.842967047"
Sep 10 22:19:40.311616 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.311582    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"]
Sep 10 22:19:40.314597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.314580    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.318654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.318614    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 10 22:19:40.319223 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.319191    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2n256\""
Sep 10 22:19:40.319352 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.319245    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 10 22:19:40.319352 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.319341    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 10 22:19:40.324589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.324571    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 10 22:19:40.324722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.324571    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 10 22:19:40.327497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.327478    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 10 22:19:40.351887 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.351849    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-secret-telemeter-client\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.351887 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.351885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-telemeter-client-tls\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.352135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.351905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-metrics-client-ca\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.352135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.351929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.352135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.352056    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.352253 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.352139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgtmk\" (UniqueName: \"kubernetes.io/projected/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-kube-api-access-dgtmk\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.352253 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.352216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-federate-client-tls\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.352328 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.352309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-serving-certs-ca-bundle\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.354687 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.354663    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"]
Sep 10 22:19:40.453431 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453400    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-secret-telemeter-client\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453431 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-telemeter-client-tls\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453451    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-metrics-client-ca\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453488    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgtmk\" (UniqueName: \"kubernetes.io/projected/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-kube-api-access-dgtmk\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453526    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-federate-client-tls\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.453722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.453663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-serving-certs-ca-bundle\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.454442 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.454381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-metrics-client-ca\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.454611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.454542    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-serving-certs-ca-bundle\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.455266 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.455238    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.456281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.456251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-federate-client-tls\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.456379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.456362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-secret-telemeter-client\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.456502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.456481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-telemeter-client-tls\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.456579 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.456560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.463111 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.463087    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgtmk\" (UniqueName: \"kubernetes.io/projected/57593d0d-eb49-48cd-a7fb-ffefd79bca0e-kube-api-access-dgtmk\") pod \"telemeter-client-5c4f4d5954-6fn7j\" (UID: \"57593d0d-eb49-48cd-a7fb-ffefd79bca0e\") " pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.624107 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.624024    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"
Sep 10 22:19:40.903129 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:40.901877    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j"]
Sep 10 22:19:40.905996 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:19:40.905970    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57593d0d_eb49_48cd_a7fb_ffefd79bca0e.slice/crio-bf712c60569c2112ffbc2f445f40ebbdfb4b7d551bef35b5cd4a5c707a29aa80 WatchSource:0}: Error finding container bf712c60569c2112ffbc2f445f40ebbdfb4b7d551bef35b5cd4a5c707a29aa80: Status 404 returned error can't find the container with id bf712c60569c2112ffbc2f445f40ebbdfb4b7d551bef35b5cd4a5c707a29aa80
Sep 10 22:19:41.292887 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.292855    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:19:41.297435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.297415    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.300416 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.300391    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 22:19:41.303514 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.303491    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 22:19:41.304478 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.304457    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f6tcj08rcf4t2\""
Sep 10 22:19:41.304585 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.304565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 22:19:41.304952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.304934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x749g\""
Sep 10 22:19:41.304999 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.304934    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 22:19:41.306512 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.306499    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 22:19:41.307802 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.307786    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 22:19:41.307852 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.307818    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 22:19:41.307957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.307913    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 22:19:41.307957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.307926    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 22:19:41.307957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.307931    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 22:19:41.308063 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.307926    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 22:19:41.308112 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.308077    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 22:19:41.308298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.308286    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 22:19:41.308695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.308680    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 22:19:41.312194 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.312177    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 22:19:41.320406 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.320376    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:19:41.360172 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360143    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360172 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360175    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360207    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-config\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360279    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360423 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360445    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360483    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360532    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360550    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzwb4\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-kube-api-access-dzwb4\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.360960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.360805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.422952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.422906    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j" event={"ID":"57593d0d-eb49-48cd-a7fb-ffefd79bca0e","Type":"ContainerStarted","Data":"bf712c60569c2112ffbc2f445f40ebbdfb4b7d551bef35b5cd4a5c707a29aa80"}
Sep 10 22:19:41.461751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461864    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461892    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzwb4\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-kube-api-access-dzwb4\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.461943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461969    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.461988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462002    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462056    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462071    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462126    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-config\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.462283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.464017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.462786    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.464017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.463610    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.465265 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.464539    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.465508 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.465483    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.466343 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.466312    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.467361 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.467337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-web-config\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.467591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.467569    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-config-out\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.467794 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.467767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.467891 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.467860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.468104 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.468082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.468260 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.468237    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.468322 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.468288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.468394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.468371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.468445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.468396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.469463 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.469413    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-config\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.469556 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.469495    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.470304 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.470261    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.470792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.470766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.471650 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.471608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.473033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.473015    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzwb4\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-kube-api-access-dzwb4\") pod \"prometheus-k8s-0\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.607025 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.606932    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:19:41.898356 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:41.898279    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:19:42.429080 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:42.429038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"5eab7bcb07166d8a844e6109a58dd165f195c691e8bbcc19017b424e8ca4a984"}
Sep 10 22:19:43.435673 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:43.435556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j" event={"ID":"57593d0d-eb49-48cd-a7fb-ffefd79bca0e","Type":"ContainerStarted","Data":"78c3ad278d88af7cb16e8a316fd51be34aa20f2529dc5ae2c5875e80a6406c51"}
Sep 10 22:19:43.436095 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:43.435689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j" event={"ID":"57593d0d-eb49-48cd-a7fb-ffefd79bca0e","Type":"ContainerStarted","Data":"c495abd38c7ba6ab7d3fa59b3a3c0b50ea9d19592c03b6c7fd15d87ed9b3d916"}
Sep 10 22:19:43.436095 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:43.435724    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j" event={"ID":"57593d0d-eb49-48cd-a7fb-ffefd79bca0e","Type":"ContainerStarted","Data":"c587182654f31061d5f62ba591da6dfeb0402869834ec303a56596430b8d9bc7"}
Sep 10 22:19:43.437271 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:43.437248    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="f12fc4a161ef0491a4a9c8906126de154bf11c7ae35cc4f97eb355de444bc9e0" exitCode=0
Sep 10 22:19:43.437386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:43.437280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"f12fc4a161ef0491a4a9c8906126de154bf11c7ae35cc4f97eb355de444bc9e0"}
Sep 10 22:19:43.462588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:43.462528    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c4f4d5954-6fn7j" podStartSLOduration=1.291884107 podStartE2EDuration="3.462509705s" totalImagesPullingTime="2.170625598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:43.461590177 +0000 UTC m=+83.872714275" watchObservedRunningTime="2026-09-10 22:19:43.462509705 +0000 UTC m=+83.873633802"
Sep 10 22:19:47.456933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:47.456895    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"be32d06ba6778dbf8ae5a0fdaef7d30fd6cc5cbf7ec007493b0bfd208e8fbe62"}
Sep 10 22:19:47.457382 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:47.456970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"b0685f309e714ee68b696c6382e1baa97afa00294a1d9dd14d24658e5c9fa327"}
Sep 10 22:19:48.463773 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:48.463742    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"1a13981d31df61a945de45eeb256224a27a68826b8f40de72b74660ac27b7b54"}
Sep 10 22:19:48.464071 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:48.463807    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"2236ab581d649ccac5f865bea6ab42d8482f086dcdc2585981504538cbb4929a"}
Sep 10 22:19:48.464071 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:48.463832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"95a36875e949c36cfc44e942ce42e78609e2af0f320500f143149060f38a33d8"}
Sep 10 22:19:49.471317 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:49.471279    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerStarted","Data":"d17b6d5966a115e7062979ee0675571cbfbfcbab5bf0e32c9d76173a71a2f86b"}
Sep 10 22:19:49.510863 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:49.510798    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.666853161 podStartE2EDuration="8.510777116s" totalImagesPullingTime="5.821658101s" totalInitContainerRuntime="22.265854ms" isStatefulPod=false podCreationTimestamp="2026-09-10 22:19:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:19:49.509787651 +0000 UTC m=+89.920911769" watchObservedRunningTime="2026-09-10 22:19:49.510777116 +0000 UTC m=+89.921901214"
Sep 10 22:19:51.607673 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:19:51.607612    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:20:04.386773 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:04.386732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2bz7m"
Sep 10 22:20:41.607643 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:41.607597    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:20:41.629387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:41.629358    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:20:41.674581 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:41.674549    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:20:59.595062 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595022    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:20:59.595469 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595341    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="prometheus" containerID="cri-o://b0685f309e714ee68b696c6382e1baa97afa00294a1d9dd14d24658e5c9fa327" gracePeriod=600
Sep 10 22:20:59.595469 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595369    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d17b6d5966a115e7062979ee0675571cbfbfcbab5bf0e32c9d76173a71a2f86b" gracePeriod=600
Sep 10 22:20:59.595469 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595395    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="thanos-sidecar" containerID="cri-o://95a36875e949c36cfc44e942ce42e78609e2af0f320500f143149060f38a33d8" gracePeriod=600
Sep 10 22:20:59.595696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595445    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-web" containerID="cri-o://2236ab581d649ccac5f865bea6ab42d8482f086dcdc2585981504538cbb4929a" gracePeriod=600
Sep 10 22:20:59.595696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595342    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy" containerID="cri-o://1a13981d31df61a945de45eeb256224a27a68826b8f40de72b74660ac27b7b54" gracePeriod=600
Sep 10 22:20:59.595696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.595445    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="config-reloader" containerID="cri-o://be32d06ba6778dbf8ae5a0fdaef7d30fd6cc5cbf7ec007493b0bfd208e8fbe62" gracePeriod=600
Sep 10 22:20:59.720712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720682    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="d17b6d5966a115e7062979ee0675571cbfbfcbab5bf0e32c9d76173a71a2f86b" exitCode=0
Sep 10 22:20:59.720712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720710    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="1a13981d31df61a945de45eeb256224a27a68826b8f40de72b74660ac27b7b54" exitCode=0
Sep 10 22:20:59.720842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720718    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="95a36875e949c36cfc44e942ce42e78609e2af0f320500f143149060f38a33d8" exitCode=0
Sep 10 22:20:59.720842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720726    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="be32d06ba6778dbf8ae5a0fdaef7d30fd6cc5cbf7ec007493b0bfd208e8fbe62" exitCode=0
Sep 10 22:20:59.720842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720734    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="b0685f309e714ee68b696c6382e1baa97afa00294a1d9dd14d24658e5c9fa327" exitCode=0
Sep 10 22:20:59.720842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720745    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"d17b6d5966a115e7062979ee0675571cbfbfcbab5bf0e32c9d76173a71a2f86b"}
Sep 10 22:20:59.720842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720814    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"1a13981d31df61a945de45eeb256224a27a68826b8f40de72b74660ac27b7b54"}
Sep 10 22:20:59.720842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"95a36875e949c36cfc44e942ce42e78609e2af0f320500f143149060f38a33d8"}
Sep 10 22:20:59.721030 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720891    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"be32d06ba6778dbf8ae5a0fdaef7d30fd6cc5cbf7ec007493b0bfd208e8fbe62"}
Sep 10 22:20:59.721030 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:20:59.720916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"b0685f309e714ee68b696c6382e1baa97afa00294a1d9dd14d24658e5c9fa327"}
Sep 10 22:21:00.728944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.728914    2582 generic.go:356] "Generic (PLEG): container finished" podID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerID="2236ab581d649ccac5f865bea6ab42d8482f086dcdc2585981504538cbb4929a" exitCode=0
Sep 10 22:21:00.729289 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.728989    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"2236ab581d649ccac5f865bea6ab42d8482f086dcdc2585981504538cbb4929a"}
Sep 10 22:21:00.842109 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.842086    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:00.875526 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875504    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-kubelet-serving-ca-bundle\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875538    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-db\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875559    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-kube-rbac-proxy\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875574    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-grpc-tls\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875592    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-metrics-client-ca\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875609    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-1\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875659    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-thanos-prometheus-http-client-file\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875697    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-serving-certs-ca-bundle\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875729    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-tls-assets\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875751    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dzwb4\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-kube-api-access-dzwb4\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875796    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-config-out\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875829    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-metrics-client-certs\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875859    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-0\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.875895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-2\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875919    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-web-config\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875948    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-tls\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.875975    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-config\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.876003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-trusted-ca-bundle\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.876005    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.876041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"39f986bd-bdca-40e6-8406-857a65b07f7a\" (UID: \"39f986bd-bdca-40e6-8406-857a65b07f7a\") "
Sep 10 22:21:00.876346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.876259    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-metrics-client-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.877222 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.876354    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.877281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.877228    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.880612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.877573    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.880612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.877659    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.880612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.878020    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.880612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.879316    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:21:00.880612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.880558    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:00.881024 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.880839    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.882724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.881543    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-kube-api-access-dzwb4" (OuterVolumeSpecName: "kube-api-access-dzwb4") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "kube-api-access-dzwb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:00.882724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.882114    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-config-out" (OuterVolumeSpecName: "config-out") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:21:00.882724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.882220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.882724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.882313    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.882724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.882462    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.883138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.883113    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.883340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.883317    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-config" (OuterVolumeSpecName: "config") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.883690 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.883663    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:21:00.884348 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.884126    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.884702 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.884471    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.892958 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.892810    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-web-config" (OuterVolumeSpecName: "web-config") pod "39f986bd-bdca-40e6-8406-857a65b07f7a" (UID: "39f986bd-bdca-40e6-8406-857a65b07f7a"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:21:00.977490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977462    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977492    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-db\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977502    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-kube-rbac-proxy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977512    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-grpc-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977522    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977530    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977539    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977548    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-tls-assets\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977556    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dzwb4\" (UniqueName: \"kubernetes.io/projected/39f986bd-bdca-40e6-8406-857a65b07f7a-kube-api-access-dzwb4\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977564    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977573    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/39f986bd-bdca-40e6-8406-857a65b07f7a-config-out\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977581    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-metrics-client-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977589    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977597    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977604    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-web-config\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977612    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977640    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-config\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977653    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/39f986bd-bdca-40e6-8406-857a65b07f7a-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:00.977696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:00.977665    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/39f986bd-bdca-40e6-8406-857a65b07f7a-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:21:01.738126 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.738094    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"39f986bd-bdca-40e6-8406-857a65b07f7a","Type":"ContainerDied","Data":"5eab7bcb07166d8a844e6109a58dd165f195c691e8bbcc19017b424e8ca4a984"}
Sep 10 22:21:01.738484 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.738132    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.738484 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.738167    2582 scope.go:117] "RemoveContainer" containerID="d17b6d5966a115e7062979ee0675571cbfbfcbab5bf0e32c9d76173a71a2f86b"
Sep 10 22:21:01.746562 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.746546    2582 scope.go:117] "RemoveContainer" containerID="1a13981d31df61a945de45eeb256224a27a68826b8f40de72b74660ac27b7b54"
Sep 10 22:21:01.754319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.754300    2582 scope.go:117] "RemoveContainer" containerID="2236ab581d649ccac5f865bea6ab42d8482f086dcdc2585981504538cbb4929a"
Sep 10 22:21:01.761305 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.761287    2582 scope.go:117] "RemoveContainer" containerID="95a36875e949c36cfc44e942ce42e78609e2af0f320500f143149060f38a33d8"
Sep 10 22:21:01.761504 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.761488    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:21:01.767452 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.767429    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:21:01.768602 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.768585    2582 scope.go:117] "RemoveContainer" containerID="be32d06ba6778dbf8ae5a0fdaef7d30fd6cc5cbf7ec007493b0bfd208e8fbe62"
Sep 10 22:21:01.775301 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.775283    2582 scope.go:117] "RemoveContainer" containerID="b0685f309e714ee68b696c6382e1baa97afa00294a1d9dd14d24658e5c9fa327"
Sep 10 22:21:01.782844 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.782827    2582 scope.go:117] "RemoveContainer" containerID="f12fc4a161ef0491a4a9c8906126de154bf11c7ae35cc4f97eb355de444bc9e0"
Sep 10 22:21:01.791066 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791043    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:21:01.791328 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791313    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="config-reloader"
Sep 10 22:21:01.791396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791332    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="config-reloader"
Sep 10 22:21:01.791396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791351    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="prometheus"
Sep 10 22:21:01.791396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791360    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="prometheus"
Sep 10 22:21:01.791396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791370    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-web"
Sep 10 22:21:01.791396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791379    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-web"
Sep 10 22:21:01.791396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791391    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="init-config-reloader"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791400    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="init-config-reloader"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791409    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="thanos-sidecar"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791417    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="thanos-sidecar"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791425    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791433    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791441    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-thanos"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791451    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-thanos"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791512    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="prometheus"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791522    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791533    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="config-reloader"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791543    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="thanos-sidecar"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791550    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-web"
Sep 10 22:21:01.791746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.791558    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" containerName="kube-rbac-proxy-thanos"
Sep 10 22:21:01.794752 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.794733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.797555 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797537    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Sep 10 22:21:01.797802 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797784    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Sep 10 22:21:01.797875 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797806    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-x749g\""
Sep 10 22:21:01.797933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797879    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Sep 10 22:21:01.797933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797880    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Sep 10 22:21:01.798033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797883    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Sep 10 22:21:01.798033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.797980    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Sep 10 22:21:01.798212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798196    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Sep 10 22:21:01.798282 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798237    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Sep 10 22:21:01.798282 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798271    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Sep 10 22:21:01.798381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798345    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-f6tcj08rcf4t2\""
Sep 10 22:21:01.798381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798350    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Sep 10 22:21:01.798674 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798615    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Sep 10 22:21:01.798674 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798670    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Sep 10 22:21:01.798834 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.798679    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 10 22:21:01.800902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.800884    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Sep 10 22:21:01.805571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.805554    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Sep 10 22:21:01.813420 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.813400    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:21:01.883330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883302    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883334    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883376    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883393    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883562    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.883598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883590    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883723    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zkbl5\" (UniqueName: \"kubernetes.io/projected/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-kube-api-access-zkbl5\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883866    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883949    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-config\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.884010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.883976    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.984960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.984933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.984965    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.984988    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985008    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985060    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985092    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985146    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zkbl5\" (UniqueName: \"kubernetes.io/projected/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-kube-api-access-zkbl5\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985210    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985235    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985254    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-config\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985276    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985305    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985329    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.985377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985359    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.986083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985398    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.986083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.986083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.985761    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.986083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.986036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.986083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.986068    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.986875 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.986851    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.988132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.988109    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-config-out\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.988588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.988555    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.988588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.988573    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.988765 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.988741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-config\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.989180 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.988919    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.989180 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.989083    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.990376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.989393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.990376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.989929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.990376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.990073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.990376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.990092    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.990376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.990227    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.991021 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.991000    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.991409 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.991394    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-web-config\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.992037 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.992022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.992083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.992047    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:01.996111 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:01.996095    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zkbl5\" (UniqueName: \"kubernetes.io/projected/046a5f29-9fb1-47ee-852a-b5caafbe0f5e-kube-api-access-zkbl5\") pod \"prometheus-k8s-0\" (UID: \"046a5f29-9fb1-47ee-852a-b5caafbe0f5e\") " pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:02.054522 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:02.054490    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39f986bd-bdca-40e6-8406-857a65b07f7a" path="/var/lib/kubelet/pods/39f986bd-bdca-40e6-8406-857a65b07f7a/volumes"
Sep 10 22:21:02.105159 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:02.105120    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:21:02.389549 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:02.389428    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Sep 10 22:21:02.392190 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:21:02.392157    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod046a5f29_9fb1_47ee_852a_b5caafbe0f5e.slice/crio-b533b4a4fe0702bda6b298e8fb90cf91b410a963f532646a216b29f3d0f60fa3 WatchSource:0}: Error finding container b533b4a4fe0702bda6b298e8fb90cf91b410a963f532646a216b29f3d0f60fa3: Status 404 returned error can't find the container with id b533b4a4fe0702bda6b298e8fb90cf91b410a963f532646a216b29f3d0f60fa3
Sep 10 22:21:02.744351 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:02.744313    2582 generic.go:356] "Generic (PLEG): container finished" podID="046a5f29-9fb1-47ee-852a-b5caafbe0f5e" containerID="50f8c12dc003acb4d45aa156945c9843317deda70d9676aa53e9abf05a340ee7" exitCode=0
Sep 10 22:21:02.744738 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:02.744400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerDied","Data":"50f8c12dc003acb4d45aa156945c9843317deda70d9676aa53e9abf05a340ee7"}
Sep 10 22:21:02.744738 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:02.744460    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"b533b4a4fe0702bda6b298e8fb90cf91b410a963f532646a216b29f3d0f60fa3"}
Sep 10 22:21:03.751939 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.751904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"4af05ce8b77ef41a1b73745e3a190566157a291e768f40564c6f2a923c98f515"}
Sep 10 22:21:03.752412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.751976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"04a30880b5a80231fe052598ca1a35db01d51580d4125b3d5be4dccfc9cd4f68"}
Sep 10 22:21:03.752412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.752003    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"d5962ff89a455487082e94ff30ad06314d17f3e2c8aa32a98e965be387a878f0"}
Sep 10 22:21:03.752412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.752028    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"3feff12af30e84b694616f285691aa87f00e90ebfe43c4decd61edeb742b6ff8"}
Sep 10 22:21:03.752412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.752050    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"ce3c946337b7b424a9f06600621e345b9af40861264728560d72317a639b5ac3"}
Sep 10 22:21:03.752412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.752072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"046a5f29-9fb1-47ee-852a-b5caafbe0f5e","Type":"ContainerStarted","Data":"3764753364def56585669e7ec95c22335f5df5adb54fb55c5dae0852fc13c2c8"}
Sep 10 22:21:03.781807 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:03.781752    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.759014014 podStartE2EDuration="2.781735346s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.721332ms" isStatefulPod=false podCreationTimestamp="2026-09-10 22:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:21:03.780485103 +0000 UTC m=+164.191609217" watchObservedRunningTime="2026-09-10 22:21:03.781735346 +0000 UTC m=+164.192859442"
Sep 10 22:21:07.105805 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:21:07.105764    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:22:02.106267 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:02.106222    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:22:02.122287 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:02.122254    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:22:02.977413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:02.977390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Sep 10 22:22:48.012486 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.012404    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"]
Sep 10 22:22:48.015242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.015227    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.017454 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.017435    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 10 22:22:48.018419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.018401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 10 22:22:48.018491 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.018395    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 10 22:22:48.018491 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.018437    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h9csj\""
Sep 10 22:22:48.018693 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.018678    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 10 22:22:48.018775 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.018707    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 10 22:22:48.027174 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.027153    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"]
Sep 10 22:22:48.089476 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.089440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48eea559-2368-4583-a141-83fa6404309c-manager-config\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.089675 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.089498    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48eea559-2368-4583-a141-83fa6404309c-cert\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.089675 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.089545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hv45l\" (UniqueName: \"kubernetes.io/projected/48eea559-2368-4583-a141-83fa6404309c-kube-api-access-hv45l\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.089675 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.089563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48eea559-2368-4583-a141-83fa6404309c-metrics-cert\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.190141 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.190106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48eea559-2368-4583-a141-83fa6404309c-manager-config\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.190330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.190167    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48eea559-2368-4583-a141-83fa6404309c-cert\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.190330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.190186    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hv45l\" (UniqueName: \"kubernetes.io/projected/48eea559-2368-4583-a141-83fa6404309c-kube-api-access-hv45l\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.190330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.190214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48eea559-2368-4583-a141-83fa6404309c-metrics-cert\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.190804 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.190780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/48eea559-2368-4583-a141-83fa6404309c-manager-config\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.192836 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.192816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/48eea559-2368-4583-a141-83fa6404309c-cert\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.192909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.192843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/48eea559-2368-4583-a141-83fa6404309c-metrics-cert\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.198995 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.198965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hv45l\" (UniqueName: \"kubernetes.io/projected/48eea559-2368-4583-a141-83fa6404309c-kube-api-access-hv45l\") pod \"lws-controller-manager-5dbdc5d69b-rx4vd\" (UID: \"48eea559-2368-4583-a141-83fa6404309c\") " pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.324840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.324747    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:48.598272 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:48.598222    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"]
Sep 10 22:22:48.600868 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:22:48.600842    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48eea559_2368_4583_a141_83fa6404309c.slice/crio-7955bb2ae7b93004697cf30d7472b7d83d02ff22ee369b46379dd262243dd4ac WatchSource:0}: Error finding container 7955bb2ae7b93004697cf30d7472b7d83d02ff22ee369b46379dd262243dd4ac: Status 404 returned error can't find the container with id 7955bb2ae7b93004697cf30d7472b7d83d02ff22ee369b46379dd262243dd4ac
Sep 10 22:22:49.122700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:49.122612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd" event={"ID":"48eea559-2368-4583-a141-83fa6404309c","Type":"ContainerStarted","Data":"7955bb2ae7b93004697cf30d7472b7d83d02ff22ee369b46379dd262243dd4ac"}
Sep 10 22:22:51.132244 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:51.132205    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd" event={"ID":"48eea559-2368-4583-a141-83fa6404309c","Type":"ContainerStarted","Data":"954e4fc9f25b05ae580d89090bc259b4d1d06da3b58a7f16eb779f62d14146d3"}
Sep 10 22:22:51.132637 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:51.132309    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:22:51.149055 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:51.149000    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd" podStartSLOduration=2.072391173 podStartE2EDuration="4.148984942s" totalImagesPullingTime="2.076593769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:22:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:22:51.14788349 +0000 UTC m=+271.559007612" watchObservedRunningTime="2026-09-10 22:22:51.148984942 +0000 UTC m=+271.560109039"
Sep 10 22:22:56.303307 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.303271    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"]
Sep 10 22:22:56.308712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.307507    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.312366 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.312338    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 10 22:22:56.312973 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.312953    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-qk85w\""
Sep 10 22:22:56.313367 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.313352    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 10 22:22:56.313435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.313387    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 10 22:22:56.313694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.313680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 10 22:22:56.334729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.334698    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"]
Sep 10 22:22:56.461219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.461187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d279e9c-87be-4f58-b0b3-1aa80d811029-manifests\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.461394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.461248    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcr87\" (UniqueName: \"kubernetes.io/projected/3d279e9c-87be-4f58-b0b3-1aa80d811029-kube-api-access-vcr87\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.461394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.461309    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d279e9c-87be-4f58-b0b3-1aa80d811029-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.461394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.461373    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d279e9c-87be-4f58-b0b3-1aa80d811029-tmp\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.461510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.461429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d279e9c-87be-4f58-b0b3-1aa80d811029-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.561970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.561894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcr87\" (UniqueName: \"kubernetes.io/projected/3d279e9c-87be-4f58-b0b3-1aa80d811029-kube-api-access-vcr87\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.561970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.561930    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d279e9c-87be-4f58-b0b3-1aa80d811029-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.561970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.561950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d279e9c-87be-4f58-b0b3-1aa80d811029-tmp\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.562204 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.561979    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d279e9c-87be-4f58-b0b3-1aa80d811029-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.562204 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.562004    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d279e9c-87be-4f58-b0b3-1aa80d811029-manifests\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.562448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.562427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3d279e9c-87be-4f58-b0b3-1aa80d811029-manifests\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.564398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.564367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d279e9c-87be-4f58-b0b3-1aa80d811029-tmp\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.564510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.564472    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3d279e9c-87be-4f58-b0b3-1aa80d811029-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.564510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.564481    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3d279e9c-87be-4f58-b0b3-1aa80d811029-webhook-cert\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.570033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.570011    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcr87\" (UniqueName: \"kubernetes.io/projected/3d279e9c-87be-4f58-b0b3-1aa80d811029-kube-api-access-vcr87\") pod \"opendatahub-operator-controller-manager-7c969df88c-fgkxh\" (UID: \"3d279e9c-87be-4f58-b0b3-1aa80d811029\") " pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.619108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.619061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:22:56.906297 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:56.906221    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"]
Sep 10 22:22:56.909719 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:22:56.909691    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d279e9c_87be_4f58_b0b3_1aa80d811029.slice/crio-7d75ce8aefd45cf69f515c88e2818dbf9e450f2dbf8b0ebaab1e51e77ae74cc5 WatchSource:0}: Error finding container 7d75ce8aefd45cf69f515c88e2818dbf9e450f2dbf8b0ebaab1e51e77ae74cc5: Status 404 returned error can't find the container with id 7d75ce8aefd45cf69f515c88e2818dbf9e450f2dbf8b0ebaab1e51e77ae74cc5
Sep 10 22:22:57.154936 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:22:57.154898    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh" event={"ID":"3d279e9c-87be-4f58-b0b3-1aa80d811029","Type":"ContainerStarted","Data":"7d75ce8aefd45cf69f515c88e2818dbf9e450f2dbf8b0ebaab1e51e77ae74cc5"}
Sep 10 22:23:00.170841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:00.170750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh" event={"ID":"3d279e9c-87be-4f58-b0b3-1aa80d811029","Type":"ContainerStarted","Data":"fdaa82ae6b98b4c877fb8a91b476ee93648b22d049d80d319c95cb8622ab6c4f"}
Sep 10 22:23:01.175911 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:01.175821    2582 generic.go:356] "Generic (PLEG): container finished" podID="3d279e9c-87be-4f58-b0b3-1aa80d811029" containerID="fdaa82ae6b98b4c877fb8a91b476ee93648b22d049d80d319c95cb8622ab6c4f" exitCode=0
Sep 10 22:23:01.175911 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:01.175869    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh" event={"ID":"3d279e9c-87be-4f58-b0b3-1aa80d811029","Type":"ContainerDied","Data":"fdaa82ae6b98b4c877fb8a91b476ee93648b22d049d80d319c95cb8622ab6c4f"}
Sep 10 22:23:02.138428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:02.138397    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5dbdc5d69b-rx4vd"
Sep 10 22:23:02.182303 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:02.182265    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh" event={"ID":"3d279e9c-87be-4f58-b0b3-1aa80d811029","Type":"ContainerStarted","Data":"df81bfd4c494917d330b258fa576b5ddc31ead28b593d825edd01d88ff60d465"}
Sep 10 22:23:02.182707 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:02.182386    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:23:02.206402 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:02.206343    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh" podStartSLOduration=1.847008491 podStartE2EDuration="6.206324284s" totalImagesPullingTime="3.338385729s" totalInitContainerRuntime="1.020930064s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:22:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:02.205391864 +0000 UTC m=+282.616516053" watchObservedRunningTime="2026-09-10 22:23:02.206324284 +0000 UTC m=+282.617448380"
Sep 10 22:23:13.189120 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:13.189091    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7c969df88c-fgkxh"
Sep 10 22:23:19.971890 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:19.971861    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 10 22:23:22.036044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.036007    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"]
Sep 10 22:23:22.038266 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.038252    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.043802 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.043778    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 10 22:23:22.043957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.043895    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-rp7w4\""
Sep 10 22:23:22.044051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.044035    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 10 22:23:22.044585 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.044568    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 10 22:23:22.061229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061242    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061313    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wf9d\" (UniqueName: \"kubernetes.io/projected/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-kube-api-access-8wf9d\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.061520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.061475    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.135159 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.135128    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"]
Sep 10 22:23:22.162428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wf9d\" (UniqueName: \"kubernetes.io/projected/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-kube-api-access-8wf9d\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162529    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162565    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.162684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.163042 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.163042 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.162946    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.163153 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.163089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.163224 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.163200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.163399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.163381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.165103 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.165084    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.165387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.165370    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.172796 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.172772    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.172894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.172877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wf9d\" (UniqueName: \"kubernetes.io/projected/4fc0868b-d794-40b5-99d1-39a2b9b8ad11-kube-api-access-8wf9d\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2\" (UID: \"4fc0868b-d794-40b5-99d1-39a2b9b8ad11\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.348477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.348383    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:22.623177 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.623151    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"]
Sep 10 22:23:22.625608 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:23:22.625580    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fc0868b_d794_40b5_99d1_39a2b9b8ad11.slice/crio-7911637007ebd3321b878f141f591bfac7b70108bea6e6a04f820299a24b1431 WatchSource:0}: Error finding container 7911637007ebd3321b878f141f591bfac7b70108bea6e6a04f820299a24b1431: Status 404 returned error can't find the container with id 7911637007ebd3321b878f141f591bfac7b70108bea6e6a04f820299a24b1431
Sep 10 22:23:22.627662 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:22.627644    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:23:23.262411 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:23.262370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2" event={"ID":"4fc0868b-d794-40b5-99d1-39a2b9b8ad11","Type":"ContainerStarted","Data":"7911637007ebd3321b878f141f591bfac7b70108bea6e6a04f820299a24b1431"}
Sep 10 22:23:25.660139 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.660100    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:23:25.660494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.660189    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:23:25.660494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.660257    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:23:25.882384 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.882352    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vrj9b"]
Sep 10 22:23:25.884695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.884674    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:25.887116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.887093    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-7g46f\""
Sep 10 22:23:25.887116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.887116    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 10 22:23:25.894922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.894900    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vrj9b"]
Sep 10 22:23:25.995185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.995153    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frb77\" (UniqueName: \"kubernetes.io/projected/df2ae45b-0645-45cb-9698-32ebe6254fd2-kube-api-access-frb77\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:25.995185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:25.995191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:26.096199 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.096168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frb77\" (UniqueName: \"kubernetes.io/projected/df2ae45b-0645-45cb-9698-32ebe6254fd2-kube-api-access-frb77\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:26.096199 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.096200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:26.096383 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:23:26.096305    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 22:23:26.096383 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:23:26.096359    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert podName:df2ae45b-0645-45cb-9698-32ebe6254fd2 nodeName:}" failed. No retries permitted until 2026-09-10 22:23:26.596342204 +0000 UTC m=+307.007466279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert") pod "odh-model-controller-7998c67dc4-vrj9b" (UID: "df2ae45b-0645-45cb-9698-32ebe6254fd2") : secret "odh-model-controller-webhook-cert" not found
Sep 10 22:23:26.104828 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.104803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frb77\" (UniqueName: \"kubernetes.io/projected/df2ae45b-0645-45cb-9698-32ebe6254fd2-kube-api-access-frb77\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:26.276262 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.276167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2" event={"ID":"4fc0868b-d794-40b5-99d1-39a2b9b8ad11","Type":"ContainerStarted","Data":"d9abd77dcfa7de900ef6a09b21dee4a5d49ea163b427dc233d2db0c523bd4b88"}
Sep 10 22:23:26.296214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.296160    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2" podStartSLOduration=2.264089427 podStartE2EDuration="5.296142718s" totalImagesPullingTime="3.032053291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:26.294860055 +0000 UTC m=+306.705984192" watchObservedRunningTime="2026-09-10 22:23:26.296142718 +0000 UTC m=+306.707266889"
Sep 10 22:23:26.349149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.349112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:26.353711 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.353684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:26.424079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.424046    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d5c4d"]
Sep 10 22:23:26.426710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.426691    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.428793 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.428772    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 10 22:23:26.438938 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.438914    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d5c4d"]
Sep 10 22:23:26.500383 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.500344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8slwv\" (UniqueName: \"kubernetes.io/projected/e4b79068-095d-4fb6-8180-8f3a632b7ad8-kube-api-access-8slwv\") pod \"model-serving-api-54d89bd5fc-d5c4d\" (UID: \"e4b79068-095d-4fb6-8180-8f3a632b7ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.500558 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.500404    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b79068-095d-4fb6-8180-8f3a632b7ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-d5c4d\" (UID: \"e4b79068-095d-4fb6-8180-8f3a632b7ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.601209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.601119    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:26.601209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.601172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8slwv\" (UniqueName: \"kubernetes.io/projected/e4b79068-095d-4fb6-8180-8f3a632b7ad8-kube-api-access-8slwv\") pod \"model-serving-api-54d89bd5fc-d5c4d\" (UID: \"e4b79068-095d-4fb6-8180-8f3a632b7ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.601410 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.601238    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b79068-095d-4fb6-8180-8f3a632b7ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-d5c4d\" (UID: \"e4b79068-095d-4fb6-8180-8f3a632b7ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.601410 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:23:26.601267    2582 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 10 22:23:26.601410 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:23:26.601332    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert podName:df2ae45b-0645-45cb-9698-32ebe6254fd2 nodeName:}" failed. No retries permitted until 2026-09-10 22:23:27.601312555 +0000 UTC m=+308.012436647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert") pod "odh-model-controller-7998c67dc4-vrj9b" (UID: "df2ae45b-0645-45cb-9698-32ebe6254fd2") : secret "odh-model-controller-webhook-cert" not found
Sep 10 22:23:26.603978 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.603960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e4b79068-095d-4fb6-8180-8f3a632b7ad8-tls-certs\") pod \"model-serving-api-54d89bd5fc-d5c4d\" (UID: \"e4b79068-095d-4fb6-8180-8f3a632b7ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.609454 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.609397    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8slwv\" (UniqueName: \"kubernetes.io/projected/e4b79068-095d-4fb6-8180-8f3a632b7ad8-kube-api-access-8slwv\") pod \"model-serving-api-54d89bd5fc-d5c4d\" (UID: \"e4b79068-095d-4fb6-8180-8f3a632b7ad8\") " pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:26.736784 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:26.736741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:27.004538 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.004509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-d5c4d"]
Sep 10 22:23:27.006775 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:23:27.006746    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4b79068_095d_4fb6_8180_8f3a632b7ad8.slice/crio-42f6f63ec47ee519b49e68dc76a359077b8fdc5316752bb73dc28367d2059a9d WatchSource:0}: Error finding container 42f6f63ec47ee519b49e68dc76a359077b8fdc5316752bb73dc28367d2059a9d: Status 404 returned error can't find the container with id 42f6f63ec47ee519b49e68dc76a359077b8fdc5316752bb73dc28367d2059a9d
Sep 10 22:23:27.281519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.281421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d" event={"ID":"e4b79068-095d-4fb6-8180-8f3a632b7ad8","Type":"ContainerStarted","Data":"42f6f63ec47ee519b49e68dc76a359077b8fdc5316752bb73dc28367d2059a9d"}
Sep 10 22:23:27.281772 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.281754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:27.282818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.282800    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2"
Sep 10 22:23:27.611819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.611731    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:27.614712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.614683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2ae45b-0645-45cb-9698-32ebe6254fd2-cert\") pod \"odh-model-controller-7998c67dc4-vrj9b\" (UID: \"df2ae45b-0645-45cb-9698-32ebe6254fd2\") " pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:27.694790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.694749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:27.978370 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:27.978285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-vrj9b"]
Sep 10 22:23:27.983355 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:23:27.983320    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2ae45b_0645_45cb_9698_32ebe6254fd2.slice/crio-2e413bcf05c565fb3a1e1302dcfad47ec46e29792db78673f1e039baa0cd384e WatchSource:0}: Error finding container 2e413bcf05c565fb3a1e1302dcfad47ec46e29792db78673f1e039baa0cd384e: Status 404 returned error can't find the container with id 2e413bcf05c565fb3a1e1302dcfad47ec46e29792db78673f1e039baa0cd384e
Sep 10 22:23:28.288654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:28.288545    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b" event={"ID":"df2ae45b-0645-45cb-9698-32ebe6254fd2","Type":"ContainerStarted","Data":"2e413bcf05c565fb3a1e1302dcfad47ec46e29792db78673f1e039baa0cd384e"}
Sep 10 22:23:30.299490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:30.299441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d" event={"ID":"e4b79068-095d-4fb6-8180-8f3a632b7ad8","Type":"ContainerStarted","Data":"18edc88709ceebdc03247a172df868d574ecc3c3c6c8422746ec9d8eb3d9392b"}
Sep 10 22:23:30.300068 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:30.299546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:30.315753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:30.315032    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d" podStartSLOduration=1.865033996 podStartE2EDuration="4.315008101s" totalImagesPullingTime="2.449974105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:30.314756496 +0000 UTC m=+310.725880627" watchObservedRunningTime="2026-09-10 22:23:30.315008101 +0000 UTC m=+310.726132198"
Sep 10 22:23:32.309259 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:32.309211    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b" event={"ID":"df2ae45b-0645-45cb-9698-32ebe6254fd2","Type":"ContainerStarted","Data":"f32d3e9958ffdf143a875de5896cad192942479a8f7bd803e7d0f04561e9a56b"}
Sep 10 22:23:32.309742 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:32.309303    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:23:32.328146 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:32.328086    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b" podStartSLOduration=3.693745969 podStartE2EDuration="7.328065158s" totalImagesPullingTime="3.634319189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:32.326217975 +0000 UTC m=+312.737342100" watchObservedRunningTime="2026-09-10 22:23:32.328065158 +0000 UTC m=+312.739189256"
Sep 10 22:23:35.648055 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.648026    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"]
Sep 10 22:23:35.651314 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.651297    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:35.654016 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.653998    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-l92cr\""
Sep 10 22:23:35.654109 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.653997    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 10 22:23:35.689005 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.688975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"]
Sep 10 22:23:35.784792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.784752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712061dc-5999-445c-891a-3328e33599bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:35.784962 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.784819    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9sjgc\" (UniqueName: \"kubernetes.io/projected/712061dc-5999-445c-891a-3328e33599bc-kube-api-access-9sjgc\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:35.885739 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.885699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9sjgc\" (UniqueName: \"kubernetes.io/projected/712061dc-5999-445c-891a-3328e33599bc-kube-api-access-9sjgc\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:35.885931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.885763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712061dc-5999-445c-891a-3328e33599bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:35.885931 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:23:35.885850    2582 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 10 22:23:35.885931 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:23:35.885905    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/712061dc-5999-445c-891a-3328e33599bc-cert podName:712061dc-5999-445c-891a-3328e33599bc nodeName:}" failed. No retries permitted until 2026-09-10 22:23:36.385889922 +0000 UTC m=+316.797013997 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/712061dc-5999-445c-891a-3328e33599bc-cert") pod "kserve-controller-manager-d6f4b65b8-wj96s" (UID: "712061dc-5999-445c-891a-3328e33599bc") : secret "kserve-webhook-server-cert" not found
Sep 10 22:23:35.904960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:35.904884    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9sjgc\" (UniqueName: \"kubernetes.io/projected/712061dc-5999-445c-891a-3328e33599bc-kube-api-access-9sjgc\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:36.389275 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:36.389232    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712061dc-5999-445c-891a-3328e33599bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:36.391839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:36.391813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/712061dc-5999-445c-891a-3328e33599bc-cert\") pod \"kserve-controller-manager-d6f4b65b8-wj96s\" (UID: \"712061dc-5999-445c-891a-3328e33599bc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:36.561704 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:36.561664    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:36.838185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:36.838162    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"]
Sep 10 22:23:36.839923 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:23:36.839890    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod712061dc_5999_445c_891a_3328e33599bc.slice/crio-9d1e8bf11a440753584375b435ff83933812e55edb36d309238d18be5eb72011 WatchSource:0}: Error finding container 9d1e8bf11a440753584375b435ff83933812e55edb36d309238d18be5eb72011: Status 404 returned error can't find the container with id 9d1e8bf11a440753584375b435ff83933812e55edb36d309238d18be5eb72011
Sep 10 22:23:37.329004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:37.328970    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s" event={"ID":"712061dc-5999-445c-891a-3328e33599bc","Type":"ContainerStarted","Data":"9d1e8bf11a440753584375b435ff83933812e55edb36d309238d18be5eb72011"}
Sep 10 22:23:39.339961 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:39.339919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s" event={"ID":"712061dc-5999-445c-891a-3328e33599bc","Type":"ContainerStarted","Data":"941b05a0ddafd3f2c724746fc969a6fed3e76ab79bd4e745982d6ef3494ae68c"}
Sep 10 22:23:39.340339 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:39.340054    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:23:39.368219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:39.368166    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s" podStartSLOduration=2.264875538 podStartE2EDuration="4.368150788s" totalImagesPullingTime="2.10327525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:23:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:23:39.366511193 +0000 UTC m=+319.777635312" watchObservedRunningTime="2026-09-10 22:23:39.368150788 +0000 UTC m=+319.779274884"
Sep 10 22:23:41.308277 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:41.308248    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-d5c4d"
Sep 10 22:23:43.314944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:23:43.314910    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-vrj9b"
Sep 10 22:24:10.349707 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:10.349674    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-wj96s"
Sep 10 22:24:48.388716 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.388680    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-6f7gn"]
Sep 10 22:24:48.391867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.391852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:24:48.394681 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.394661    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 10 22:24:48.394796 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.394708    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-tgk8b\""
Sep 10 22:24:48.394796 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.394749    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 10 22:24:48.406293 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.406271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-6f7gn"]
Sep 10 22:24:48.502697 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.502664    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8bcd\" (UniqueName: \"kubernetes.io/projected/ccf0098c-48d8-4f05-8182-62f61f2a10dd-kube-api-access-r8bcd\") pod \"authorino-operator-76b478bd78-6f7gn\" (UID: \"ccf0098c-48d8-4f05-8182-62f61f2a10dd\") " pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:24:48.603822 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.603785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8bcd\" (UniqueName: \"kubernetes.io/projected/ccf0098c-48d8-4f05-8182-62f61f2a10dd-kube-api-access-r8bcd\") pod \"authorino-operator-76b478bd78-6f7gn\" (UID: \"ccf0098c-48d8-4f05-8182-62f61f2a10dd\") " pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:24:48.617014 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.616988    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8bcd\" (UniqueName: \"kubernetes.io/projected/ccf0098c-48d8-4f05-8182-62f61f2a10dd-kube-api-access-r8bcd\") pod \"authorino-operator-76b478bd78-6f7gn\" (UID: \"ccf0098c-48d8-4f05-8182-62f61f2a10dd\") " pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:24:48.702012 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.701918    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:24:48.981857 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:48.981821    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-6f7gn"]
Sep 10 22:24:48.985273 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:24:48.985242    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf0098c_48d8_4f05_8182_62f61f2a10dd.slice/crio-5de7bccbbc23a87b4903a9d6e67e814c3cdb679e6a3c0685e1f990daf0765712 WatchSource:0}: Error finding container 5de7bccbbc23a87b4903a9d6e67e814c3cdb679e6a3c0685e1f990daf0765712: Status 404 returned error can't find the container with id 5de7bccbbc23a87b4903a9d6e67e814c3cdb679e6a3c0685e1f990daf0765712
Sep 10 22:24:49.644948 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:49.644919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn" event={"ID":"ccf0098c-48d8-4f05-8182-62f61f2a10dd","Type":"ContainerStarted","Data":"5de7bccbbc23a87b4903a9d6e67e814c3cdb679e6a3c0685e1f990daf0765712"}
Sep 10 22:24:51.654948 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:51.654908    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn" event={"ID":"ccf0098c-48d8-4f05-8182-62f61f2a10dd","Type":"ContainerStarted","Data":"8121a9e021708616e0157c2b4c8457a7d5e3507a49ad9740c44808a18a7a14df"}
Sep 10 22:24:51.655323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:51.655033    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:24:51.680946 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:51.680897    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn" podStartSLOduration=1.159516482 podStartE2EDuration="3.680882146s" totalImagesPullingTime="2.521365664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:51.680238204 +0000 UTC m=+392.091362311" watchObservedRunningTime="2026-09-10 22:24:51.680882146 +0000 UTC m=+392.092006242"
Sep 10 22:24:52.604187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.604151    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"]
Sep 10 22:24:52.607369 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.607349    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:24:52.613652 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.613179    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 10 22:24:52.613652 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.613187    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-zw69m\""
Sep 10 22:24:52.624672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.624648    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"]
Sep 10 22:24:52.740927 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.740890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2xlb\" (UniqueName: \"kubernetes.io/projected/d233c055-1ead-4793-bb79-7064be272dfc-kube-api-access-j2xlb\") pod \"dns-operator-controller-manager-7b84cd7c9c-kfvxs\" (UID: \"d233c055-1ead-4793-bb79-7064be272dfc\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:24:52.842177 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.842141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2xlb\" (UniqueName: \"kubernetes.io/projected/d233c055-1ead-4793-bb79-7064be272dfc-kube-api-access-j2xlb\") pod \"dns-operator-controller-manager-7b84cd7c9c-kfvxs\" (UID: \"d233c055-1ead-4793-bb79-7064be272dfc\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:24:52.855444 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.855371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2xlb\" (UniqueName: \"kubernetes.io/projected/d233c055-1ead-4793-bb79-7064be272dfc-kube-api-access-j2xlb\") pod \"dns-operator-controller-manager-7b84cd7c9c-kfvxs\" (UID: \"d233c055-1ead-4793-bb79-7064be272dfc\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:24:52.917086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:52.917055    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:24:53.190507 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:53.190390    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"]
Sep 10 22:24:53.193108 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:24:53.193075    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd233c055_1ead_4793_bb79_7064be272dfc.slice/crio-3bebd1983947b5b561a6b11d3f56a80e6d9306e0f30c551bb0dbbdf1de91ed2c WatchSource:0}: Error finding container 3bebd1983947b5b561a6b11d3f56a80e6d9306e0f30c551bb0dbbdf1de91ed2c: Status 404 returned error can't find the container with id 3bebd1983947b5b561a6b11d3f56a80e6d9306e0f30c551bb0dbbdf1de91ed2c
Sep 10 22:24:53.663777 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:53.663744    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs" event={"ID":"d233c055-1ead-4793-bb79-7064be272dfc","Type":"ContainerStarted","Data":"3bebd1983947b5b561a6b11d3f56a80e6d9306e0f30c551bb0dbbdf1de91ed2c"}
Sep 10 22:24:55.674850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:55.674817    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs" event={"ID":"d233c055-1ead-4793-bb79-7064be272dfc","Type":"ContainerStarted","Data":"cffd24b818577881b38188823d37579961d45836d6e173bdfc81457c50210c86"}
Sep 10 22:24:55.675326 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:55.674941    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:24:55.692413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:24:55.692360    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs" podStartSLOduration=2.10577749 podStartE2EDuration="3.692341243s" totalImagesPullingTime="1.586563753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:24:55.690864892 +0000 UTC m=+396.101988999" watchObservedRunningTime="2026-09-10 22:24:55.692341243 +0000 UTC m=+396.103465341"
Sep 10 22:25:02.662122 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:02.662088    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-6f7gn"
Sep 10 22:25:06.682147 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:06.682112    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-kfvxs"
Sep 10 22:25:19.221059 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.221020    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"]
Sep 10 22:25:19.224036 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.224016    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.228190 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.228160    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qplrh\""
Sep 10 22:25:19.236904 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.236877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b66e974-5f98-46d7-837e-f7010ab996ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.237034 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.236942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8g56\" (UniqueName: \"kubernetes.io/projected/2b66e974-5f98-46d7-837e-f7010ab996ca-kube-api-access-b8g56\") pod \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.244777 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.244751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"]
Sep 10 22:25:19.337454 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.337423    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b66e974-5f98-46d7-837e-f7010ab996ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.337672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.337479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8g56\" (UniqueName: \"kubernetes.io/projected/2b66e974-5f98-46d7-837e-f7010ab996ca-kube-api-access-b8g56\") pod \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.337869 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.337850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b66e974-5f98-46d7-837e-f7010ab996ca-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.349727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.349703    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8g56\" (UniqueName: \"kubernetes.io/projected/2b66e974-5f98-46d7-837e-f7010ab996ca-kube-api-access-b8g56\") pod \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.533907 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.533863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:19.809247 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:19.809219    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"]
Sep 10 22:25:19.811964 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:25:19.811937    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b66e974_5f98_46d7_837e_f7010ab996ca.slice/crio-94f324e2b10975fe81489942cf4950d50082704aaa491936c598cbf60dbf77e5 WatchSource:0}: Error finding container 94f324e2b10975fe81489942cf4950d50082704aaa491936c598cbf60dbf77e5: Status 404 returned error can't find the container with id 94f324e2b10975fe81489942cf4950d50082704aaa491936c598cbf60dbf77e5
Sep 10 22:25:20.087654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.087557    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"]
Sep 10 22:25:20.099649 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.094442    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"]
Sep 10 22:25:20.113473 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.113445    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"]
Sep 10 22:25:20.118371 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.118353    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.132905 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.132881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"]
Sep 10 22:25:20.141767 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.141741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b627ea1d-0dbc-4e75-9794-31ec11b85a04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-ksttv\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.141914 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.141883    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpk2x\" (UniqueName: \"kubernetes.io/projected/b627ea1d-0dbc-4e75-9794-31ec11b85a04-kube-api-access-hpk2x\") pod \"kuadrant-operator-controller-manager-5f685c496f-ksttv\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.242672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.242611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpk2x\" (UniqueName: \"kubernetes.io/projected/b627ea1d-0dbc-4e75-9794-31ec11b85a04-kube-api-access-hpk2x\") pod \"kuadrant-operator-controller-manager-5f685c496f-ksttv\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.243035 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.242683    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b627ea1d-0dbc-4e75-9794-31ec11b85a04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-ksttv\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.243108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.243085    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b627ea1d-0dbc-4e75-9794-31ec11b85a04-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f685c496f-ksttv\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.260786 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.260747    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpk2x\" (UniqueName: \"kubernetes.io/projected/b627ea1d-0dbc-4e75-9794-31ec11b85a04-kube-api-access-hpk2x\") pod \"kuadrant-operator-controller-manager-5f685c496f-ksttv\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.430064 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.429957    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:20.720640 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.720585    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"]
Sep 10 22:25:20.723764 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:25:20.723733    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb627ea1d_0dbc_4e75_9794_31ec11b85a04.slice/crio-3ce3386b776e92cb399d2ffd98bea944dc4f86ad87190acec715d89c33afb58a WatchSource:0}: Error finding container 3ce3386b776e92cb399d2ffd98bea944dc4f86ad87190acec715d89c33afb58a: Status 404 returned error can't find the container with id 3ce3386b776e92cb399d2ffd98bea944dc4f86ad87190acec715d89c33afb58a
Sep 10 22:25:20.787435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:20.787393    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv" event={"ID":"b627ea1d-0dbc-4e75-9794-31ec11b85a04","Type":"ContainerStarted","Data":"3ce3386b776e92cb399d2ffd98bea944dc4f86ad87190acec715d89c33afb58a"}
Sep 10 22:25:24.812450 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:24.812407    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" containerName="manager" containerID="cri-o://6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c" gracePeriod=2
Sep 10 22:25:24.814696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:24.814655    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv" event={"ID":"b627ea1d-0dbc-4e75-9794-31ec11b85a04","Type":"ContainerStarted","Data":"9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3"}
Sep 10 22:25:24.814827 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:24.814806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:24.850882 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:24.850827    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv" podStartSLOduration=1.8103060210000002 podStartE2EDuration="4.850808799s" totalImagesPullingTime="3.040502778s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:24.849811328 +0000 UTC m=+425.260935426" watchObservedRunningTime="2026-09-10 22:25:24.850808799 +0000 UTC m=+425.261932901"
Sep 10 22:25:25.050826 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.050798    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:25.052961 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:25:25.052931    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" is forbidden: User \"system:node:ip-10-0-132-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-115.ec2.internal' and this object" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:25.075319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.075239    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b66e974-5f98-46d7-837e-f7010ab996ca-extensions-socket-volume\") pod \"2b66e974-5f98-46d7-837e-f7010ab996ca\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") "
Sep 10 22:25:25.075319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.075295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b8g56\" (UniqueName: \"kubernetes.io/projected/2b66e974-5f98-46d7-837e-f7010ab996ca-kube-api-access-b8g56\") pod \"2b66e974-5f98-46d7-837e-f7010ab996ca\" (UID: \"2b66e974-5f98-46d7-837e-f7010ab996ca\") "
Sep 10 22:25:25.075511 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.075486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b66e974-5f98-46d7-837e-f7010ab996ca-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2b66e974-5f98-46d7-837e-f7010ab996ca" (UID: "2b66e974-5f98-46d7-837e-f7010ab996ca"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:25:25.075565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.075554    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2b66e974-5f98-46d7-837e-f7010ab996ca-extensions-socket-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:25:25.077771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.077749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b66e974-5f98-46d7-837e-f7010ab996ca-kube-api-access-b8g56" (OuterVolumeSpecName: "kube-api-access-b8g56") pod "2b66e974-5f98-46d7-837e-f7010ab996ca" (UID: "2b66e974-5f98-46d7-837e-f7010ab996ca"). InnerVolumeSpecName "kube-api-access-b8g56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:25:25.175951 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.175911    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b8g56\" (UniqueName: \"kubernetes.io/projected/2b66e974-5f98-46d7-837e-f7010ab996ca-kube-api-access-b8g56\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:25:25.820943 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.820908    2582 generic.go:356] "Generic (PLEG): container finished" podID="2b66e974-5f98-46d7-837e-f7010ab996ca" containerID="6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c" exitCode=2
Sep 10 22:25:25.821434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.820957    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:25.821434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.821016    2582 scope.go:117] "RemoveContainer" containerID="6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c"
Sep 10 22:25:25.823229 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:25:25.823203    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" is forbidden: User \"system:node:ip-10-0-132-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-115.ec2.internal' and this object" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:25.830066 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.830048    2582 scope.go:117] "RemoveContainer" containerID="6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c"
Sep 10 22:25:25.830401 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:25:25.830380    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c\": container with ID starting with 6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c not found: ID does not exist" containerID="6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c"
Sep 10 22:25:25.830513 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:25.830414    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c"} err="failed to get container status \"6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c\": rpc error: code = NotFound desc = could not find container \"6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c\": container with ID starting with 6fe2811afb06ad43cbb0f8f0a78ed10a5a9cbbe36bad935488a4f8c93e8f136c not found: ID does not exist"
Sep 10 22:25:25.831140 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:25:25.831115    2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-5f685c496f-f9qxd\" is forbidden: User \"system:node:ip-10-0-132-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-115.ec2.internal' and this object" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-f9qxd"
Sep 10 22:25:26.051575 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:26.051531    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" path="/var/lib/kubelet/pods/2b66e974-5f98-46d7-837e-f7010ab996ca/volumes"
Sep 10 22:25:35.823982 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:35.823950    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:48.200717 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.200611    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"]
Sep 10 22:25:48.201093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.200888    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv" podUID="b627ea1d-0dbc-4e75-9794-31ec11b85a04" containerName="manager" containerID="cri-o://9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3" gracePeriod=10
Sep 10 22:25:48.449087 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.449061    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:48.566053 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.566013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpk2x\" (UniqueName: \"kubernetes.io/projected/b627ea1d-0dbc-4e75-9794-31ec11b85a04-kube-api-access-hpk2x\") pod \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") "
Sep 10 22:25:48.566228 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.566061    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b627ea1d-0dbc-4e75-9794-31ec11b85a04-extensions-socket-volume\") pod \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\" (UID: \"b627ea1d-0dbc-4e75-9794-31ec11b85a04\") "
Sep 10 22:25:48.566598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.566575    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b627ea1d-0dbc-4e75-9794-31ec11b85a04-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b627ea1d-0dbc-4e75-9794-31ec11b85a04" (UID: "b627ea1d-0dbc-4e75-9794-31ec11b85a04"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:25:48.568267 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.568243    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b627ea1d-0dbc-4e75-9794-31ec11b85a04-kube-api-access-hpk2x" (OuterVolumeSpecName: "kube-api-access-hpk2x") pod "b627ea1d-0dbc-4e75-9794-31ec11b85a04" (UID: "b627ea1d-0dbc-4e75-9794-31ec11b85a04"). InnerVolumeSpecName "kube-api-access-hpk2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:25:48.666745 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.666709    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpk2x\" (UniqueName: \"kubernetes.io/projected/b627ea1d-0dbc-4e75-9794-31ec11b85a04-kube-api-access-hpk2x\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:25:48.666745 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.666740    2582 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b627ea1d-0dbc-4e75-9794-31ec11b85a04-extensions-socket-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:25:48.929856 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.929764    2582 generic.go:356] "Generic (PLEG): container finished" podID="b627ea1d-0dbc-4e75-9794-31ec11b85a04" containerID="9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3" exitCode=0
Sep 10 22:25:48.929856 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.929824    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"
Sep 10 22:25:48.929856 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.929836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv" event={"ID":"b627ea1d-0dbc-4e75-9794-31ec11b85a04","Type":"ContainerDied","Data":"9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3"}
Sep 10 22:25:48.930061 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.929918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv" event={"ID":"b627ea1d-0dbc-4e75-9794-31ec11b85a04","Type":"ContainerDied","Data":"3ce3386b776e92cb399d2ffd98bea944dc4f86ad87190acec715d89c33afb58a"}
Sep 10 22:25:48.930061 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.929945    2582 scope.go:117] "RemoveContainer" containerID="9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3"
Sep 10 22:25:48.938810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.938785    2582 scope.go:117] "RemoveContainer" containerID="9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3"
Sep 10 22:25:48.939222 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:25:48.939171    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3\": container with ID starting with 9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3 not found: ID does not exist" containerID="9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3"
Sep 10 22:25:48.939320 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.939236    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3"} err="failed to get container status \"9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3\": rpc error: code = NotFound desc = could not find container \"9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3\": container with ID starting with 9160293ba4f44b26d0595f1ae245b986eebdcc48819dc12d69a109a0ed7ff3c3 not found: ID does not exist"
Sep 10 22:25:48.953561 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.953529    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"]
Sep 10 22:25:48.960251 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:48.960226    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f685c496f-ksttv"]
Sep 10 22:25:50.051857 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:50.051814    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b627ea1d-0dbc-4e75-9794-31ec11b85a04" path="/var/lib/kubelet/pods/b627ea1d-0dbc-4e75-9794-31ec11b85a04/volumes"
Sep 10 22:25:52.314588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.314558    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"]
Sep 10 22:25:52.314987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.314908    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" containerName="manager"
Sep 10 22:25:52.314987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.314930    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" containerName="manager"
Sep 10 22:25:52.314987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.314949    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b627ea1d-0dbc-4e75-9794-31ec11b85a04" containerName="manager"
Sep 10 22:25:52.314987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.314957    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b627ea1d-0dbc-4e75-9794-31ec11b85a04" containerName="manager"
Sep 10 22:25:52.315115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.315018    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b627ea1d-0dbc-4e75-9794-31ec11b85a04" containerName="manager"
Sep 10 22:25:52.315115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.315027    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b66e974-5f98-46d7-837e-f7010ab996ca" containerName="manager"
Sep 10 22:25:52.319363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.319341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.322902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.322885    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-xjtc2\""
Sep 10 22:25:52.331027 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.331002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"]
Sep 10 22:25:52.398783 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.398978 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398794    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.398978 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398813    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.398978 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.398978 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b942aee-ebe6-4815-83d1-16deda36e23b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.398978 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398975    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.399187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.398994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ds4mc\" (UniqueName: \"kubernetes.io/projected/0b942aee-ebe6-4815-83d1-16deda36e23b-kube-api-access-ds4mc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.399187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.399047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.399187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.399088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500244 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500196    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500265    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500288    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500340    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b942aee-ebe6-4815-83d1-16deda36e23b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ds4mc\" (UniqueName: \"kubernetes.io/projected/0b942aee-ebe6-4815-83d1-16deda36e23b-kube-api-access-ds4mc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500837 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500468    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500837 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500837 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500746    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.500989 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.501067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.500991    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.501144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.501119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b942aee-ebe6-4815-83d1-16deda36e23b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.502690 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.502671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.503036 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.503016    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.508433 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.508409    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b942aee-ebe6-4815-83d1-16deda36e23b-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.509011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.508971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ds4mc\" (UniqueName: \"kubernetes.io/projected/0b942aee-ebe6-4815-83d1-16deda36e23b-kube-api-access-ds4mc\") pod \"maas-default-gateway-openshift-default-78bb78ff78-vhj5h\" (UID: \"0b942aee-ebe6-4815-83d1-16deda36e23b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.629135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.629040    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:52.903202 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.903174    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"]
Sep 10 22:25:52.906043 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:25:52.906013    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b942aee_ebe6_4815_83d1_16deda36e23b.slice/crio-6d94f0b377a7cc14cd89984a3d6fe7b0ec6e82073e66a2ea2bd6f00a106aa2bb WatchSource:0}: Error finding container 6d94f0b377a7cc14cd89984a3d6fe7b0ec6e82073e66a2ea2bd6f00a106aa2bb: Status 404 returned error can't find the container with id 6d94f0b377a7cc14cd89984a3d6fe7b0ec6e82073e66a2ea2bd6f00a106aa2bb
Sep 10 22:25:52.908081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.908052    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:25:52.908156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.908116    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:25:52.908156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.908147    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:25:52.956982 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:52.956942    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" event={"ID":"0b942aee-ebe6-4815-83d1-16deda36e23b","Type":"ContainerStarted","Data":"6d94f0b377a7cc14cd89984a3d6fe7b0ec6e82073e66a2ea2bd6f00a106aa2bb"}
Sep 10 22:25:53.963033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:53.962998    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" event={"ID":"0b942aee-ebe6-4815-83d1-16deda36e23b","Type":"ContainerStarted","Data":"8630dce58d79298e1b2d92bbed3a05164cc21bdc7a3d7c391054b1ad4150f099"}
Sep 10 22:25:53.984158 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:53.984105    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" podStartSLOduration=1.984090373 podStartE2EDuration="1.984090373s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:25:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:25:53.983424795 +0000 UTC m=+454.394548915" watchObservedRunningTime="2026-09-10 22:25:53.984090373 +0000 UTC m=+454.395214535"
Sep 10 22:25:54.629274 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:54.629233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:54.634215 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:54.634179    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:54.968069 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:54.967994    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:25:54.969131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:25:54.969108    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:26:09.147508 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.147470    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-s27gt"]
Sep 10 22:26:09.149862 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.149838    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:09.152135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.152111    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-jmpbc\""
Sep 10 22:26:09.159972 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.159950    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-s27gt"]
Sep 10 22:26:09.251896 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.251858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7p72\" (UniqueName: \"kubernetes.io/projected/11db5f44-0547-44cf-bebb-b836d636bdf0-kube-api-access-s7p72\") pod \"authorino-59c974bd48-s27gt\" (UID: \"11db5f44-0547-44cf-bebb-b836d636bdf0\") " pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:09.352953 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.352900    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7p72\" (UniqueName: \"kubernetes.io/projected/11db5f44-0547-44cf-bebb-b836d636bdf0-kube-api-access-s7p72\") pod \"authorino-59c974bd48-s27gt\" (UID: \"11db5f44-0547-44cf-bebb-b836d636bdf0\") " pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:09.361591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.361568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7p72\" (UniqueName: \"kubernetes.io/projected/11db5f44-0547-44cf-bebb-b836d636bdf0-kube-api-access-s7p72\") pod \"authorino-59c974bd48-s27gt\" (UID: \"11db5f44-0547-44cf-bebb-b836d636bdf0\") " pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:09.459852 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.459761    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:09.727504 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:09.727477    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-s27gt"]
Sep 10 22:26:09.730133 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:26:09.730104    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod11db5f44_0547_44cf_bebb_b836d636bdf0.slice/crio-65dd216ef16d279d76dbd6cd535522aab377fab0f6a093a28dc53808ca4c5c38 WatchSource:0}: Error finding container 65dd216ef16d279d76dbd6cd535522aab377fab0f6a093a28dc53808ca4c5c38: Status 404 returned error can't find the container with id 65dd216ef16d279d76dbd6cd535522aab377fab0f6a093a28dc53808ca4c5c38
Sep 10 22:26:10.035740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:10.035643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-s27gt" event={"ID":"11db5f44-0547-44cf-bebb-b836d636bdf0","Type":"ContainerStarted","Data":"65dd216ef16d279d76dbd6cd535522aab377fab0f6a093a28dc53808ca4c5c38"}
Sep 10 22:26:12.052093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:12.052059    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-s27gt" event={"ID":"11db5f44-0547-44cf-bebb-b836d636bdf0","Type":"ContainerStarted","Data":"a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f"}
Sep 10 22:26:12.083548 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:12.083491    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-s27gt" podStartSLOduration=1.724965787 podStartE2EDuration="3.083473918s" totalImagesPullingTime="1.358508131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:26:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:26:12.081840134 +0000 UTC m=+472.492964230" watchObservedRunningTime="2026-09-10 22:26:12.083473918 +0000 UTC m=+472.494598014"
Sep 10 22:26:39.077948 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.077917    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-79znm"]
Sep 10 22:26:39.082611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.082592    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:39.090162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.089926    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-79znm"]
Sep 10 22:26:39.205031 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.204994    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-79znm"]
Sep 10 22:26:39.205291 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:26:39.205269    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-l5bq9], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-79znm" podUID="17779408-43c4-4e49-b756-292166fe9391"
Sep 10 22:26:39.211440 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.211414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5bq9\" (UniqueName: \"kubernetes.io/projected/17779408-43c4-4e49-b756-292166fe9391-kube-api-access-l5bq9\") pod \"authorino-557f876f69-79znm\" (UID: \"17779408-43c4-4e49-b756-292166fe9391\") " pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:39.234338 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.234307    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-bbg52"]
Sep 10 22:26:39.237479 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.237458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.239850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.239832    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 10 22:26:39.244344 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.244268    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-bbg52"]
Sep 10 22:26:39.310540 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.310505    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-bbg52"]
Sep 10 22:26:39.310825 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:26:39.310801    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-l6smq tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-bbg52" podUID="bd7aa54c-b13f-4d69-9576-5bb74b8e6df7"
Sep 10 22:26:39.312062 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.312043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6smq\" (UniqueName: \"kubernetes.io/projected/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-kube-api-access-l6smq\") pod \"authorino-6d4dfc649f-bbg52\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") " pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.312126 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.312095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5bq9\" (UniqueName: \"kubernetes.io/projected/17779408-43c4-4e49-b756-292166fe9391-kube-api-access-l5bq9\") pod \"authorino-557f876f69-79znm\" (UID: \"17779408-43c4-4e49-b756-292166fe9391\") " pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:39.312126 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.312122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-tls-cert\") pod \"authorino-6d4dfc649f-bbg52\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") " pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.322509 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.322486    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5bq9\" (UniqueName: \"kubernetes.io/projected/17779408-43c4-4e49-b756-292166fe9391-kube-api-access-l5bq9\") pod \"authorino-557f876f69-79znm\" (UID: \"17779408-43c4-4e49-b756-292166fe9391\") " pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:39.338116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.338046    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56cf7f6958-z2gdh"]
Sep 10 22:26:39.341270 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.341255    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.350221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.350197    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cf7f6958-z2gdh"]
Sep 10 22:26:39.413429 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.413388    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b27d1d09-0d82-470c-9496-d77b9e5a703c-tls-cert\") pod \"authorino-56cf7f6958-z2gdh\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") " pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.413600 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.413441    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-tls-cert\") pod \"authorino-6d4dfc649f-bbg52\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") " pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.413600 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.413521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xrn2\" (UniqueName: \"kubernetes.io/projected/b27d1d09-0d82-470c-9496-d77b9e5a703c-kube-api-access-4xrn2\") pod \"authorino-56cf7f6958-z2gdh\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") " pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.413708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.413599    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6smq\" (UniqueName: \"kubernetes.io/projected/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-kube-api-access-l6smq\") pod \"authorino-6d4dfc649f-bbg52\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") " pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.416090 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.416064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-tls-cert\") pod \"authorino-6d4dfc649f-bbg52\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") " pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.421092 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.421069    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6smq\" (UniqueName: \"kubernetes.io/projected/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-kube-api-access-l6smq\") pod \"authorino-6d4dfc649f-bbg52\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") " pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:39.514058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.514025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xrn2\" (UniqueName: \"kubernetes.io/projected/b27d1d09-0d82-470c-9496-d77b9e5a703c-kube-api-access-4xrn2\") pod \"authorino-56cf7f6958-z2gdh\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") " pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.514250 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.514081    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b27d1d09-0d82-470c-9496-d77b9e5a703c-tls-cert\") pod \"authorino-56cf7f6958-z2gdh\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") " pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.516582 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.516557    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b27d1d09-0d82-470c-9496-d77b9e5a703c-tls-cert\") pod \"authorino-56cf7f6958-z2gdh\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") " pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.523682 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.523657    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xrn2\" (UniqueName: \"kubernetes.io/projected/b27d1d09-0d82-470c-9496-d77b9e5a703c-kube-api-access-4xrn2\") pod \"authorino-56cf7f6958-z2gdh\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") " pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.651015 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.650910    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:26:39.919520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:39.919453    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56cf7f6958-z2gdh"]
Sep 10 22:26:39.922228 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:26:39.922205    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb27d1d09_0d82_470c_9496_d77b9e5a703c.slice/crio-1e7214ba88489ca15219a8ec7ed6bc2efbd90077cc96b395050d99c18214428a WatchSource:0}: Error finding container 1e7214ba88489ca15219a8ec7ed6bc2efbd90077cc96b395050d99c18214428a: Status 404 returned error can't find the container with id 1e7214ba88489ca15219a8ec7ed6bc2efbd90077cc96b395050d99c18214428a
Sep 10 22:26:40.168115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.168075    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cf7f6958-z2gdh" event={"ID":"b27d1d09-0d82-470c-9496-d77b9e5a703c","Type":"ContainerStarted","Data":"1e7214ba88489ca15219a8ec7ed6bc2efbd90077cc96b395050d99c18214428a"}
Sep 10 22:26:40.168115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.168107    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:40.168115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.168087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:40.176250 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.176197    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:40.178147 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.178133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:40.221050 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.221013    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6smq\" (UniqueName: \"kubernetes.io/projected/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-kube-api-access-l6smq\") pod \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") "
Sep 10 22:26:40.221229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.221065    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5bq9\" (UniqueName: \"kubernetes.io/projected/17779408-43c4-4e49-b756-292166fe9391-kube-api-access-l5bq9\") pod \"17779408-43c4-4e49-b756-292166fe9391\" (UID: \"17779408-43c4-4e49-b756-292166fe9391\") "
Sep 10 22:26:40.221229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.221089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-tls-cert\") pod \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\" (UID: \"bd7aa54c-b13f-4d69-9576-5bb74b8e6df7\") "
Sep 10 22:26:40.223287 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.223260    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-kube-api-access-l6smq" (OuterVolumeSpecName: "kube-api-access-l6smq") pod "bd7aa54c-b13f-4d69-9576-5bb74b8e6df7" (UID: "bd7aa54c-b13f-4d69-9576-5bb74b8e6df7"). InnerVolumeSpecName "kube-api-access-l6smq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:40.223414 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.223287    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "bd7aa54c-b13f-4d69-9576-5bb74b8e6df7" (UID: "bd7aa54c-b13f-4d69-9576-5bb74b8e6df7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:26:40.223414 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.223310    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17779408-43c4-4e49-b756-292166fe9391-kube-api-access-l5bq9" (OuterVolumeSpecName: "kube-api-access-l5bq9") pod "17779408-43c4-4e49-b756-292166fe9391" (UID: "17779408-43c4-4e49-b756-292166fe9391"). InnerVolumeSpecName "kube-api-access-l5bq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:40.321816 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.321773    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6smq\" (UniqueName: \"kubernetes.io/projected/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-kube-api-access-l6smq\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:26:40.321816 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.321805    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5bq9\" (UniqueName: \"kubernetes.io/projected/17779408-43c4-4e49-b756-292166fe9391-kube-api-access-l5bq9\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:26:40.321816 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:40.321814    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7-tls-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:26:41.174332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.174242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cf7f6958-z2gdh" event={"ID":"b27d1d09-0d82-470c-9496-d77b9e5a703c","Type":"ContainerStarted","Data":"55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596"}
Sep 10 22:26:41.174332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.174264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-bbg52"
Sep 10 22:26:41.174332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.174254    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-79znm"
Sep 10 22:26:41.192001 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.191957    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56cf7f6958-z2gdh" podStartSLOduration=1.389267471 podStartE2EDuration="2.19193922s" totalImagesPullingTime="802.671749ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:26:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:26:41.191159203 +0000 UTC m=+501.602283309" watchObservedRunningTime="2026-09-10 22:26:41.19193922 +0000 UTC m=+501.603063364"
Sep 10 22:26:41.229668 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.225050    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-s27gt"]
Sep 10 22:26:41.229668 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.227321    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-s27gt" podUID="11db5f44-0547-44cf-bebb-b836d636bdf0" containerName="authorino" containerID="cri-o://a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f" gracePeriod=30
Sep 10 22:26:41.232002 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.231945    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-bbg52"]
Sep 10 22:26:41.239086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.239058    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-bbg52"]
Sep 10 22:26:41.266739 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.266711    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-79znm"]
Sep 10 22:26:41.270279 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.270256    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-79znm"]
Sep 10 22:26:41.476054 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.476026    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:41.531710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.531588    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7p72\" (UniqueName: \"kubernetes.io/projected/11db5f44-0547-44cf-bebb-b836d636bdf0-kube-api-access-s7p72\") pod \"11db5f44-0547-44cf-bebb-b836d636bdf0\" (UID: \"11db5f44-0547-44cf-bebb-b836d636bdf0\") "
Sep 10 22:26:41.533792 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.533767    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11db5f44-0547-44cf-bebb-b836d636bdf0-kube-api-access-s7p72" (OuterVolumeSpecName: "kube-api-access-s7p72") pod "11db5f44-0547-44cf-bebb-b836d636bdf0" (UID: "11db5f44-0547-44cf-bebb-b836d636bdf0"). InnerVolumeSpecName "kube-api-access-s7p72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:26:41.632582 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:41.632542    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7p72\" (UniqueName: \"kubernetes.io/projected/11db5f44-0547-44cf-bebb-b836d636bdf0-kube-api-access-s7p72\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:26:42.051669 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.051611    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17779408-43c4-4e49-b756-292166fe9391" path="/var/lib/kubelet/pods/17779408-43c4-4e49-b756-292166fe9391/volumes"
Sep 10 22:26:42.051920 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.051907    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd7aa54c-b13f-4d69-9576-5bb74b8e6df7" path="/var/lib/kubelet/pods/bd7aa54c-b13f-4d69-9576-5bb74b8e6df7/volumes"
Sep 10 22:26:42.180808 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.180773    2582 generic.go:356] "Generic (PLEG): container finished" podID="11db5f44-0547-44cf-bebb-b836d636bdf0" containerID="a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f" exitCode=0
Sep 10 22:26:42.180808 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.180813    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-s27gt"
Sep 10 22:26:42.181306 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.180836    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-s27gt" event={"ID":"11db5f44-0547-44cf-bebb-b836d636bdf0","Type":"ContainerDied","Data":"a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f"}
Sep 10 22:26:42.181306 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.180880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-s27gt" event={"ID":"11db5f44-0547-44cf-bebb-b836d636bdf0","Type":"ContainerDied","Data":"65dd216ef16d279d76dbd6cd535522aab377fab0f6a093a28dc53808ca4c5c38"}
Sep 10 22:26:42.181306 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.180898    2582 scope.go:117] "RemoveContainer" containerID="a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f"
Sep 10 22:26:42.189074 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.189056    2582 scope.go:117] "RemoveContainer" containerID="a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f"
Sep 10 22:26:42.189366 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:26:42.189350    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f\": container with ID starting with a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f not found: ID does not exist" containerID="a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f"
Sep 10 22:26:42.189428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.189374    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f"} err="failed to get container status \"a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f\": rpc error: code = NotFound desc = could not find container \"a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f\": container with ID starting with a01cdb2aa944529e527ac8761f5a11abb74060ae7ab9d453fb901eeff30f194f not found: ID does not exist"
Sep 10 22:26:42.195987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.195965    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-s27gt"]
Sep 10 22:26:42.200027 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:42.200007    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-s27gt"]
Sep 10 22:26:44.051740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:44.051708    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11db5f44-0547-44cf-bebb-b836d636bdf0" path="/var/lib/kubelet/pods/11db5f44-0547-44cf-bebb-b836d636bdf0/volumes"
Sep 10 22:26:46.198593 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.198561    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77786d6846-mppjx"]
Sep 10 22:26:46.199085 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.199068    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11db5f44-0547-44cf-bebb-b836d636bdf0" containerName="authorino"
Sep 10 22:26:46.199130 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.199088    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="11db5f44-0547-44cf-bebb-b836d636bdf0" containerName="authorino"
Sep 10 22:26:46.199198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.199187    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="11db5f44-0547-44cf-bebb-b836d636bdf0" containerName="authorino"
Sep 10 22:26:46.204735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.204715    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.208206 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.208181    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 22:26:46.208320 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.208263    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cc2r4\""
Sep 10 22:26:46.208320 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.208266    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 22:26:46.208432 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.208325    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 22:26:46.219198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.219166    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77786d6846-mppjx"]
Sep 10 22:26:46.275384 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.275341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-webhook-cert\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.275558 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.275517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mz8l\" (UniqueName: \"kubernetes.io/projected/04ab00f0-3d7a-4a4b-adff-53216ab00786-kube-api-access-7mz8l\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.275610 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.275555    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-metrics-certs\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.376932 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.376896    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7mz8l\" (UniqueName: \"kubernetes.io/projected/04ab00f0-3d7a-4a4b-adff-53216ab00786-kube-api-access-7mz8l\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.376932 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.376938    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-metrics-certs\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.377185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.376968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-webhook-cert\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.379603 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.379579    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-metrics-certs\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.379745 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.379729    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-webhook-cert\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.385145 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.385122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mz8l\" (UniqueName: \"kubernetes.io/projected/04ab00f0-3d7a-4a4b-adff-53216ab00786-kube-api-access-7mz8l\") pod \"maas-controller-77786d6846-mppjx\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") " pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.517137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.517091    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:46.793677 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:46.793652    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77786d6846-mppjx"]
Sep 10 22:26:46.796309 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:26:46.796279    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04ab00f0_3d7a_4a4b_adff_53216ab00786.slice/crio-53f97be94d536e032a3b5cdba5873fa8809d014e92c5b5235dcfbfdee52f7dd1 WatchSource:0}: Error finding container 53f97be94d536e032a3b5cdba5873fa8809d014e92c5b5235dcfbfdee52f7dd1: Status 404 returned error can't find the container with id 53f97be94d536e032a3b5cdba5873fa8809d014e92c5b5235dcfbfdee52f7dd1
Sep 10 22:26:47.206595 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:47.206511    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-mppjx" event={"ID":"04ab00f0-3d7a-4a4b-adff-53216ab00786","Type":"ContainerStarted","Data":"53f97be94d536e032a3b5cdba5873fa8809d014e92c5b5235dcfbfdee52f7dd1"}
Sep 10 22:26:49.220251 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:49.220216    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-mppjx" event={"ID":"04ab00f0-3d7a-4a4b-adff-53216ab00786","Type":"ContainerStarted","Data":"b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1"}
Sep 10 22:26:49.220700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:49.220420    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:26:49.239854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:26:49.239802    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77786d6846-mppjx" podStartSLOduration=0.978333704 podStartE2EDuration="3.239785316s" totalImagesPullingTime="2.261451612s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:26:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:26:49.23824145 +0000 UTC m=+509.649365571" watchObservedRunningTime="2026-09-10 22:26:49.239785316 +0000 UTC m=+509.650909413"
Sep 10 22:27:00.227210 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:00.227177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:27:22.395845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.395813    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7745fd994b-869nk"]
Sep 10 22:27:22.402087 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.402059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.404712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.404684    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 10 22:27:22.405581 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.405561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 10 22:27:22.405721 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.405597    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 10 22:27:22.405721 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.405562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ljsfd\""
Sep 10 22:27:22.406148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.406130    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 10 22:27:22.410760 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.410719    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7745fd994b-869nk"]
Sep 10 22:27:22.491613 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.491568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-metrics-certs\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.491613 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.491616    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4qlcb\" (UniqueName: \"kubernetes.io/projected/a02473a9-da17-41dc-a857-851ac676ba36-kube-api-access-4qlcb\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.491859 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.491761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.491859 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.491798    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02473a9-da17-41dc-a857-851ac676ba36-openshift-service-ca\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.593020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.592981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.593020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.593027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02473a9-da17-41dc-a857-851ac676ba36-openshift-service-ca\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.593273 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.593068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-metrics-certs\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.593273 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.593086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4qlcb\" (UniqueName: \"kubernetes.io/projected/a02473a9-da17-41dc-a857-851ac676ba36-kube-api-access-4qlcb\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.593273 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:27:22.593139    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Sep 10 22:27:22.593273 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:27:22.593210    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls podName:a02473a9-da17-41dc-a857-851ac676ba36 nodeName:}" failed. No retries permitted until 2026-09-10 22:27:23.093194779 +0000 UTC m=+543.504318857 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls") pod "maas-api-7745fd994b-869nk" (UID: "a02473a9-da17-41dc-a857-851ac676ba36") : secret "maas-api-serving-cert" not found
Sep 10 22:27:22.593737 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.593716    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02473a9-da17-41dc-a857-851ac676ba36-openshift-service-ca\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.595655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.595616    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-metrics-certs\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:22.604231 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:22.604205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4qlcb\" (UniqueName: \"kubernetes.io/projected/a02473a9-da17-41dc-a857-851ac676ba36-kube-api-access-4qlcb\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:23.095812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:23.095776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:23.098315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:23.098288    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls\") pod \"maas-api-7745fd994b-869nk\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") " pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:23.313324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:23.313158    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:23.590261 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:23.590236    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7745fd994b-869nk"]
Sep 10 22:27:23.592346 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:27:23.592321    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02473a9_da17_41dc_a857_851ac676ba36.slice/crio-4a9ad1e35e3018abecdcb9d99a2c81f92122d52033eb41b207f8412c74969c28 WatchSource:0}: Error finding container 4a9ad1e35e3018abecdcb9d99a2c81f92122d52033eb41b207f8412c74969c28: Status 404 returned error can't find the container with id 4a9ad1e35e3018abecdcb9d99a2c81f92122d52033eb41b207f8412c74969c28
Sep 10 22:27:24.378239 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:24.378165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" event={"ID":"a02473a9-da17-41dc-a857-851ac676ba36","Type":"ContainerStarted","Data":"4a9ad1e35e3018abecdcb9d99a2c81f92122d52033eb41b207f8412c74969c28"}
Sep 10 22:27:26.388264 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:26.388229    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" event={"ID":"a02473a9-da17-41dc-a857-851ac676ba36","Type":"ContainerStarted","Data":"99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab"}
Sep 10 22:27:26.388729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:26.388371    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:26.406708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:26.406657    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" podStartSLOduration=2.621357607 podStartE2EDuration="4.40663952s" totalImagesPullingTime="1.785281913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:27:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:27:26.405068277 +0000 UTC m=+546.816192383" watchObservedRunningTime="2026-09-10 22:27:26.40663952 +0000 UTC m=+546.817763609"
Sep 10 22:27:32.397437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.397404    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:27:32.417642 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.417596    2582 generic.go:356] "Generic (PLEG): container finished" podID="0b942aee-ebe6-4815-83d1-16deda36e23b" containerID="8630dce58d79298e1b2d92bbed3a05164cc21bdc7a3d7c391054b1ad4150f099" exitCode=0
Sep 10 22:27:32.417820 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.417661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" event={"ID":"0b942aee-ebe6-4815-83d1-16deda36e23b","Type":"ContainerDied","Data":"8630dce58d79298e1b2d92bbed3a05164cc21bdc7a3d7c391054b1ad4150f099"}
Sep 10 22:27:32.418057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.418043    2582 scope.go:117] "RemoveContainer" containerID="8630dce58d79298e1b2d92bbed3a05164cc21bdc7a3d7c391054b1ad4150f099"
Sep 10 22:27:32.419126 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.419095    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:27:32.419230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.419179    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:27:32.419291 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:32.419226    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:27:33.432205 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:33.432170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" event={"ID":"0b942aee-ebe6-4815-83d1-16deda36e23b","Type":"ContainerStarted","Data":"5a3e34f1a992789c68d4d430f0e8d2ac377b2a4a2fe5eb45029150c1179ede46"}
Sep 10 22:27:33.629570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:33.629530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:27:33.629977 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:33.629950    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vhj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 10 22:27:33.630149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:33.630116    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" podUID="0b942aee-ebe6-4815-83d1-16deda36e23b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 10 22:27:34.629539 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:34.629500    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vhj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 10 22:27:34.631175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:34.631141    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" podUID="0b942aee-ebe6-4815-83d1-16deda36e23b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 10 22:27:35.629755 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:35.629715    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vhj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 10 22:27:35.630355 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:35.630322    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" podUID="0b942aee-ebe6-4815-83d1-16deda36e23b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 10 22:27:36.629572 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:36.629532    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vhj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 10 22:27:36.629914 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:36.629882    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" podUID="0b942aee-ebe6-4815-83d1-16deda36e23b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 10 22:27:37.630172 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:37.630124    2582 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-vhj5h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused" start-of-body=
Sep 10 22:27:37.630722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:37.630209    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h" podUID="0b942aee-ebe6-4815-83d1-16deda36e23b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.25:15021/healthz/ready\": dial tcp 10.134.0.25:15021: connect: connection refused"
Sep 10 22:27:38.633230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:38.633197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:27:38.633603 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:38.633580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:27:38.634317 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:38.634295    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-vhj5h"
Sep 10 22:27:42.154180 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.154146    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"]
Sep 10 22:27:42.156430 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.156407    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.158742 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.158721    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-m62lm\""
Sep 10 22:27:42.159073 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.159054    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 10 22:27:42.159744 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.159727    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 10 22:27:42.159849 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.159732    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 10 22:27:42.166753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.166729    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"]
Sep 10 22:27:42.294800 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.294769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22e12c27-a531-4c34-acc5-10da084b2660-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.294985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.294815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.294985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.294832    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.294985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.294913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.294985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.294965    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htx68\" (UniqueName: \"kubernetes.io/projected/22e12c27-a531-4c34-acc5-10da084b2660-kube-api-access-htx68\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.295121 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.294988    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.395934 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.395894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.395934 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.395933    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.395970    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.396009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htx68\" (UniqueName: \"kubernetes.io/projected/22e12c27-a531-4c34-acc5-10da084b2660-kube-api-access-htx68\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.396036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.396111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22e12c27-a531-4c34-acc5-10da084b2660-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396422 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.396398    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396529 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.396504    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.396602 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.396508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.398505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.398485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22e12c27-a531-4c34-acc5-10da084b2660-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.398776 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.398758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22e12c27-a531-4c34-acc5-10da084b2660-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.405506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.405427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htx68\" (UniqueName: \"kubernetes.io/projected/22e12c27-a531-4c34-acc5-10da084b2660-kube-api-access-htx68\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv\" (UID: \"22e12c27-a531-4c34-acc5-10da084b2660\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.468963 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.468930    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:42.748418 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:42.748393    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"]
Sep 10 22:27:42.751686 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:27:42.751656    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e12c27_a531_4c34_acc5_10da084b2660.slice/crio-6f0f38ee028607811039bece1d0fac1c05bf5e5280bd322fbf51bc731933ca7d WatchSource:0}: Error finding container 6f0f38ee028607811039bece1d0fac1c05bf5e5280bd322fbf51bc731933ca7d: Status 404 returned error can't find the container with id 6f0f38ee028607811039bece1d0fac1c05bf5e5280bd322fbf51bc731933ca7d
Sep 10 22:27:43.481946 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:43.481910    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv" event={"ID":"22e12c27-a531-4c34-acc5-10da084b2660","Type":"ContainerStarted","Data":"6f0f38ee028607811039bece1d0fac1c05bf5e5280bd322fbf51bc731933ca7d"}
Sep 10 22:27:44.489970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:44.489936    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv" event={"ID":"22e12c27-a531-4c34-acc5-10da084b2660","Type":"ContainerStarted","Data":"826dc183f26e13f9616958a81e5f6902414d8243d1e9ae29c1c8fce98e2d0224"}
Sep 10 22:27:44.512116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:44.512064    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv" podStartSLOduration=1.16036579 podStartE2EDuration="2.512019339s" totalImagesPullingTime="1.351653549s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:27:44.510948393 +0000 UTC m=+564.922072513" watchObservedRunningTime="2026-09-10 22:27:44.512019339 +0000 UTC m=+564.923143436"
Sep 10 22:27:52.469586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:52.469534    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:52.470089 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:52.469614    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:52.482074 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:52.482050    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:27:52.540973 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:27:52.540942    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv"
Sep 10 22:29:44.013934 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.013902    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574fcc4575-2pn4k"]
Sep 10 22:29:44.017154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.017135    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.026154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.026132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574fcc4575-2pn4k"]
Sep 10 22:29:44.068273 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.068249    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d59d37d8-68f4-44c0-a81b-81f561ba83d2-tls-cert\") pod \"authorino-574fcc4575-2pn4k\" (UID: \"d59d37d8-68f4-44c0-a81b-81f561ba83d2\") " pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.068458 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.068287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrhwt\" (UniqueName: \"kubernetes.io/projected/d59d37d8-68f4-44c0-a81b-81f561ba83d2-kube-api-access-jrhwt\") pod \"authorino-574fcc4575-2pn4k\" (UID: \"d59d37d8-68f4-44c0-a81b-81f561ba83d2\") " pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.169595 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.169554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d59d37d8-68f4-44c0-a81b-81f561ba83d2-tls-cert\") pod \"authorino-574fcc4575-2pn4k\" (UID: \"d59d37d8-68f4-44c0-a81b-81f561ba83d2\") " pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.169813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.169654    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrhwt\" (UniqueName: \"kubernetes.io/projected/d59d37d8-68f4-44c0-a81b-81f561ba83d2-kube-api-access-jrhwt\") pod \"authorino-574fcc4575-2pn4k\" (UID: \"d59d37d8-68f4-44c0-a81b-81f561ba83d2\") " pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.172236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.172210    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d59d37d8-68f4-44c0-a81b-81f561ba83d2-tls-cert\") pod \"authorino-574fcc4575-2pn4k\" (UID: \"d59d37d8-68f4-44c0-a81b-81f561ba83d2\") " pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.177661 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.177612    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrhwt\" (UniqueName: \"kubernetes.io/projected/d59d37d8-68f4-44c0-a81b-81f561ba83d2-kube-api-access-jrhwt\") pod \"authorino-574fcc4575-2pn4k\" (UID: \"d59d37d8-68f4-44c0-a81b-81f561ba83d2\") " pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.327294 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.327211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574fcc4575-2pn4k"
Sep 10 22:29:44.596129 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.596100    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574fcc4575-2pn4k"]
Sep 10 22:29:44.598082 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:29:44.598057    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd59d37d8_68f4_44c0_a81b_81f561ba83d2.slice/crio-85a47e88a707898594acddc73d9462a03859bba5d22f2a845709d5e86173e383 WatchSource:0}: Error finding container 85a47e88a707898594acddc73d9462a03859bba5d22f2a845709d5e86173e383: Status 404 returned error can't find the container with id 85a47e88a707898594acddc73d9462a03859bba5d22f2a845709d5e86173e383
Sep 10 22:29:44.599429 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:44.599412    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:29:45.031451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:45.031413    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574fcc4575-2pn4k" event={"ID":"d59d37d8-68f4-44c0-a81b-81f561ba83d2","Type":"ContainerStarted","Data":"85a47e88a707898594acddc73d9462a03859bba5d22f2a845709d5e86173e383"}
Sep 10 22:29:46.038874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.038834    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574fcc4575-2pn4k" event={"ID":"d59d37d8-68f4-44c0-a81b-81f561ba83d2","Type":"ContainerStarted","Data":"720179e918a2ea27eb065ab0f13c778d94daa5f802602a44b08f66079df5a6c0"}
Sep 10 22:29:46.059795 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.059743    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574fcc4575-2pn4k" podStartSLOduration=2.436058354 podStartE2EDuration="3.059724485s" totalImagesPullingTime="623.666131ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:29:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:29:46.05837306 +0000 UTC m=+686.469497158" watchObservedRunningTime="2026-09-10 22:29:46.059724485 +0000 UTC m=+686.470848581"
Sep 10 22:29:46.088994 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.088938    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cf7f6958-z2gdh"]
Sep 10 22:29:46.089233 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.089167    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56cf7f6958-z2gdh" podUID="b27d1d09-0d82-470c-9496-d77b9e5a703c" containerName="authorino" containerID="cri-o://55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596" gracePeriod=30
Sep 10 22:29:46.343948 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.343915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:29:46.491951 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.491909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b27d1d09-0d82-470c-9496-d77b9e5a703c-tls-cert\") pod \"b27d1d09-0d82-470c-9496-d77b9e5a703c\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") "
Sep 10 22:29:46.492116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.492004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xrn2\" (UniqueName: \"kubernetes.io/projected/b27d1d09-0d82-470c-9496-d77b9e5a703c-kube-api-access-4xrn2\") pod \"b27d1d09-0d82-470c-9496-d77b9e5a703c\" (UID: \"b27d1d09-0d82-470c-9496-d77b9e5a703c\") "
Sep 10 22:29:46.494129 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.494076    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b27d1d09-0d82-470c-9496-d77b9e5a703c-kube-api-access-4xrn2" (OuterVolumeSpecName: "kube-api-access-4xrn2") pod "b27d1d09-0d82-470c-9496-d77b9e5a703c" (UID: "b27d1d09-0d82-470c-9496-d77b9e5a703c"). InnerVolumeSpecName "kube-api-access-4xrn2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:29:46.502520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.502485    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b27d1d09-0d82-470c-9496-d77b9e5a703c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "b27d1d09-0d82-470c-9496-d77b9e5a703c" (UID: "b27d1d09-0d82-470c-9496-d77b9e5a703c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:29:46.592972 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.592866    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/b27d1d09-0d82-470c-9496-d77b9e5a703c-tls-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:29:46.592972 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:46.592910    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xrn2\" (UniqueName: \"kubernetes.io/projected/b27d1d09-0d82-470c-9496-d77b9e5a703c-kube-api-access-4xrn2\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:29:47.044817 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.044781    2582 generic.go:356] "Generic (PLEG): container finished" podID="b27d1d09-0d82-470c-9496-d77b9e5a703c" containerID="55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596" exitCode=0
Sep 10 22:29:47.044817 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.044819    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56cf7f6958-z2gdh"
Sep 10 22:29:47.045324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.044872    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cf7f6958-z2gdh" event={"ID":"b27d1d09-0d82-470c-9496-d77b9e5a703c","Type":"ContainerDied","Data":"55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596"}
Sep 10 22:29:47.045324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.044925    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56cf7f6958-z2gdh" event={"ID":"b27d1d09-0d82-470c-9496-d77b9e5a703c","Type":"ContainerDied","Data":"1e7214ba88489ca15219a8ec7ed6bc2efbd90077cc96b395050d99c18214428a"}
Sep 10 22:29:47.045324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.044950    2582 scope.go:117] "RemoveContainer" containerID="55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596"
Sep 10 22:29:47.054347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.054330    2582 scope.go:117] "RemoveContainer" containerID="55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596"
Sep 10 22:29:47.054611 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:29:47.054593    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596\": container with ID starting with 55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596 not found: ID does not exist" containerID="55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596"
Sep 10 22:29:47.054676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.054632    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596"} err="failed to get container status \"55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596\": rpc error: code = NotFound desc = could not find container \"55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596\": container with ID starting with 55911da9421881a55a878511edce2737c100e95b63f1ddd9c24ce70a243da596 not found: ID does not exist"
Sep 10 22:29:47.074199 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.074166    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56cf7f6958-z2gdh"]
Sep 10 22:29:47.085826 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:47.085805    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56cf7f6958-z2gdh"]
Sep 10 22:29:48.051694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:29:48.051656    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b27d1d09-0d82-470c-9496-d77b9e5a703c" path="/var/lib/kubelet/pods/b27d1d09-0d82-470c-9496-d77b9e5a703c/volumes"
Sep 10 22:30:03.230759 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.230722    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"]
Sep 10 22:30:03.231189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.231076    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b27d1d09-0d82-470c-9496-d77b9e5a703c" containerName="authorino"
Sep 10 22:30:03.231189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.231088    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b27d1d09-0d82-470c-9496-d77b9e5a703c" containerName="authorino"
Sep 10 22:30:03.231189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.231158    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b27d1d09-0d82-470c-9496-d77b9e5a703c" containerName="authorino"
Sep 10 22:30:03.235636 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.235608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.238638 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.238604    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-ddf324-openshift-default-dockercfg-lmtdp\""
Sep 10 22:30:03.239813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.239786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-socket\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.239921 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.239838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-credential-socket\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.239921 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.239881    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-certs\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.240011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.239919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-data\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.240011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.239956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-token\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.240011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.239997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-podinfo\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.240154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.240043    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-envoy\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.240154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.240075    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b58565-b77e-4f23-b4b0-00fc1e480820-istiod-ca-cert\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.240237 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.240161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bqf\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-kube-api-access-n8bqf\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.258945 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.258906    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"]
Sep 10 22:30:03.340954 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.340918    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-data\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.340954 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.340960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-token\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341152 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.340983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-podinfo\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341152 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341007    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-envoy\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341152 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341027    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b58565-b77e-4f23-b4b0-00fc1e480820-istiod-ca-cert\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341269 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bqf\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-kube-api-access-n8bqf\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341269 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341248    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-socket\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341372 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-credential-socket\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341372 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341343    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-certs\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341471 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341407    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-data\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341658 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341638    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-socket\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341695    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-credential-socket\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.341956 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.341911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-certs\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.342052 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.342029    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b58565-b77e-4f23-b4b0-00fc1e480820-istiod-ca-cert\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.343499 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.343477    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-envoy\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.343743 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.343724    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-podinfo\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.357891 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.357860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-token\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.367945 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.367908    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bqf\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-kube-api-access-n8bqf\") pod \"e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") " pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.546447 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.546363    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:03.826158 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.826134    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"]
Sep 10 22:30:03.828396 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:03.828367    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2b58565_b77e_4f23_b4b0_00fc1e480820.slice/crio-cde944c9afc45cc6e505f4dc1f09a308534ef228bc7b3ed48bc75d2a3c51beb5 WatchSource:0}: Error finding container cde944c9afc45cc6e505f4dc1f09a308534ef228bc7b3ed48bc75d2a3c51beb5: Status 404 returned error can't find the container with id cde944c9afc45cc6e505f4dc1f09a308534ef228bc7b3ed48bc75d2a3c51beb5
Sep 10 22:30:03.830466 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.830434    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:03.830539 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.830500    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:03.830539 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:03.830527    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:04.125435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:04.125328    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" event={"ID":"b2b58565-b77e-4f23-b4b0-00fc1e480820","Type":"ContainerStarted","Data":"1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"}
Sep 10 22:30:04.125435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:04.125399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" event={"ID":"b2b58565-b77e-4f23-b4b0-00fc1e480820","Type":"ContainerStarted","Data":"cde944c9afc45cc6e505f4dc1f09a308534ef228bc7b3ed48bc75d2a3c51beb5"}
Sep 10 22:30:04.146393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:04.146329    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podStartSLOduration=1.1463055 podStartE2EDuration="1.1463055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:04.145171971 +0000 UTC m=+704.556296093" watchObservedRunningTime="2026-09-10 22:30:04.1463055 +0000 UTC m=+704.557429597"
Sep 10 22:30:04.546718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:04.546675    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:04.551939 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:04.551913    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:05.044074 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.044038    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-fd1f24"]
Sep 10 22:30:05.047404 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.047389    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:05.050225 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.050204    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-ks5gc\""
Sep 10 22:30:05.051394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.051364    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvjpn\" (UniqueName: \"kubernetes.io/projected/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6-kube-api-access-jvjpn\") pod \"test-curl-7586-fd1f24\" (UID: \"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6\") " pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:05.052557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.052533    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-fd1f24"]
Sep 10 22:30:05.130053 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.130020    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:05.131020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.131001    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:05.152154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.152128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvjpn\" (UniqueName: \"kubernetes.io/projected/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6-kube-api-access-jvjpn\") pod \"test-curl-7586-fd1f24\" (UID: \"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6\") " pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:05.165281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.165245    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvjpn\" (UniqueName: \"kubernetes.io/projected/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6-kube-api-access-jvjpn\") pod \"test-curl-7586-fd1f24\" (UID: \"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6\") " pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:05.357881 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.357779    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:05.631516 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:05.631492    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-fd1f24"]
Sep 10 22:30:05.633888 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:05.633862    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e5a73a2_67cf_4f08_bb69_6c0db3f37bb6.slice/crio-0d4ac3479076bca826858c6acf19d283b4980f65ba501e1b3473f3d55dc75d94 WatchSource:0}: Error finding container 0d4ac3479076bca826858c6acf19d283b4980f65ba501e1b3473f3d55dc75d94: Status 404 returned error can't find the container with id 0d4ac3479076bca826858c6acf19d283b4980f65ba501e1b3473f3d55dc75d94
Sep 10 22:30:06.136324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:06.136264    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-fd1f24" event={"ID":"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6","Type":"ContainerStarted","Data":"0d4ac3479076bca826858c6acf19d283b4980f65ba501e1b3473f3d55dc75d94"}
Sep 10 22:30:07.141676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.141634    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-fd1f24" event={"ID":"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6","Type":"ContainerStarted","Data":"aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45"}
Sep 10 22:30:07.157079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.157028    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7586-fd1f24" podStartSLOduration=1.259696052 podStartE2EDuration="2.157012954s" totalImagesPullingTime="897.316902ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:07.155961577 +0000 UTC m=+707.567085674" watchObservedRunningTime="2026-09-10 22:30:07.157012954 +0000 UTC m=+707.568137050"
Sep 10 22:30:07.745610 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.745572    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-fd1f24"]
Sep 10 22:30:07.749782 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.749753    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-fd1f24"]
Sep 10 22:30:07.863371 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.863293    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7586-1cdfe2"]
Sep 10 22:30:07.863689 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.863675    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" containerName="test-curl-7586-fd1f24"
Sep 10 22:30:07.863749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.863691    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" containerName="test-curl-7586-fd1f24"
Sep 10 22:30:07.863749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.863742    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" containerName="test-curl-7586-fd1f24"
Sep 10 22:30:07.866704 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.866688    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:07.872718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.872696    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47br2\" (UniqueName: \"kubernetes.io/projected/dbe3d606-dde4-4f11-a26d-9787aae5f83a-kube-api-access-47br2\") pod \"test-curl-7586-1cdfe2\" (UID: \"dbe3d606-dde4-4f11-a26d-9787aae5f83a\") " pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:07.876313 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.876291    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-1cdfe2"]
Sep 10 22:30:07.935908 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.935873    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"]
Sep 10 22:30:07.939158 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.939142    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:07.941386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.941365    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-ddf324\""
Sep 10 22:30:07.949911 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.949888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"]
Sep 10 22:30:07.973830 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.973801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47br2\" (UniqueName: \"kubernetes.io/projected/dbe3d606-dde4-4f11-a26d-9787aae5f83a-kube-api-access-47br2\") pod \"test-curl-7586-1cdfe2\" (UID: \"dbe3d606-dde4-4f11-a26d-9787aae5f83a\") " pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:07.973970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.973850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3412d5aa-29c1-4e9d-8957-42a8351a31a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:07.973970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.973910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdvnz\" (UniqueName: \"kubernetes.io/projected/3412d5aa-29c1-4e9d-8957-42a8351a31a4-kube-api-access-zdvnz\") pod \"payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:07.983582 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:07.983558    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47br2\" (UniqueName: \"kubernetes.io/projected/dbe3d606-dde4-4f11-a26d-9787aae5f83a-kube-api-access-47br2\") pod \"test-curl-7586-1cdfe2\" (UID: \"dbe3d606-dde4-4f11-a26d-9787aae5f83a\") " pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:08.075164 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.075112    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3412d5aa-29c1-4e9d-8957-42a8351a31a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:08.075371 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.075206    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdvnz\" (UniqueName: \"kubernetes.io/projected/3412d5aa-29c1-4e9d-8957-42a8351a31a4-kube-api-access-zdvnz\") pod \"payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:08.076310 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.076256    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3412d5aa-29c1-4e9d-8957-42a8351a31a4-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:08.083381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.083359    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdvnz\" (UniqueName: \"kubernetes.io/projected/3412d5aa-29c1-4e9d-8957-42a8351a31a4-kube-api-access-zdvnz\") pod \"payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:08.147440 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:08.147343    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7586-fd1f24" container="test-curl-7586-fd1f24"
Sep 10 22:30:08.176575 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.176545    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:08.250499 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.250462    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:08.444894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.444861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7586-1cdfe2"]
Sep 10 22:30:08.446860 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:08.446831    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddbe3d606_dde4_4f11_a26d_9787aae5f83a.slice/crio-bb8ffa6def0633308d646d0551285a5d05038bd1b5037f6f82b440e87b60bf2e WatchSource:0}: Error finding container bb8ffa6def0633308d646d0551285a5d05038bd1b5037f6f82b440e87b60bf2e: Status 404 returned error can't find the container with id bb8ffa6def0633308d646d0551285a5d05038bd1b5037f6f82b440e87b60bf2e
Sep 10 22:30:08.533288 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:08.533262    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"]
Sep 10 22:30:08.534903 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:08.534876    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3412d5aa_29c1_4e9d_8957_42a8351a31a4.slice/crio-eec1814b7498b12f4571559a8d216f5406f042b9ac054aac2bc895189b8c269b WatchSource:0}: Error finding container eec1814b7498b12f4571559a8d216f5406f042b9ac054aac2bc895189b8c269b: Status 404 returned error can't find the container with id eec1814b7498b12f4571559a8d216f5406f042b9ac054aac2bc895189b8c269b
Sep 10 22:30:09.153987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.153940    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf" event={"ID":"3412d5aa-29c1-4e9d-8957-42a8351a31a4","Type":"ContainerStarted","Data":"eec1814b7498b12f4571559a8d216f5406f042b9ac054aac2bc895189b8c269b"}
Sep 10 22:30:09.156032 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.155990    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-1cdfe2" event={"ID":"dbe3d606-dde4-4f11-a26d-9787aae5f83a","Type":"ContainerStarted","Data":"8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be"}
Sep 10 22:30:09.156181 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.156040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7586-1cdfe2" event={"ID":"dbe3d606-dde4-4f11-a26d-9787aae5f83a","Type":"ContainerStarted","Data":"bb8ffa6def0633308d646d0551285a5d05038bd1b5037f6f82b440e87b60bf2e"}
Sep 10 22:30:09.156241 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.156195    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7586-fd1f24" podUID="8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" containerName="test-curl-7586-fd1f24" containerID="cri-o://aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45" gracePeriod=2
Sep 10 22:30:09.170074 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.170017    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7586-1cdfe2" podStartSLOduration=2.169996679 podStartE2EDuration="2.169996679s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:09.168610532 +0000 UTC m=+709.579734628" watchObservedRunningTime="2026-09-10 22:30:09.169996679 +0000 UTC m=+709.581120776"
Sep 10 22:30:09.766399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.766363    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7586-1cdfe2"]
Sep 10 22:30:09.773757 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:09.772939    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7586-1cdfe2"]
Sep 10 22:30:10.162560 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:10.162530    2582 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7586-1cdfe2" container="test-curl-7586-1cdfe2"
Sep 10 22:30:10.540698 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.540666    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"]
Sep 10 22:30:10.541160 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.541135    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbe3d606-dde4-4f11-a26d-9787aae5f83a" containerName="test-curl-7586-1cdfe2"
Sep 10 22:30:10.541160 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.541161    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbe3d606-dde4-4f11-a26d-9787aae5f83a" containerName="test-curl-7586-1cdfe2"
Sep 10 22:30:10.541350 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.541263    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbe3d606-dde4-4f11-a26d-9787aae5f83a" containerName="test-curl-7586-1cdfe2"
Sep 10 22:30:10.552957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.552931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.556710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.556305    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-cc3245-openshift-default-dockercfg-k5x69\""
Sep 10 22:30:10.558934 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.558893    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"]
Sep 10 22:30:10.603108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603076    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-socket\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-certs\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-token\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603154    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092453a1-f918-4054-b3b7-b5f7fe645a00-istiod-ca-cert\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-data\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-envoy\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603485 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603357    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4x2m\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-kube-api-access-l4x2m\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603485 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603405    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-credential-socket\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.603485 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.603436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-podinfo\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.704960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.704921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092453a1-f918-4054-b3b7-b5f7fe645a00-istiod-ca-cert\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.704978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-data\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705029    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-envoy\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4x2m\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-kube-api-access-l4x2m\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-credential-socket\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705122    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-podinfo\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705414 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705217    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-socket\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705414 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705243    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-certs\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705414 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705272    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-token\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705784 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705725    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092453a1-f918-4054-b3b7-b5f7fe645a00-istiod-ca-cert\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705906 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705846    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-credential-socket\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.705906 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.705885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-data\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.706129 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.706103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-socket\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.706260 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.706114    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-certs\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.708276 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.708241    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-envoy\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.708409 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.708387    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-podinfo\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.728840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.728813    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4x2m\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-kube-api-access-l4x2m\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.730421 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.730264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-token\") pod \"e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") " pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:10.867594 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:10.867511    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:11.168899 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.168861    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf" event={"ID":"3412d5aa-29c1-4e9d-8957-42a8351a31a4","Type":"ContainerStarted","Data":"d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8"}
Sep 10 22:30:11.169245 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.168951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:11.169245 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.169138    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7586-1cdfe2" podUID="dbe3d606-dde4-4f11-a26d-9787aae5f83a" containerName="test-curl-7586-1cdfe2" containerID="cri-o://8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be" gracePeriod=2
Sep 10 22:30:11.187753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.187708    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf" podStartSLOduration=1.7433141989999998 podStartE2EDuration="4.187692668s" totalImagesPullingTime="2.444378469s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:11.186952822 +0000 UTC m=+711.598076946" watchObservedRunningTime="2026-09-10 22:30:11.187692668 +0000 UTC m=+711.598816765"
Sep 10 22:30:11.197896 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.197868    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"]
Sep 10 22:30:11.215518 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:11.215494    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod092453a1_f918_4054_b3b7_b5f7fe645a00.slice/crio-7319ccba17d6984bdf08acfcdeb86b8f7aad0909efe83b66447e529ee1ed1f61 WatchSource:0}: Error finding container 7319ccba17d6984bdf08acfcdeb86b8f7aad0909efe83b66447e529ee1ed1f61: Status 404 returned error can't find the container with id 7319ccba17d6984bdf08acfcdeb86b8f7aad0909efe83b66447e529ee1ed1f61
Sep 10 22:30:11.217772 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.217738    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:11.217872 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.217848    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:11.217939 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.217896    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:11.244248 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.244219    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"]
Sep 10 22:30:11.250362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.250334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.253364 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.253165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-9005ccc0-openshift-default-dockercfg-8sthk\""
Sep 10 22:30:11.264056 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.264034    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"]
Sep 10 22:30:11.311645 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982282e3-7c4a-468c-a247-65e66ec27e00-istiod-ca-cert\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311645 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311646    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-credential-socket\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311671    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-certs\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311716    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-istio-token\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-data\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-socket\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311826    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982282e3-7c4a-468c-a247-65e66ec27e00-istio-podinfo\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.311874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311871    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcw6d\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-kube-api-access-zcw6d\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.312230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.311904    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-envoy\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.351080 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.351051    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:11.412379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412293    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvjpn\" (UniqueName: \"kubernetes.io/projected/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6-kube-api-access-jvjpn\") pod \"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6\" (UID: \"8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6\") "
Sep 10 22:30:11.412546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-istio-token\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-data\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412479    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-socket\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412530    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982282e3-7c4a-468c-a247-65e66ec27e00-istio-podinfo\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412799 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcw6d\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-kube-api-access-zcw6d\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412799 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412596    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-envoy\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412799 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412716    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982282e3-7c4a-468c-a247-65e66ec27e00-istiod-ca-cert\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412799 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-credential-socket\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.412799 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.412767    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-certs\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.414221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.413160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-certs\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.414221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.413222    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-credential-socket\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.414221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.413371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-socket\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.414221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.413654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-data\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.414221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.413853    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982282e3-7c4a-468c-a247-65e66ec27e00-istiod-ca-cert\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.415193 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.415137    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6-kube-api-access-jvjpn" (OuterVolumeSpecName: "kube-api-access-jvjpn") pod "8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" (UID: "8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6"). InnerVolumeSpecName "kube-api-access-jvjpn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:11.415798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.415774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-envoy\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.416017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.415994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982282e3-7c4a-468c-a247-65e66ec27e00-istio-podinfo\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.436543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.436517    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-istio-token\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.443674 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.443646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcw6d\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-kube-api-access-zcw6d\") pod \"e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") " pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.513928 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.513880    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvjpn\" (UniqueName: \"kubernetes.io/projected/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6-kube-api-access-jvjpn\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:30:11.578873 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.578840    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:11.872912 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.872824    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"]
Sep 10 22:30:11.877283 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:11.877252    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod982282e3_7c4a_468c_a247_65e66ec27e00.slice/crio-a22d1530eefcd680edb2d58b9d6c369710884225b6d2692d83bbfcb90cd74bc2 WatchSource:0}: Error finding container a22d1530eefcd680edb2d58b9d6c369710884225b6d2692d83bbfcb90cd74bc2: Status 404 returned error can't find the container with id a22d1530eefcd680edb2d58b9d6c369710884225b6d2692d83bbfcb90cd74bc2
Sep 10 22:30:11.883794 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.883755    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:11.883875 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.883840    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:11.883913 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:11.883884    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:12.055988 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.055902    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" path="/var/lib/kubelet/pods/8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6/volumes"
Sep 10 22:30:12.178336 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.178129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" event={"ID":"982282e3-7c4a-468c-a247-65e66ec27e00","Type":"ContainerStarted","Data":"60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"}
Sep 10 22:30:12.178336 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.178197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" event={"ID":"982282e3-7c4a-468c-a247-65e66ec27e00","Type":"ContainerStarted","Data":"a22d1530eefcd680edb2d58b9d6c369710884225b6d2692d83bbfcb90cd74bc2"}
Sep 10 22:30:12.180159 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.180130    2582 generic.go:356] "Generic (PLEG): container finished" podID="8e5a73a2-67cf-4f08-bb69-6c0db3f37bb6" containerID="aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45" exitCode=137
Sep 10 22:30:12.180286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.180183    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-fd1f24"
Sep 10 22:30:12.180286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.180229    2582 scope.go:117] "RemoveContainer" containerID="aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45"
Sep 10 22:30:12.186885 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.186860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" event={"ID":"092453a1-f918-4054-b3b7-b5f7fe645a00","Type":"ContainerStarted","Data":"a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"}
Sep 10 22:30:12.187000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.186913    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" event={"ID":"092453a1-f918-4054-b3b7-b5f7fe645a00","Type":"ContainerStarted","Data":"7319ccba17d6984bdf08acfcdeb86b8f7aad0909efe83b66447e529ee1ed1f61"}
Sep 10 22:30:12.193696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.193664    2582 scope.go:117] "RemoveContainer" containerID="aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45"
Sep 10 22:30:12.194026 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:12.194002    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45\": container with ID starting with aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45 not found: ID does not exist" containerID="aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45"
Sep 10 22:30:12.194120 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.194037    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45"} err="failed to get container status \"aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45\": rpc error: code = NotFound desc = could not find container \"aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45\": container with ID starting with aac9c0ed4b556022b23ed3d73259957005bbe8b118053229ea42f59cc1b9db45 not found: ID does not exist"
Sep 10 22:30:12.217571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.217517    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podStartSLOduration=1.217497819 podStartE2EDuration="1.217497819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:12.19700166 +0000 UTC m=+712.608125775" watchObservedRunningTime="2026-09-10 22:30:12.217497819 +0000 UTC m=+712.628621918"
Sep 10 22:30:12.218842 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.218797    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podStartSLOduration=2.218780794 podStartE2EDuration="2.218780794s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:12.216987095 +0000 UTC m=+712.628111203" watchObservedRunningTime="2026-09-10 22:30:12.218780794 +0000 UTC m=+712.629904892"
Sep 10 22:30:12.579276 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.579242    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:12.584310 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.584282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:12.868427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.868338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:12.873935 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:12.873907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:13.192907 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.192883    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:13.193291 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.192938    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:13.193711 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.193684    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:13.193819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.193803    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:13.408434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.408410    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:13.447360 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.447283    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47br2\" (UniqueName: \"kubernetes.io/projected/dbe3d606-dde4-4f11-a26d-9787aae5f83a-kube-api-access-47br2\") pod \"dbe3d606-dde4-4f11-a26d-9787aae5f83a\" (UID: \"dbe3d606-dde4-4f11-a26d-9787aae5f83a\") "
Sep 10 22:30:13.449551 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.449522    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbe3d606-dde4-4f11-a26d-9787aae5f83a-kube-api-access-47br2" (OuterVolumeSpecName: "kube-api-access-47br2") pod "dbe3d606-dde4-4f11-a26d-9787aae5f83a" (UID: "dbe3d606-dde4-4f11-a26d-9787aae5f83a"). InnerVolumeSpecName "kube-api-access-47br2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:13.548609 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:13.548570    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47br2\" (UniqueName: \"kubernetes.io/projected/dbe3d606-dde4-4f11-a26d-9787aae5f83a-kube-api-access-47br2\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:30:14.051611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.051566    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbe3d606-dde4-4f11-a26d-9787aae5f83a" path="/var/lib/kubelet/pods/dbe3d606-dde4-4f11-a26d-9787aae5f83a/volumes"
Sep 10 22:30:14.199209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.199173    2582 generic.go:356] "Generic (PLEG): container finished" podID="dbe3d606-dde4-4f11-a26d-9787aae5f83a" containerID="8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be" exitCode=137
Sep 10 22:30:14.199209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.199210    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7586-1cdfe2"
Sep 10 22:30:14.199736 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.199270    2582 scope.go:117] "RemoveContainer" containerID="8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be"
Sep 10 22:30:14.208366 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.208343    2582 scope.go:117] "RemoveContainer" containerID="8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be"
Sep 10 22:30:14.208713 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:14.208686    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be\": container with ID starting with 8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be not found: ID does not exist" containerID="8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be"
Sep 10 22:30:14.208818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.208724    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be"} err="failed to get container status \"8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be\": rpc error: code = NotFound desc = could not find container \"8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be\": container with ID starting with 8c3e081d0927694a21daf4f24376546e3fe00b04113bb5eaf429fb1f71eea6be not found: ID does not exist"
Sep 10 22:30:14.800659 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.800604    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"]
Sep 10 22:30:14.805434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.805411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.808077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.808055    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-9005ccc0-serving-cert\""
Sep 10 22:30:14.824717 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.821509    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"]
Sep 10 22:30:14.860940 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.860907    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h92sb\" (UniqueName: \"kubernetes.io/projected/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-kube-api-access-h92sb\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.860940 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.860945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-openshift-service-ca\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.861168 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.860983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.861168 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.861027    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-metrics-certs\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.962394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.962352    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h92sb\" (UniqueName: \"kubernetes.io/projected/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-kube-api-access-h92sb\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.962394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.962390    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-openshift-service-ca\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.962676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.962428    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.962676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.962445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-metrics-certs\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.962676 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:14.962524    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-serving-cert: secret "maas-api-e2e-ait-9005ccc0-serving-cert" not found
Sep 10 22:30:14.962676 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:14.962599    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls podName:1d7db34d-ca7d-409a-ac8d-24f05892f7f4 nodeName:}" failed. No retries permitted until 2026-09-10 22:30:15.462578518 +0000 UTC m=+715.873702606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls") pod "maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" (UID: "1d7db34d-ca7d-409a-ac8d-24f05892f7f4") : secret "maas-api-e2e-ait-9005ccc0-serving-cert" not found
Sep 10 22:30:14.963161 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.963137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-openshift-service-ca\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.964998 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.964972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-metrics-certs\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:14.974416 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:14.974391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h92sb\" (UniqueName: \"kubernetes.io/projected/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-kube-api-access-h92sb\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:15.467736 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:15.467698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:15.470319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:15.470290    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls\") pod \"maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:15.746147 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:15.746106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:16.034847 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.034744    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"]
Sep 10 22:30:16.041769 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:16.041729    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d7db34d_ca7d_409a_ac8d_24f05892f7f4.slice/crio-29da5c99d4270ac58b5dca30271924881ddd5b2e0af086ac223c7ead92638ff8 WatchSource:0}: Error finding container 29da5c99d4270ac58b5dca30271924881ddd5b2e0af086ac223c7ead92638ff8: Status 404 returned error can't find the container with id 29da5c99d4270ac58b5dca30271924881ddd5b2e0af086ac223c7ead92638ff8
Sep 10 22:30:16.078400 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.078361    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"]
Sep 10 22:30:16.083079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.083051    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.085152 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.085129    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-cc3245-serving-cert\""
Sep 10 22:30:16.108677 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.108645    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"]
Sep 10 22:30:16.176167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.176127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-maas-api-tls\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.176323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.176173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-metrics-certs\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.176323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.176253    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-openshift-service-ca\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.176323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.176296    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dhb5\" (UniqueName: \"kubernetes.io/projected/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-kube-api-access-6dhb5\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.238095 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.237972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" event={"ID":"1d7db34d-ca7d-409a-ac8d-24f05892f7f4","Type":"ContainerStarted","Data":"29da5c99d4270ac58b5dca30271924881ddd5b2e0af086ac223c7ead92638ff8"}
Sep 10 22:30:16.277556 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.277518    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-openshift-service-ca\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.277774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.277579    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dhb5\" (UniqueName: \"kubernetes.io/projected/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-kube-api-access-6dhb5\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.277774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.277661    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-maas-api-tls\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.277774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.277700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-metrics-certs\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.278419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.278363    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-openshift-service-ca\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.280467 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.280443    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-maas-api-tls\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.280648 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.280597    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-metrics-certs\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.285962 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.285894    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dhb5\" (UniqueName: \"kubernetes.io/projected/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-kube-api-access-6dhb5\") pod \"maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.397571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.397531    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:16.747662 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:16.744637    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"]
Sep 10 22:30:16.753534 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:16.753487    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f8b1b5b_e328_4ec1_9ad4_bd954655eb2b.slice/crio-5a24b86da476fdc37c3262a68cdee377018272e4fad5366207861a3f1e510f3e WatchSource:0}: Error finding container 5a24b86da476fdc37c3262a68cdee377018272e4fad5366207861a3f1e510f3e: Status 404 returned error can't find the container with id 5a24b86da476fdc37c3262a68cdee377018272e4fad5366207861a3f1e510f3e
Sep 10 22:30:17.245813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.245772    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" event={"ID":"1d7db34d-ca7d-409a-ac8d-24f05892f7f4","Type":"ContainerStarted","Data":"78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03"}
Sep 10 22:30:17.245977 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.245912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:17.247915 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.247886    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh" event={"ID":"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b","Type":"ContainerStarted","Data":"27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235"}
Sep 10 22:30:17.248034 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.247938    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh" event={"ID":"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b","Type":"ContainerStarted","Data":"5a24b86da476fdc37c3262a68cdee377018272e4fad5366207861a3f1e510f3e"}
Sep 10 22:30:17.248034 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.247969    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:17.268877 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.268808    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" podStartSLOduration=2.904022336 podStartE2EDuration="3.268790553s" totalImagesPullingTime="364.768217ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:17.267598769 +0000 UTC m=+717.678722866" watchObservedRunningTime="2026-09-10 22:30:17.268790553 +0000 UTC m=+717.679914649"
Sep 10 22:30:17.287316 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:17.287262    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh" podStartSLOduration=0.952633329 podStartE2EDuration="1.287245102s" totalImagesPullingTime="334.611773ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:17.285664411 +0000 UTC m=+717.696788536" watchObservedRunningTime="2026-09-10 22:30:17.287245102 +0000 UTC m=+717.698369198"
Sep 10 22:30:20.403008 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:20.398893    2582 patch_prober.go:28] interesting pod/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:40144->10.134.0.34:15021: read: connection reset by peer" start-of-body=
Sep 10 22:30:20.403008 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:20.398968    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": read tcp 10.134.0.2:40144->10.134.0.34:15021: read: connection reset by peer"
Sep 10 22:30:21.272162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:21.272133    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerID="1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43" exitCode=0
Sep 10 22:30:21.272322 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:21.272203    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" event={"ID":"b2b58565-b77e-4f23-b4b0-00fc1e480820","Type":"ContainerDied","Data":"1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"}
Sep 10 22:30:21.272651 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:21.272616    2582 scope.go:117] "RemoveContainer" containerID="1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"
Sep 10 22:30:21.273724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:21.273693    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:21.273787 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:21.273773    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:21.273829 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:21.273818    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:22.190178 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:22.190146    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:30:22.281616 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:22.280846    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" event={"ID":"b2b58565-b77e-4f23-b4b0-00fc1e480820","Type":"ContainerStarted","Data":"0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8"}
Sep 10 22:30:22.546740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:22.546689    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:22.547230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:22.547196    2582 patch_prober.go:28] interesting pod/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 22:30:22.547333 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:22.547255    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 22:30:23.263123 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:23.263086    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:30:23.266487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:23.266456    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:23.547413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:23.547314    2582 patch_prober.go:28] interesting pod/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 22:30:23.547722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:23.547688    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 22:30:24.547072 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:24.547030    2582 patch_prober.go:28] interesting pod/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 22:30:24.547699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:24.547664    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 22:30:25.547457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:25.547415    2582 patch_prober.go:28] interesting pod/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 22:30:25.547878 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:25.547495    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 22:30:26.546964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:26.546914    2582 patch_prober.go:28] interesting pod/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused" start-of-body=
Sep 10 22:30:26.547163 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:26.546978    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.34:15021/healthz/ready\": dial tcp 10.134.0.34:15021: connect: connection refused"
Sep 10 22:30:27.565079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:27.565046    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:27.565609 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:27.565585    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:27.566534 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:27.566511    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:30:28.976284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:28.976256    2582 patch_prober.go:28] interesting pod/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:52940->10.134.0.39:15021: read: connection reset by peer" start-of-body=
Sep 10 22:30:28.976809 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:28.976776    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:52940->10.134.0.39:15021: read: connection reset by peer"
Sep 10 22:30:29.317084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:29.316987    2582 generic.go:356] "Generic (PLEG): container finished" podID="982282e3-7c4a-468c-a247-65e66ec27e00" containerID="60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d" exitCode=0
Sep 10 22:30:29.317472 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:29.317421    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" event={"ID":"982282e3-7c4a-468c-a247-65e66ec27e00","Type":"ContainerDied","Data":"60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"}
Sep 10 22:30:29.317961 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:29.317935    2582 scope.go:117] "RemoveContainer" containerID="60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"
Sep 10 22:30:29.319404 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:29.319338    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:29.319506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:29.319431    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:29.319506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:29.319487    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:30.327345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:30.327303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" event={"ID":"982282e3-7c4a-468c-a247-65e66ec27e00","Type":"ContainerStarted","Data":"5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d"}
Sep 10 22:30:30.579309 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:30.579221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:30.579592 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:30.579554    2582 patch_prober.go:28] interesting pod/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 10 22:30:30.579695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:30.579616    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 10 22:30:31.579815 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.579766    2582 patch_prober.go:28] interesting pod/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 10 22:30:31.580276 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.579835    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 10 22:30:31.588091 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.588063    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"]
Sep 10 22:30:31.590588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.590572    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.593248 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.593223    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-d1a134-openshift-default-dockercfg-mj9cd\""
Sep 10 22:30:31.610339 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.610314    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"]
Sep 10 22:30:31.669282 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669234    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-socket\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669282 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669280    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56v9s\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-kube-api-access-56v9s\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669548 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669429    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-podinfo\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669548 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669480    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-token\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669677 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-credential-socket\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669677 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669612    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-data\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669677 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669647    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac99625-c1b8-45a9-8201-5774d10a1922-istiod-ca-cert\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-certs\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.669818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.669711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-envoy\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-socket\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771160    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56v9s\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-kube-api-access-56v9s\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771384 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771221    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-podinfo\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771384 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-token\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771384    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-credential-socket\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771433    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-data\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac99625-c1b8-45a9-8201-5774d10a1922-istiod-ca-cert\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771552 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771515    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-certs\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771554    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-envoy\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771564    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-socket\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-credential-socket\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.771989 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.771972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-data\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.772785 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.772759    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-certs\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.772942 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.772803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac99625-c1b8-45a9-8201-5774d10a1922-istiod-ca-cert\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.774761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.774740    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-envoy\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.775088 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.775064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-podinfo\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.780860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.780836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56v9s\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-kube-api-access-56v9s\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.781056 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.781038    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-token\") pod \"e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") " pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:31.902106 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:31.902017    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:32.226747 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.226707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"]
Sep 10 22:30:32.259806 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:32.259756    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac99625_c1b8_45a9_8201_5774d10a1922.slice/crio-32e4042b25b6fa1a7d9d65beea2acdbc240402808d356d0d66e2c1c028f86d28 WatchSource:0}: Error finding container 32e4042b25b6fa1a7d9d65beea2acdbc240402808d356d0d66e2c1c028f86d28: Status 404 returned error can't find the container with id 32e4042b25b6fa1a7d9d65beea2acdbc240402808d356d0d66e2c1c028f86d28
Sep 10 22:30:32.263482 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.263427    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:32.263742 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.263718    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:32.263947 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.263927    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:32.348806 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.348671    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" event={"ID":"0ac99625-c1b8-45a9-8201-5774d10a1922","Type":"ContainerStarted","Data":"32e4042b25b6fa1a7d9d65beea2acdbc240402808d356d0d66e2c1c028f86d28"}
Sep 10 22:30:32.580390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.580293    2582 patch_prober.go:28] interesting pod/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 10 22:30:32.580860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:32.580712    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 10 22:30:33.356331 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:33.356298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" event={"ID":"0ac99625-c1b8-45a9-8201-5774d10a1922","Type":"ContainerStarted","Data":"86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"}
Sep 10 22:30:33.422063 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:33.421991    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podStartSLOduration=2.42196869 podStartE2EDuration="2.42196869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:33.418269593 +0000 UTC m=+733.829393714" watchObservedRunningTime="2026-09-10 22:30:33.42196869 +0000 UTC m=+733.833092789"
Sep 10 22:30:33.579960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:33.579927    2582 patch_prober.go:28] interesting pod/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 10 22:30:33.580130 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:33.579991    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 10 22:30:33.902430 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:33.902385    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:33.908912 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:33.908885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:34.363502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:34.363424    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:34.364614 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:34.364587    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:34.579491 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:34.579452    2582 patch_prober.go:28] interesting pod/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body=
Sep 10 22:30:34.579708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:34.579523    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused"
Sep 10 22:30:35.623203 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:35.623160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:35.623867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:35.623832    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:35.624597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:35.624573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:30:37.382188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.382073    2582 generic.go:356] "Generic (PLEG): container finished" podID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerID="a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892" exitCode=0
Sep 10 22:30:37.382188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.382146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" event={"ID":"092453a1-f918-4054-b3b7-b5f7fe645a00","Type":"ContainerDied","Data":"a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"}
Sep 10 22:30:37.382785 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.382657    2582 scope.go:117] "RemoveContainer" containerID="a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"
Sep 10 22:30:37.384017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.383982    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:37.384122 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.384075    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:37.384122 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.384109    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:37.388359 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.388337    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"]
Sep 10 22:30:37.391895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.391877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.394325 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.394303    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d1a134\""
Sep 10 22:30:37.394910 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.394726    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d1a134-dockercfg-44nv2\""
Sep 10 22:30:37.406139 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.406115    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"]
Sep 10 22:30:37.542179 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.540173    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvlhb\" (UniqueName: \"kubernetes.io/projected/f81a328a-21a0-4c1d-842b-76b6ebc8c823-kube-api-access-xvlhb\") pod \"payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.542179 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.540353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81a328a-21a0-4c1d-842b-76b6ebc8c823-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.641744 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.641653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvlhb\" (UniqueName: \"kubernetes.io/projected/f81a328a-21a0-4c1d-842b-76b6ebc8c823-kube-api-access-xvlhb\") pod \"payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.641744 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.641741    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81a328a-21a0-4c1d-842b-76b6ebc8c823-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.642693 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.642671    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81a328a-21a0-4c1d-842b-76b6ebc8c823-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.650838 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.650812    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvlhb\" (UniqueName: \"kubernetes.io/projected/f81a328a-21a0-4c1d-842b-76b6ebc8c823-kube-api-access-xvlhb\") pod \"payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:37.728587 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:37.728544    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:38.002938 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.002903    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"]
Sep 10 22:30:38.005131 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:30:38.005106    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf81a328a_21a0_4c1d_842b_76b6ebc8c823.slice/crio-744e2a9b1af7f4079f75c148ab16cc94ae851d4dc7a997e01bd8b2a118a6385c WatchSource:0}: Error finding container 744e2a9b1af7f4079f75c148ab16cc94ae851d4dc7a997e01bd8b2a118a6385c: Status 404 returned error can't find the container with id 744e2a9b1af7f4079f75c148ab16cc94ae851d4dc7a997e01bd8b2a118a6385c
Sep 10 22:30:38.389503 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.389416    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv" event={"ID":"f81a328a-21a0-4c1d-842b-76b6ebc8c823","Type":"ContainerStarted","Data":"a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946"}
Sep 10 22:30:38.389503 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.389464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv" event={"ID":"f81a328a-21a0-4c1d-842b-76b6ebc8c823","Type":"ContainerStarted","Data":"744e2a9b1af7f4079f75c148ab16cc94ae851d4dc7a997e01bd8b2a118a6385c"}
Sep 10 22:30:38.390019 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.389502    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:38.391733 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.391707    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" event={"ID":"092453a1-f918-4054-b3b7-b5f7fe645a00","Type":"ContainerStarted","Data":"6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde"}
Sep 10 22:30:38.405726 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.405651    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv" podStartSLOduration=1.4056073119999999 podStartE2EDuration="1.405607312s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:30:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:30:38.404737086 +0000 UTC m=+738.815861205" watchObservedRunningTime="2026-09-10 22:30:38.405607312 +0000 UTC m=+738.816731412"
Sep 10 22:30:38.868886 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.868843    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:38.870012 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.869987    2582 patch_prober.go:28] interesting pod/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 22:30:38.870066 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:38.870048    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 22:30:39.868708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:39.868670    2582 patch_prober.go:28] interesting pod/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 22:30:39.869113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:39.868731    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 22:30:40.868370 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:40.868330    2582 patch_prober.go:28] interesting pod/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 22:30:40.868548 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:40.868387    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 22:30:41.868860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:41.868821    2582 patch_prober.go:28] interesting pod/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 22:30:41.869252 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:41.868881    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 22:30:42.868399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:42.868363    2582 patch_prober.go:28] interesting pod/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 10 22:30:42.868570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:42.868421    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 10 22:30:43.193011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:43.192919    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:44.083345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:44.083310    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:44.085654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:44.085595    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:30:49.399387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:49.399361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:30:54.493563 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:54.493527    2582 generic.go:356] "Generic (PLEG): container finished" podID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerID="86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000" exitCode=0
Sep 10 22:30:54.494003 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:54.493598    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" event={"ID":"0ac99625-c1b8-45a9-8201-5774d10a1922","Type":"ContainerDied","Data":"86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"}
Sep 10 22:30:54.494044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:54.494012    2582 scope.go:117] "RemoveContainer" containerID="86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"
Sep 10 22:30:54.495189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:54.495160    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:54.495248 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:54.495234    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:54.495283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:54.495267    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:30:55.502051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.502017    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" event={"ID":"0ac99625-c1b8-45a9-8201-5774d10a1922","Type":"ContainerStarted","Data":"053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91"}
Sep 10 22:30:55.582755 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.582721    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"]
Sep 10 22:30:55.582991 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.582963    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" podUID="1d7db34d-ca7d-409a-ac8d-24f05892f7f4" containerName="maas-api" containerID="cri-o://78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03" gracePeriod=30
Sep 10 22:30:55.871708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.871683    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:55.903333 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.903302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:30:55.903687 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.903666    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 22:30:55.903777 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.903718    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 22:30:55.940497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.940464    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls\") pod \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") "
Sep 10 22:30:55.940779 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.940760    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h92sb\" (UniqueName: \"kubernetes.io/projected/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-kube-api-access-h92sb\") pod \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") "
Sep 10 22:30:55.940981 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.940964    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-metrics-certs\") pod \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") "
Sep 10 22:30:55.941149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.941131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-openshift-service-ca\") pod \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\" (UID: \"1d7db34d-ca7d-409a-ac8d-24f05892f7f4\") "
Sep 10 22:30:55.941681 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.941519    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1d7db34d-ca7d-409a-ac8d-24f05892f7f4" (UID: "1d7db34d-ca7d-409a-ac8d-24f05892f7f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:30:55.941777 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.941744    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:30:55.944074 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.944032    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1d7db34d-ca7d-409a-ac8d-24f05892f7f4" (UID: "1d7db34d-ca7d-409a-ac8d-24f05892f7f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:30:55.944469 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.944445    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-kube-api-access-h92sb" (OuterVolumeSpecName: "kube-api-access-h92sb") pod "1d7db34d-ca7d-409a-ac8d-24f05892f7f4" (UID: "1d7db34d-ca7d-409a-ac8d-24f05892f7f4"). InnerVolumeSpecName "kube-api-access-h92sb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:30:55.944845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.944825    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1d7db34d-ca7d-409a-ac8d-24f05892f7f4" (UID: "1d7db34d-ca7d-409a-ac8d-24f05892f7f4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:30:55.988419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.988328    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"]
Sep 10 22:30:55.988614 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:55.988590    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy" containerID="cri-o://5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d" gracePeriod=30
Sep 10 22:30:56.043117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.043018    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:30:56.043117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.043050    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:30:56.043117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.043059    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h92sb\" (UniqueName: \"kubernetes.io/projected/1d7db34d-ca7d-409a-ac8d-24f05892f7f4-kube-api-access-h92sb\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:30:56.508164 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.508129    2582 generic.go:356] "Generic (PLEG): container finished" podID="1d7db34d-ca7d-409a-ac8d-24f05892f7f4" containerID="78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03" exitCode=0
Sep 10 22:30:56.508667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.508174    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"
Sep 10 22:30:56.508667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.508219    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" event={"ID":"1d7db34d-ca7d-409a-ac8d-24f05892f7f4","Type":"ContainerDied","Data":"78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03"}
Sep 10 22:30:56.508667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.508274    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm" event={"ID":"1d7db34d-ca7d-409a-ac8d-24f05892f7f4","Type":"ContainerDied","Data":"29da5c99d4270ac58b5dca30271924881ddd5b2e0af086ac223c7ead92638ff8"}
Sep 10 22:30:56.508667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.508303    2582 scope.go:117] "RemoveContainer" containerID="78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03"
Sep 10 22:30:56.538511 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.538469    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"]
Sep 10 22:30:56.541798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.541383    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-9005ccc0-fddf8894b-vfkzm"]
Sep 10 22:30:56.543002 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.542976    2582 scope.go:117] "RemoveContainer" containerID="78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03"
Sep 10 22:30:56.544125 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:30:56.544090    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03\": container with ID starting with 78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03 not found: ID does not exist" containerID="78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03"
Sep 10 22:30:56.544236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.544132    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03"} err="failed to get container status \"78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03\": rpc error: code = NotFound desc = could not find container \"78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03\": container with ID starting with 78c948355c258eb5c2642c0becee7da63ce9442514ee1131bb7b86beb5f3cc03 not found: ID does not exist"
Sep 10 22:30:56.902958 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.902859    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 22:30:56.903130 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:56.902949    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 22:30:57.903531 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:57.903496    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 22:30:57.903980 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:57.903550    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 22:30:58.051897 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:58.051863    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d7db34d-ca7d-409a-ac8d-24f05892f7f4" path="/var/lib/kubelet/pods/1d7db34d-ca7d-409a-ac8d-24f05892f7f4/volumes"
Sep 10 22:30:58.903692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:58.903562    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 22:30:58.903692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:58.903670    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 22:30:59.902723 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:59.902687    2582 patch_prober.go:28] interesting pod/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 10 22:30:59.902901 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:30:59.902758    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 10 22:31:00.907272 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:00.907241    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:31:00.907670 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:00.907516    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:31:00.908330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:00.908311    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:31:01.260604 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.260578    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:31:01.397964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.397921    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982282e3-7c4a-468c-a247-65e66ec27e00-istiod-ca-cert\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.397964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.397961    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-envoy\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398203 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.397996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-istio-token\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398203 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398030    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-data\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398203 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398055    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982282e3-7c4a-468c-a247-65e66ec27e00-istio-podinfo\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398203 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398163    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-certs\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398400 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-credential-socket\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398400 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398304    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-socket\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398400 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcw6d\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-kube-api-access-zcw6d\") pod \"982282e3-7c4a-468c-a247-65e66ec27e00\" (UID: \"982282e3-7c4a-468c-a247-65e66ec27e00\") "
Sep 10 22:31:01.398683 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398404    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-data" (OuterVolumeSpecName: "istio-data") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.398683 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398445    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.398683 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398501    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.398683 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398596    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.398903 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398778    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.398972 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398920    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.399038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398980    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.399038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.398996    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.399145 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.399102    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/982282e3-7c4a-468c-a247-65e66ec27e00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:01.400572 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.400549    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/982282e3-7c4a-468c-a247-65e66ec27e00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:31:01.400679 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.400583    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-istio-token" (OuterVolumeSpecName: "istio-token") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:01.400729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.400691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:31:01.400805 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.400786    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-kube-api-access-zcw6d" (OuterVolumeSpecName: "kube-api-access-zcw6d") pod "982282e3-7c4a-468c-a247-65e66ec27e00" (UID: "982282e3-7c4a-468c-a247-65e66ec27e00"). InnerVolumeSpecName "kube-api-access-zcw6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:01.500136 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.500101    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/982282e3-7c4a-468c-a247-65e66ec27e00-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.500136 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.500131    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcw6d\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-kube-api-access-zcw6d\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.500136 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.500140    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/982282e3-7c4a-468c-a247-65e66ec27e00-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.500375 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.500149    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/982282e3-7c4a-468c-a247-65e66ec27e00-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.500375 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.500159    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/982282e3-7c4a-468c-a247-65e66ec27e00-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:01.542655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.542590    2582 generic.go:356] "Generic (PLEG): container finished" podID="982282e3-7c4a-468c-a247-65e66ec27e00" containerID="5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d" exitCode=0
Sep 10 22:31:01.542845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.542680    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"
Sep 10 22:31:01.542845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.542681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" event={"ID":"982282e3-7c4a-468c-a247-65e66ec27e00","Type":"ContainerDied","Data":"5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d"}
Sep 10 22:31:01.542845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.542750    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g" event={"ID":"982282e3-7c4a-468c-a247-65e66ec27e00","Type":"ContainerDied","Data":"a22d1530eefcd680edb2d58b9d6c369710884225b6d2692d83bbfcb90cd74bc2"}
Sep 10 22:31:01.542845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.542778    2582 scope.go:117] "RemoveContainer" containerID="5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d"
Sep 10 22:31:01.552485 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.552461    2582 scope.go:117] "RemoveContainer" containerID="60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"
Sep 10 22:31:01.561686 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.561665    2582 scope.go:117] "RemoveContainer" containerID="5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d"
Sep 10 22:31:01.562009 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:31:01.561986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d\": container with ID starting with 5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d not found: ID does not exist" containerID="5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d"
Sep 10 22:31:01.562062 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.562018    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d"} err="failed to get container status \"5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d\": rpc error: code = NotFound desc = could not find container \"5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d\": container with ID starting with 5fbc351ed482abfd04228385bc755d733cf3dfef1ccbff6a5a615d0787e6348d not found: ID does not exist"
Sep 10 22:31:01.562062 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.562038    2582 scope.go:117] "RemoveContainer" containerID="60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"
Sep 10 22:31:01.562383 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:31:01.562362    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d\": container with ID starting with 60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d not found: ID does not exist" containerID="60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"
Sep 10 22:31:01.562456 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.562389    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d"} err="failed to get container status \"60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d\": rpc error: code = NotFound desc = could not find container \"60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d\": container with ID starting with 60d868045af2a221ab733ce3daae84d60af5576790a231ab05f75fbae8586e5d not found: ID does not exist"
Sep 10 22:31:01.563729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.563710    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"]
Sep 10 22:31:01.571092 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:01.571057    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-9005ccc0-openshift-default-b8f69cb54-7m82g"]
Sep 10 22:31:02.052505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.052471    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" path="/var/lib/kubelet/pods/982282e3-7c4a-468c-a247-65e66ec27e00/volumes"
Sep 10 22:31:02.866983 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.866951    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"]
Sep 10 22:31:02.867356 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867344    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d7db34d-ca7d-409a-ac8d-24f05892f7f4" containerName="maas-api"
Sep 10 22:31:02.867398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867359    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d7db34d-ca7d-409a-ac8d-24f05892f7f4" containerName="maas-api"
Sep 10 22:31:02.867398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867374    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy"
Sep 10 22:31:02.867398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867380    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy"
Sep 10 22:31:02.867398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867386    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy"
Sep 10 22:31:02.867398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867392    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy"
Sep 10 22:31:02.867555 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867444    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy"
Sep 10 22:31:02.867555 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.867454    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d7db34d-ca7d-409a-ac8d-24f05892f7f4" containerName="maas-api"
Sep 10 22:31:02.872323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.872302    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:02.874820 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.874792    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-2643d53e-serving-cert\""
Sep 10 22:31:02.884661 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:02.884609    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"]
Sep 10 22:31:03.016557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.016520    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cee5ed2-7950-4b14-9583-6885a191fdd1-openshift-service-ca\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.016557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.016567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-maas-api-tls\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.016830 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.016694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfkj7\" (UniqueName: \"kubernetes.io/projected/6cee5ed2-7950-4b14-9583-6885a191fdd1-kube-api-access-mfkj7\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.016877 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.016824    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-metrics-certs\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.118379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.118287    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cee5ed2-7950-4b14-9583-6885a191fdd1-openshift-service-ca\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.118379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.118338    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-maas-api-tls\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.118379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.118378    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfkj7\" (UniqueName: \"kubernetes.io/projected/6cee5ed2-7950-4b14-9583-6885a191fdd1-kube-api-access-mfkj7\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.118880 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.118463    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-metrics-certs\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.119027 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.119007    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cee5ed2-7950-4b14-9583-6885a191fdd1-openshift-service-ca\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.121016 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.120997    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-metrics-certs\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.121069 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.121050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-maas-api-tls\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.131416 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.131383    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfkj7\" (UniqueName: \"kubernetes.io/projected/6cee5ed2-7950-4b14-9583-6885a191fdd1-kube-api-access-mfkj7\") pod \"maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.185331 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.185294    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:03.467367 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.467338    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"]
Sep 10 22:31:03.469739 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:31:03.469710    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cee5ed2_7950_4b14_9583_6885a191fdd1.slice/crio-87db5f54db14a3e90f88ab541cbee44b013bdb5c9b9e9141efaf349ae4b080f8 WatchSource:0}: Error finding container 87db5f54db14a3e90f88ab541cbee44b013bdb5c9b9e9141efaf349ae4b080f8: Status 404 returned error can't find the container with id 87db5f54db14a3e90f88ab541cbee44b013bdb5c9b9e9141efaf349ae4b080f8
Sep 10 22:31:03.555431 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:03.555399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp" event={"ID":"6cee5ed2-7950-4b14-9583-6885a191fdd1","Type":"ContainerStarted","Data":"87db5f54db14a3e90f88ab541cbee44b013bdb5c9b9e9141efaf349ae4b080f8"}
Sep 10 22:31:04.562458 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:04.562420    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp" event={"ID":"6cee5ed2-7950-4b14-9583-6885a191fdd1","Type":"ContainerStarted","Data":"63804b818b5066bba88cec5de7605a57667087d13f886d7db900f400d2376190"}
Sep 10 22:31:04.562881 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:04.562552    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:04.582137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:04.582088    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp" podStartSLOduration=2.187933464 podStartE2EDuration="2.582072693s" totalImagesPullingTime="394.139229ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:04.581782063 +0000 UTC m=+764.992906182" watchObservedRunningTime="2026-09-10 22:31:04.582072693 +0000 UTC m=+764.993196789"
Sep 10 22:31:10.573394 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:10.573361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:28.944017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.943973    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"]
Sep 10 22:31:28.944596 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.944424    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="982282e3-7c4a-468c-a247-65e66ec27e00" containerName="istio-proxy"
Sep 10 22:31:28.949125 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.949100    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:28.952699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.952331    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-cc3245\"/\"autores-model-cc3245-kserve-self-signed-certs\""
Sep 10 22:31:28.952699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.952393    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-autores-cc3245\"/\"default-dockercfg-h987c\""
Sep 10 22:31:28.952699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.952557    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-cc3245\"/\"openshift-service-ca.crt\""
Sep 10 22:31:28.952699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.952581    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-autores-cc3245\"/\"kube-root-ca.crt\""
Sep 10 22:31:28.955571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:28.955549    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"]
Sep 10 22:31:29.067224 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.067187    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-model-cache\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.067386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.067243    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-dshm\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.067386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.067289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-home\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.067386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.067329    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-tmp-dir\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.067494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.067427    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26qfb\" (UniqueName: \"kubernetes.io/projected/bebca841-dda9-4c20-b59e-9320fe34fac3-kube-api-access-26qfb\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.067494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.067455    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bebca841-dda9-4c20-b59e-9320fe34fac3-tls-certs\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.168850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.168812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-dshm\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.168850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.168853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-home\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169114 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.168874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-tmp-dir\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169114 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.169022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26qfb\" (UniqueName: \"kubernetes.io/projected/bebca841-dda9-4c20-b59e-9320fe34fac3-kube-api-access-26qfb\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169114 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.169064    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bebca841-dda9-4c20-b59e-9320fe34fac3-tls-certs\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169114 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.169106    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-model-cache\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169318 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.169225    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-home\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169318 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.169287    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-tmp-dir\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.169426 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.169411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-model-cache\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.171391 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.171366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-dshm\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.171635 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.171603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bebca841-dda9-4c20-b59e-9320fe34fac3-tls-certs\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.176864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.176841    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26qfb\" (UniqueName: \"kubernetes.io/projected/bebca841-dda9-4c20-b59e-9320fe34fac3-kube-api-access-26qfb\") pod \"autores-model-cc3245-kserve-6758cc4859-ftstb\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") " pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.261891 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.261851    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:29.535902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.535869    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"]
Sep 10 22:31:29.538425 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:31:29.538399    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbebca841_dda9_4c20_b59e_9320fe34fac3.slice/crio-a2301850528916f4bc5baa2b610eaa1258f38906ac1640ca33666a877fd4d022 WatchSource:0}: Error finding container a2301850528916f4bc5baa2b610eaa1258f38906ac1640ca33666a877fd4d022: Status 404 returned error can't find the container with id a2301850528916f4bc5baa2b610eaa1258f38906ac1640ca33666a877fd4d022
Sep 10 22:31:29.701820 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.701776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb" event={"ID":"bebca841-dda9-4c20-b59e-9320fe34fac3","Type":"ContainerStarted","Data":"aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473"}
Sep 10 22:31:29.701820 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.701823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb" event={"ID":"bebca841-dda9-4c20-b59e-9320fe34fac3","Type":"ContainerStarted","Data":"a2301850528916f4bc5baa2b610eaa1258f38906ac1640ca33666a877fd4d022"}
Sep 10 22:31:29.719034 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:29.718978    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb" podStartSLOduration=1.718962374 podStartE2EDuration="1.718962374s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:29.717678044 +0000 UTC m=+790.128802161" watchObservedRunningTime="2026-09-10 22:31:29.718962374 +0000 UTC m=+790.130086490"
Sep 10 22:31:33.543730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.543691    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"]
Sep 10 22:31:33.544124 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.543961    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp" podUID="6cee5ed2-7950-4b14-9583-6885a191fdd1" containerName="maas-api" containerID="cri-o://63804b818b5066bba88cec5de7605a57667087d13f886d7db900f400d2376190" gracePeriod=30
Sep 10 22:31:33.729346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.729234    2582 generic.go:356] "Generic (PLEG): container finished" podID="6cee5ed2-7950-4b14-9583-6885a191fdd1" containerID="63804b818b5066bba88cec5de7605a57667087d13f886d7db900f400d2376190" exitCode=0
Sep 10 22:31:33.729346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.729280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp" event={"ID":"6cee5ed2-7950-4b14-9583-6885a191fdd1","Type":"ContainerDied","Data":"63804b818b5066bba88cec5de7605a57667087d13f886d7db900f400d2376190"}
Sep 10 22:31:33.804025 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.803955    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:33.917858 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.917823    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-maas-api-tls\") pod \"6cee5ed2-7950-4b14-9583-6885a191fdd1\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") "
Sep 10 22:31:33.918039 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.917984    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-metrics-certs\") pod \"6cee5ed2-7950-4b14-9583-6885a191fdd1\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") "
Sep 10 22:31:33.918039 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.918031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mfkj7\" (UniqueName: \"kubernetes.io/projected/6cee5ed2-7950-4b14-9583-6885a191fdd1-kube-api-access-mfkj7\") pod \"6cee5ed2-7950-4b14-9583-6885a191fdd1\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") "
Sep 10 22:31:33.918161 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.918068    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cee5ed2-7950-4b14-9583-6885a191fdd1-openshift-service-ca\") pod \"6cee5ed2-7950-4b14-9583-6885a191fdd1\" (UID: \"6cee5ed2-7950-4b14-9583-6885a191fdd1\") "
Sep 10 22:31:33.918671 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.918596    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6cee5ed2-7950-4b14-9583-6885a191fdd1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6cee5ed2-7950-4b14-9583-6885a191fdd1" (UID: "6cee5ed2-7950-4b14-9583-6885a191fdd1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:31:33.920388 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.920352    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6cee5ed2-7950-4b14-9583-6885a191fdd1" (UID: "6cee5ed2-7950-4b14-9583-6885a191fdd1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:31:33.920601 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.920581    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6cee5ed2-7950-4b14-9583-6885a191fdd1" (UID: "6cee5ed2-7950-4b14-9583-6885a191fdd1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:31:33.920936 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:33.920907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cee5ed2-7950-4b14-9583-6885a191fdd1-kube-api-access-mfkj7" (OuterVolumeSpecName: "kube-api-access-mfkj7") pod "6cee5ed2-7950-4b14-9583-6885a191fdd1" (UID: "6cee5ed2-7950-4b14-9583-6885a191fdd1"). InnerVolumeSpecName "kube-api-access-mfkj7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:31:34.019740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.019685    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.019740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.019740    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mfkj7\" (UniqueName: \"kubernetes.io/projected/6cee5ed2-7950-4b14-9583-6885a191fdd1-kube-api-access-mfkj7\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.019740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.019756    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6cee5ed2-7950-4b14-9583-6885a191fdd1-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.020070 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.019770    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6cee5ed2-7950-4b14-9583-6885a191fdd1-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:31:34.633235 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.633202    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"]
Sep 10 22:31:34.633685 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.633647    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cee5ed2-7950-4b14-9583-6885a191fdd1" containerName="maas-api"
Sep 10 22:31:34.633685 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.633660    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cee5ed2-7950-4b14-9583-6885a191fdd1" containerName="maas-api"
Sep 10 22:31:34.633789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.633720    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cee5ed2-7950-4b14-9583-6885a191fdd1" containerName="maas-api"
Sep 10 22:31:34.636956 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.636933    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.639185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.639165    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-df975900-openshift-default-dockercfg-t9ln9\""
Sep 10 22:31:34.648155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.648131    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"]
Sep 10 22:31:34.726068 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-certs\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726098    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6n4k\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-kube-api-access-f6n4k\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726134    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-socket\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726169    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-envoy\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726228    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istiod-ca-cert\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726263    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-credential-socket\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726288    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-token\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726320    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-data\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.726565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.726344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-podinfo\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.739405 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.739376    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"
Sep 10 22:31:34.739615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.739410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp" event={"ID":"6cee5ed2-7950-4b14-9583-6885a191fdd1","Type":"ContainerDied","Data":"87db5f54db14a3e90f88ab541cbee44b013bdb5c9b9e9141efaf349ae4b080f8"}
Sep 10 22:31:34.739615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.739473    2582 scope.go:117] "RemoveContainer" containerID="63804b818b5066bba88cec5de7605a57667087d13f886d7db900f400d2376190"
Sep 10 22:31:34.769880 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.764521    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"]
Sep 10 22:31:34.771858 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.771828    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-2643d53e-59994bc7c4-gh5qp"]
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828487    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-certs\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828557    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6n4k\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-kube-api-access-f6n4k\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828593    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-socket\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828650    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-envoy\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istiod-ca-cert\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-credential-socket\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-token\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-data\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.828833    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-podinfo\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.832130    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-credential-socket\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.832924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.832840    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istiod-ca-cert\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.833971 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.833343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-podinfo\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.833971 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.833413    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-data\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.833971 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.833680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-socket\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.833971 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.833765    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-envoy\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.833971 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.833781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-certs\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.840834 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.840807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-token\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.840921 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.840869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6n4k\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-kube-api-access-f6n4k\") pod \"e2e-ait-df975900-openshift-default-f999d857b-t2rwj\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") " pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:34.950079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:34.949990    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:35.230561 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.230530    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"]
Sep 10 22:31:35.231786 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:31:35.231759    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a31e5f8_f88c_4f4e_b337_a01bba9122b8.slice/crio-e007eaeeec51c5d7b4d7db8d9a901ec087e7a3f894664dd2bbe2417a1bac1b64 WatchSource:0}: Error finding container e007eaeeec51c5d7b4d7db8d9a901ec087e7a3f894664dd2bbe2417a1bac1b64: Status 404 returned error can't find the container with id e007eaeeec51c5d7b4d7db8d9a901ec087e7a3f894664dd2bbe2417a1bac1b64
Sep 10 22:31:35.234172 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.234136    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:31:35.234256 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.234208    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:31:35.234256 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.234239    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:31:35.746491 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.746454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" event={"ID":"3a31e5f8-f88c-4f4e-b337-a01bba9122b8","Type":"ContainerStarted","Data":"b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"}
Sep 10 22:31:35.746999 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.746517    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" event={"ID":"3a31e5f8-f88c-4f4e-b337-a01bba9122b8","Type":"ContainerStarted","Data":"e007eaeeec51c5d7b4d7db8d9a901ec087e7a3f894664dd2bbe2417a1bac1b64"}
Sep 10 22:31:35.767173 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.767114    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podStartSLOduration=1.76709618 podStartE2EDuration="1.76709618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:35.764600219 +0000 UTC m=+796.175724327" watchObservedRunningTime="2026-09-10 22:31:35.76709618 +0000 UTC m=+796.178220278"
Sep 10 22:31:35.950740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:35.950702    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:36.053111 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:36.053029    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6cee5ed2-7950-4b14-9583-6885a191fdd1" path="/var/lib/kubelet/pods/6cee5ed2-7950-4b14-9583-6885a191fdd1/volumes"
Sep 10 22:31:36.955745 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:36.955719    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:37.760438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:37.760407    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:37.761538 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:37.761515    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:38.277252 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.277203    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"]
Sep 10 22:31:38.282301 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.282274    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.284749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.284724    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-df975900-serving-cert\""
Sep 10 22:31:38.293960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.293127    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"]
Sep 10 22:31:38.368089 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.368053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8vjd\" (UniqueName: \"kubernetes.io/projected/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-kube-api-access-z8vjd\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.368089 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.368090    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-openshift-service-ca\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.368315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.368167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.368315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.368186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-metrics-certs\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.469465 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.469420    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.469465 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.469462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-metrics-certs\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.469753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.469537    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8vjd\" (UniqueName: \"kubernetes.io/projected/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-kube-api-access-z8vjd\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.469753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.469566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-openshift-service-ca\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.469753 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:31:38.469575    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-df975900-serving-cert: secret "maas-api-e2e-ait-df975900-serving-cert" not found
Sep 10 22:31:38.469753 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:31:38.469685    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls podName:c3d360e3-c5e7-42bf-8a05-862bfe3b6319 nodeName:}" failed. No retries permitted until 2026-09-10 22:31:38.969660068 +0000 UTC m=+799.380784160 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls") pod "maas-api-e2e-ait-df975900-585679bcd7-6jhsp" (UID: "c3d360e3-c5e7-42bf-8a05-862bfe3b6319") : secret "maas-api-e2e-ait-df975900-serving-cert" not found
Sep 10 22:31:38.470295 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.470271    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-openshift-service-ca\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.472289 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.472268    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-metrics-certs\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.478104 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.478078    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8vjd\" (UniqueName: \"kubernetes.io/projected/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-kube-api-access-z8vjd\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.976297 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.976111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:38.980177 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:38.980141    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls\") pod \"maas-api-e2e-ait-df975900-585679bcd7-6jhsp\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:39.198079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.198036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:39.263084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.262732    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:39.263084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.262802    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:39.286505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.286373    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:39.501644 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.501601    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"]
Sep 10 22:31:39.503568 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:31:39.503540    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3d360e3_c5e7_42bf_8a05_862bfe3b6319.slice/crio-bd82f1599b741e54ba3bb1d23469ee8a90c3d4935a0a8364c64e96d1f3144273 WatchSource:0}: Error finding container bd82f1599b741e54ba3bb1d23469ee8a90c3d4935a0a8364c64e96d1f3144273: Status 404 returned error can't find the container with id bd82f1599b741e54ba3bb1d23469ee8a90c3d4935a0a8364c64e96d1f3144273
Sep 10 22:31:39.772998 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.772958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp" event={"ID":"c3d360e3-c5e7-42bf-8a05-862bfe3b6319","Type":"ContainerStarted","Data":"bd82f1599b741e54ba3bb1d23469ee8a90c3d4935a0a8364c64e96d1f3144273"}
Sep 10 22:31:39.784849 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:39.784821    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:31:40.780208 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:40.780174    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp" event={"ID":"c3d360e3-c5e7-42bf-8a05-862bfe3b6319","Type":"ContainerStarted","Data":"6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90"}
Sep 10 22:31:40.798193 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:40.798140    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp" podStartSLOduration=2.427823849 podStartE2EDuration="2.798122118s" totalImagesPullingTime="370.298269ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:31:40.797096609 +0000 UTC m=+801.208220730" watchObservedRunningTime="2026-09-10 22:31:40.798122118 +0000 UTC m=+801.209246214"
Sep 10 22:31:41.789548 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:41.789514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:47.800572 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:47.800539    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:31:58.885487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:58.885455    2582 generic.go:356] "Generic (PLEG): container finished" podID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerID="b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b" exitCode=0
Sep 10 22:31:58.885970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:58.885507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" event={"ID":"3a31e5f8-f88c-4f4e-b337-a01bba9122b8","Type":"ContainerDied","Data":"b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"}
Sep 10 22:31:58.885970 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:58.885909    2582 scope.go:117] "RemoveContainer" containerID="b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"
Sep 10 22:31:58.886998 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:58.886967    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:31:58.887057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:58.887036    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:31:58.887094 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:58.887067    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:31:59.892475 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:59.892444    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" event={"ID":"3a31e5f8-f88c-4f4e-b337-a01bba9122b8","Type":"ContainerStarted","Data":"fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144"}
Sep 10 22:31:59.950533 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:59.950491    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:31:59.950820 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:59.950798    2582 patch_prober.go:28] interesting pod/e2e-ait-df975900-openshift-default-f999d857b-t2rwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:31:59.950905 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:31:59.950857    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 22:32:00.951192 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:00.951161    2582 patch_prober.go:28] interesting pod/e2e-ait-df975900-openshift-default-f999d857b-t2rwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:32:00.951595 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:00.951217    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 22:32:01.951192 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:01.951157    2582 patch_prober.go:28] interesting pod/e2e-ait-df975900-openshift-default-f999d857b-t2rwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:32:01.951370 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:01.951216    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 22:32:02.951117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:02.951072    2582 patch_prober.go:28] interesting pod/e2e-ait-df975900-openshift-default-f999d857b-t2rwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:32:02.951324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:02.951163    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 22:32:03.950951 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:03.950901    2582 patch_prober.go:28] interesting pod/e2e-ait-df975900-openshift-default-f999d857b-t2rwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body=
Sep 10 22:32:03.951336 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:03.950980    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused"
Sep 10 22:32:05.129801 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:05.129766    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:32:05.130355 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:05.130247    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:32:05.131144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:05.131113    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:32:08.862058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:08.862026    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"]
Sep 10 22:32:08.862494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:08.862301    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp" podUID="c3d360e3-c5e7-42bf-8a05-862bfe3b6319" containerName="maas-api" containerID="cri-o://6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90" gracePeriod=30
Sep 10 22:32:09.114049 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.113971    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:32:09.202108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.202068    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z8vjd\" (UniqueName: \"kubernetes.io/projected/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-kube-api-access-z8vjd\") pod \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") "
Sep 10 22:32:09.202340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.202182    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-metrics-certs\") pod \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") "
Sep 10 22:32:09.202340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.202256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-openshift-service-ca\") pod \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") "
Sep 10 22:32:09.202340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.202278    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls\") pod \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\" (UID: \"c3d360e3-c5e7-42bf-8a05-862bfe3b6319\") "
Sep 10 22:32:09.202696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.202662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c3d360e3-c5e7-42bf-8a05-862bfe3b6319" (UID: "c3d360e3-c5e7-42bf-8a05-862bfe3b6319"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:09.204424 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.204394    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-kube-api-access-z8vjd" (OuterVolumeSpecName: "kube-api-access-z8vjd") pod "c3d360e3-c5e7-42bf-8a05-862bfe3b6319" (UID: "c3d360e3-c5e7-42bf-8a05-862bfe3b6319"). InnerVolumeSpecName "kube-api-access-z8vjd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:09.204545 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.204501    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c3d360e3-c5e7-42bf-8a05-862bfe3b6319" (UID: "c3d360e3-c5e7-42bf-8a05-862bfe3b6319"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:09.204603 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.204539    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c3d360e3-c5e7-42bf-8a05-862bfe3b6319" (UID: "c3d360e3-c5e7-42bf-8a05-862bfe3b6319"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:09.303692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.303658    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.303692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.303689    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.303910 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.303717    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.303910 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.303729    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z8vjd\" (UniqueName: \"kubernetes.io/projected/c3d360e3-c5e7-42bf-8a05-862bfe3b6319-kube-api-access-z8vjd\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:09.953801 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.953767    2582 generic.go:356] "Generic (PLEG): container finished" podID="c3d360e3-c5e7-42bf-8a05-862bfe3b6319" containerID="6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90" exitCode=0
Sep 10 22:32:09.953801 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.953806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"
Sep 10 22:32:09.954335 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.953853    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp" event={"ID":"c3d360e3-c5e7-42bf-8a05-862bfe3b6319","Type":"ContainerDied","Data":"6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90"}
Sep 10 22:32:09.954335 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.953912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp" event={"ID":"c3d360e3-c5e7-42bf-8a05-862bfe3b6319","Type":"ContainerDied","Data":"bd82f1599b741e54ba3bb1d23469ee8a90c3d4935a0a8364c64e96d1f3144273"}
Sep 10 22:32:09.954335 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.953947    2582 scope.go:117] "RemoveContainer" containerID="6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90"
Sep 10 22:32:09.963503 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.963485    2582 scope.go:117] "RemoveContainer" containerID="6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90"
Sep 10 22:32:09.963842 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:32:09.963821    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90\": container with ID starting with 6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90 not found: ID does not exist" containerID="6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90"
Sep 10 22:32:09.963941 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.963848    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90"} err="failed to get container status \"6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90\": rpc error: code = NotFound desc = could not find container \"6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90\": container with ID starting with 6dc87dce7e0b8d82a4020a6d55fdb67431c67f2a918ac7624fc6ae1e74daed90 not found: ID does not exist"
Sep 10 22:32:09.974637 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.974598    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"]
Sep 10 22:32:09.978312 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:09.978288    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-df975900-585679bcd7-6jhsp"]
Sep 10 22:32:10.052173 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:10.052140    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3d360e3-c5e7-42bf-8a05-862bfe3b6319" path="/var/lib/kubelet/pods/c3d360e3-c5e7-42bf-8a05-862bfe3b6319/volumes"
Sep 10 22:32:10.149209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:10.149178    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"]
Sep 10 22:32:10.149405 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:10.149372    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy" containerID="cri-o://fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144" gracePeriod=30
Sep 10 22:32:12.605987 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.605948    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"]
Sep 10 22:32:12.606495 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.606228    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh" podUID="0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" containerName="maas-api" containerID="cri-o://27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235" gracePeriod=30
Sep 10 22:32:12.863761 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.863693    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:32:12.975327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.975287    2582 generic.go:356] "Generic (PLEG): container finished" podID="0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" containerID="27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235" exitCode=0
Sep 10 22:32:12.975483 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.975339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh" event={"ID":"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b","Type":"ContainerDied","Data":"27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235"}
Sep 10 22:32:12.975483 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.975391    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"
Sep 10 22:32:12.975483 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.975409    2582 scope.go:117] "RemoveContainer" containerID="27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235"
Sep 10 22:32:12.975655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.975396    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh" event={"ID":"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b","Type":"ContainerDied","Data":"5a24b86da476fdc37c3262a68cdee377018272e4fad5366207861a3f1e510f3e"}
Sep 10 22:32:12.986379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.986358    2582 scope.go:117] "RemoveContainer" containerID="27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235"
Sep 10 22:32:12.986792 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:32:12.986765    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235\": container with ID starting with 27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235 not found: ID does not exist" containerID="27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235"
Sep 10 22:32:12.986856 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:12.986803    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235"} err="failed to get container status \"27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235\": rpc error: code = NotFound desc = could not find container \"27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235\": container with ID starting with 27a76f6acf30fb247873ad2f379d43a30853b93cda08e74ecdbaf0db231d6235 not found: ID does not exist"
Sep 10 22:32:13.040660 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.040602    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-metrics-certs\") pod \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") "
Sep 10 22:32:13.040840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.040726    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-maas-api-tls\") pod \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") "
Sep 10 22:32:13.040840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.040758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-openshift-service-ca\") pod \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") "
Sep 10 22:32:13.040840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.040800    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dhb5\" (UniqueName: \"kubernetes.io/projected/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-kube-api-access-6dhb5\") pod \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\" (UID: \"0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b\") "
Sep 10 22:32:13.041133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.041106    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" (UID: "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:13.042931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.042903    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" (UID: "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:13.043077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.043057    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" (UID: "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:13.043144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.043060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-kube-api-access-6dhb5" (OuterVolumeSpecName: "kube-api-access-6dhb5") pod "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" (UID: "0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b"). InnerVolumeSpecName "kube-api-access-6dhb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:13.142198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.142103    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:13.142198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.142138    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:13.142198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.142151    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:13.142198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.142163    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dhb5\" (UniqueName: \"kubernetes.io/projected/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b-kube-api-access-6dhb5\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:13.299630 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.299587    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"]
Sep 10 22:32:13.304818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:13.304792    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-cc3245-5dc6f46b4b-tzrdh"]
Sep 10 22:32:14.052633 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.052571    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" path="/var/lib/kubelet/pods/0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b/volumes"
Sep 10 22:32:14.176887 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.176848    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"]
Sep 10 22:32:14.177465 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.177449    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" containerName="maas-api"
Sep 10 22:32:14.177505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.177470    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" containerName="maas-api"
Sep 10 22:32:14.177505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.177487    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3d360e3-c5e7-42bf-8a05-862bfe3b6319" containerName="maas-api"
Sep 10 22:32:14.177505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.177495    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3d360e3-c5e7-42bf-8a05-862bfe3b6319" containerName="maas-api"
Sep 10 22:32:14.177609 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.177598    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3d360e3-c5e7-42bf-8a05-862bfe3b6319" containerName="maas-api"
Sep 10 22:32:14.177673 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.177614    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f8b1b5b-e328-4ec1-9ad4-bd954655eb2b" containerName="maas-api"
Sep 10 22:32:14.181128 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.181106    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.183470 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.183446    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-e01e31eb-serving-cert\""
Sep 10 22:32:14.192504 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.192460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"]
Sep 10 22:32:14.353807 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.353724    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9c42\" (UniqueName: \"kubernetes.io/projected/01ec4d1b-e155-4807-a067-3938219859e1-kube-api-access-n9c42\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.353807 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.353789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-metrics-certs\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.353989 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.353816    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-maas-api-tls\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.353989 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.353888    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4d1b-e155-4807-a067-3938219859e1-openshift-service-ca\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.454812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.454780    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4d1b-e155-4807-a067-3938219859e1-openshift-service-ca\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.455011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.454850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9c42\" (UniqueName: \"kubernetes.io/projected/01ec4d1b-e155-4807-a067-3938219859e1-kube-api-access-n9c42\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.455011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.454894    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-metrics-certs\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.455011 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.454920    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-maas-api-tls\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.455544 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.455519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4d1b-e155-4807-a067-3938219859e1-openshift-service-ca\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.457443 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.457421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-maas-api-tls\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.457443 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.457430    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-metrics-certs\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.463570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.463545    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9c42\" (UniqueName: \"kubernetes.io/projected/01ec4d1b-e155-4807-a067-3938219859e1-kube-api-access-n9c42\") pod \"maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.494451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.494417    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:14.773668 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.773642    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"]
Sep 10 22:32:14.775765 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:32:14.775734    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01ec4d1b_e155_4807_a067_3938219859e1.slice/crio-3f039f70738db4c7712e2c23e54798779199c7a200a735b4527c364d9397c721 WatchSource:0}: Error finding container 3f039f70738db4c7712e2c23e54798779199c7a200a735b4527c364d9397c721: Status 404 returned error can't find the container with id 3f039f70738db4c7712e2c23e54798779199c7a200a735b4527c364d9397c721
Sep 10 22:32:14.989220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:14.989181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56" event={"ID":"01ec4d1b-e155-4807-a067-3938219859e1","Type":"ContainerStarted","Data":"3f039f70738db4c7712e2c23e54798779199c7a200a735b4527c364d9397c721"}
Sep 10 22:32:15.409131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.409105    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:32:15.467724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467696    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istiod-ca-cert\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.467895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467786    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6n4k\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-kube-api-access-f6n4k\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.467895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467811    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-envoy\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.467895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-certs\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.467895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467865    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-credential-socket\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.468131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467896    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-podinfo\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.468131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467920    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-data\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.468131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.467970    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-socket\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.468131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468031    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-token\") pod \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\" (UID: \"3a31e5f8-f88c-4f4e-b337-a01bba9122b8\") "
Sep 10 22:32:15.468345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468153    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:15.468445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468424    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:15.468536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468444    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.468536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468468    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:15.468688 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468606    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:15.468688 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.468665    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:15.470694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.470608    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-kube-api-access-f6n4k" (OuterVolumeSpecName: "kube-api-access-f6n4k") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "kube-api-access-f6n4k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:15.470694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.470666    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:15.470694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.470679    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:32:15.471133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.471104    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a31e5f8-f88c-4f4e-b337-a01bba9122b8" (UID: "3a31e5f8-f88c-4f4e-b337-a01bba9122b8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:15.569700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569665    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6n4k\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-kube-api-access-f6n4k\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569694    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569703    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569949 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569710    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569949 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569722    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569949 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569730    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569949 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569737    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.569949 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.569746    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a31e5f8-f88c-4f4e-b337-a01bba9122b8-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:15.996628 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.996593    2582 generic.go:356] "Generic (PLEG): container finished" podID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerID="fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144" exitCode=0
Sep 10 22:32:15.996855 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.996677    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"
Sep 10 22:32:15.996855 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.996689    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" event={"ID":"3a31e5f8-f88c-4f4e-b337-a01bba9122b8","Type":"ContainerDied","Data":"fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144"}
Sep 10 22:32:15.996855 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.996783    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj" event={"ID":"3a31e5f8-f88c-4f4e-b337-a01bba9122b8","Type":"ContainerDied","Data":"e007eaeeec51c5d7b4d7db8d9a901ec087e7a3f894664dd2bbe2417a1bac1b64"}
Sep 10 22:32:15.996855 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.996815    2582 scope.go:117] "RemoveContainer" containerID="fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144"
Sep 10 22:32:15.998428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.998404    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56" event={"ID":"01ec4d1b-e155-4807-a067-3938219859e1","Type":"ContainerStarted","Data":"8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348"}
Sep 10 22:32:15.998543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:15.998528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:16.006457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.006438    2582 scope.go:117] "RemoveContainer" containerID="b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"
Sep 10 22:32:16.014966 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.014937    2582 scope.go:117] "RemoveContainer" containerID="fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144"
Sep 10 22:32:16.015262 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:32:16.015245    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144\": container with ID starting with fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144 not found: ID does not exist" containerID="fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144"
Sep 10 22:32:16.015314 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.015272    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144"} err="failed to get container status \"fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144\": rpc error: code = NotFound desc = could not find container \"fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144\": container with ID starting with fddeca739f22e8f4486424891f4e9256684edeb14971cef50df26982dcb76144 not found: ID does not exist"
Sep 10 22:32:16.015314 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.015291    2582 scope.go:117] "RemoveContainer" containerID="b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"
Sep 10 22:32:16.015530 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:32:16.015513    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b\": container with ID starting with b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b not found: ID does not exist" containerID="b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"
Sep 10 22:32:16.015572 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.015537    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b"} err="failed to get container status \"b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b\": rpc error: code = NotFound desc = could not find container \"b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b\": container with ID starting with b553d4556630f32d4f93689234f83ea422bd6466f2e246a037d243aa9797e35b not found: ID does not exist"
Sep 10 22:32:16.017292 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.017249    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56" podStartSLOduration=1.568370554 podStartE2EDuration="2.017236105s" totalImagesPullingTime="448.865551ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:16.016440054 +0000 UTC m=+836.427564161" watchObservedRunningTime="2026-09-10 22:32:16.017236105 +0000 UTC m=+836.428360202"
Sep 10 22:32:16.031588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.031555    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"]
Sep 10 22:32:16.037396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.037369    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-df975900-openshift-default-f999d857b-t2rwj"]
Sep 10 22:32:16.051956 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:16.051924    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" path="/var/lib/kubelet/pods/3a31e5f8-f88c-4f4e-b337-a01bba9122b8/volumes"
Sep 10 22:32:18.172198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:18.172157    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"]
Sep 10 22:32:22.011384 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:22.011357    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:33.192125 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.192062    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb" podUID="bebca841-dda9-4c20-b59e-9320fe34fac3" containerName="main" containerID="cri-o://aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473" gracePeriod=45
Sep 10 22:32:33.449244 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.449177    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:32:33.548917 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.548882    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-tmp-dir\") pod \"bebca841-dda9-4c20-b59e-9320fe34fac3\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") "
Sep 10 22:32:33.549093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.548929    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-model-cache\") pod \"bebca841-dda9-4c20-b59e-9320fe34fac3\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") "
Sep 10 22:32:33.549093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.548946    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-home\") pod \"bebca841-dda9-4c20-b59e-9320fe34fac3\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") "
Sep 10 22:32:33.549093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.548986    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-dshm\") pod \"bebca841-dda9-4c20-b59e-9320fe34fac3\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") "
Sep 10 22:32:33.549093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549019    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-26qfb\" (UniqueName: \"kubernetes.io/projected/bebca841-dda9-4c20-b59e-9320fe34fac3-kube-api-access-26qfb\") pod \"bebca841-dda9-4c20-b59e-9320fe34fac3\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") "
Sep 10 22:32:33.549093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549081    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bebca841-dda9-4c20-b59e-9320fe34fac3-tls-certs\") pod \"bebca841-dda9-4c20-b59e-9320fe34fac3\" (UID: \"bebca841-dda9-4c20-b59e-9320fe34fac3\") "
Sep 10 22:32:33.549301 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549158    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bebca841-dda9-4c20-b59e-9320fe34fac3" (UID: "bebca841-dda9-4c20-b59e-9320fe34fac3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:33.549301 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549201    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-model-cache" (OuterVolumeSpecName: "model-cache") pod "bebca841-dda9-4c20-b59e-9320fe34fac3" (UID: "bebca841-dda9-4c20-b59e-9320fe34fac3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:33.549301 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549279    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-home" (OuterVolumeSpecName: "home") pod "bebca841-dda9-4c20-b59e-9320fe34fac3" (UID: "bebca841-dda9-4c20-b59e-9320fe34fac3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:33.549448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549389    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-tmp-dir\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:33.549448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549405    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-model-cache\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:33.549448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.549414    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-home\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:33.551481 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.551454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-dshm" (OuterVolumeSpecName: "dshm") pod "bebca841-dda9-4c20-b59e-9320fe34fac3" (UID: "bebca841-dda9-4c20-b59e-9320fe34fac3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:32:33.551591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.551566    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bebca841-dda9-4c20-b59e-9320fe34fac3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bebca841-dda9-4c20-b59e-9320fe34fac3" (UID: "bebca841-dda9-4c20-b59e-9320fe34fac3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:33.551591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.551567    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bebca841-dda9-4c20-b59e-9320fe34fac3-kube-api-access-26qfb" (OuterVolumeSpecName: "kube-api-access-26qfb") pod "bebca841-dda9-4c20-b59e-9320fe34fac3" (UID: "bebca841-dda9-4c20-b59e-9320fe34fac3"). InnerVolumeSpecName "kube-api-access-26qfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:33.650451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.650414    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bebca841-dda9-4c20-b59e-9320fe34fac3-tls-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:33.650451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.650445    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bebca841-dda9-4c20-b59e-9320fe34fac3-dshm\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:33.650451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:33.650455    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-26qfb\" (UniqueName: \"kubernetes.io/projected/bebca841-dda9-4c20-b59e-9320fe34fac3-kube-api-access-26qfb\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:34.090470 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.090432    2582 generic.go:356] "Generic (PLEG): container finished" podID="bebca841-dda9-4c20-b59e-9320fe34fac3" containerID="aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473" exitCode=0
Sep 10 22:32:34.090470 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.090472    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"
Sep 10 22:32:34.090672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.090497    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb" event={"ID":"bebca841-dda9-4c20-b59e-9320fe34fac3","Type":"ContainerDied","Data":"aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473"}
Sep 10 22:32:34.090672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.090532    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb" event={"ID":"bebca841-dda9-4c20-b59e-9320fe34fac3","Type":"ContainerDied","Data":"a2301850528916f4bc5baa2b610eaa1258f38906ac1640ca33666a877fd4d022"}
Sep 10 22:32:34.090672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.090552    2582 scope.go:117] "RemoveContainer" containerID="aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473"
Sep 10 22:32:34.099463 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.099437    2582 scope.go:117] "RemoveContainer" containerID="aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473"
Sep 10 22:32:34.099830 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:32:34.099804    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473\": container with ID starting with aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473 not found: ID does not exist" containerID="aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473"
Sep 10 22:32:34.099934 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.099841    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473"} err="failed to get container status \"aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473\": rpc error: code = NotFound desc = could not find container \"aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473\": container with ID starting with aed3a8d8e2c85a6e6c30bf985efb41f75416cbff2484320f4e0f08da21a04473 not found: ID does not exist"
Sep 10 22:32:34.116591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.116565    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"]
Sep 10 22:32:34.118221 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:34.118202    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-autores-cc3245/autores-model-cc3245-kserve-6758cc4859-ftstb"]
Sep 10 22:32:36.051870 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:36.051838    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bebca841-dda9-4c20-b59e-9320fe34fac3" path="/var/lib/kubelet/pods/bebca841-dda9-4c20-b59e-9320fe34fac3/volumes"
Sep 10 22:32:45.522947 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.522903    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"]
Sep 10 22:32:45.523413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.523178    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56" podUID="01ec4d1b-e155-4807-a067-3938219859e1" containerName="maas-api" containerID="cri-o://8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348" gracePeriod=30
Sep 10 22:32:45.780046 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.779988    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:45.874020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.873965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9c42\" (UniqueName: \"kubernetes.io/projected/01ec4d1b-e155-4807-a067-3938219859e1-kube-api-access-n9c42\") pod \"01ec4d1b-e155-4807-a067-3938219859e1\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") "
Sep 10 22:32:45.874220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.874048    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-maas-api-tls\") pod \"01ec4d1b-e155-4807-a067-3938219859e1\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") "
Sep 10 22:32:45.874220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.874100    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4d1b-e155-4807-a067-3938219859e1-openshift-service-ca\") pod \"01ec4d1b-e155-4807-a067-3938219859e1\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") "
Sep 10 22:32:45.874220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.874200    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-metrics-certs\") pod \"01ec4d1b-e155-4807-a067-3938219859e1\" (UID: \"01ec4d1b-e155-4807-a067-3938219859e1\") "
Sep 10 22:32:45.874735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.874691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01ec4d1b-e155-4807-a067-3938219859e1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "01ec4d1b-e155-4807-a067-3938219859e1" (UID: "01ec4d1b-e155-4807-a067-3938219859e1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:32:45.878146 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.878115    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "01ec4d1b-e155-4807-a067-3938219859e1" (UID: "01ec4d1b-e155-4807-a067-3938219859e1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:45.879723 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.879689    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "01ec4d1b-e155-4807-a067-3938219859e1" (UID: "01ec4d1b-e155-4807-a067-3938219859e1"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:32:45.880805 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.880655    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01ec4d1b-e155-4807-a067-3938219859e1-kube-api-access-n9c42" (OuterVolumeSpecName: "kube-api-access-n9c42") pod "01ec4d1b-e155-4807-a067-3938219859e1" (UID: "01ec4d1b-e155-4807-a067-3938219859e1"). InnerVolumeSpecName "kube-api-access-n9c42". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:32:45.975678 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.975616    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/01ec4d1b-e155-4807-a067-3938219859e1-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:45.975678 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.975674    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:45.975678 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.975684    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9c42\" (UniqueName: \"kubernetes.io/projected/01ec4d1b-e155-4807-a067-3938219859e1-kube-api-access-n9c42\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:45.975922 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:45.975692    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/01ec4d1b-e155-4807-a067-3938219859e1-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:32:46.152778 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.152740    2582 generic.go:356] "Generic (PLEG): container finished" podID="01ec4d1b-e155-4807-a067-3938219859e1" containerID="8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348" exitCode=0
Sep 10 22:32:46.152976 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.152787    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"
Sep 10 22:32:46.152976 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.152823    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56" event={"ID":"01ec4d1b-e155-4807-a067-3938219859e1","Type":"ContainerDied","Data":"8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348"}
Sep 10 22:32:46.152976 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.152876    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56" event={"ID":"01ec4d1b-e155-4807-a067-3938219859e1","Type":"ContainerDied","Data":"3f039f70738db4c7712e2c23e54798779199c7a200a735b4527c364d9397c721"}
Sep 10 22:32:46.152976 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.152898    2582 scope.go:117] "RemoveContainer" containerID="8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348"
Sep 10 22:32:46.161548 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.161525    2582 scope.go:117] "RemoveContainer" containerID="8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348"
Sep 10 22:32:46.161868 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:32:46.161848    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348\": container with ID starting with 8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348 not found: ID does not exist" containerID="8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348"
Sep 10 22:32:46.161955 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.161876    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348"} err="failed to get container status \"8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348\": rpc error: code = NotFound desc = could not find container \"8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348\": container with ID starting with 8f1b087dc45fb7bb21d594545fdc92e56625ba2f59248e2bf8a4bc463cabb348 not found: ID does not exist"
Sep 10 22:32:46.185081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.185048    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"]
Sep 10 22:32:46.189872 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:46.189843    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-e01e31eb-747d4cd5c8-dqz56"]
Sep 10 22:32:48.051864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:48.051831    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01ec4d1b-e155-4807-a067-3938219859e1" path="/var/lib/kubelet/pods/01ec4d1b-e155-4807-a067-3938219859e1/volumes"
Sep 10 22:32:55.944203 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:55.944163    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"]
Sep 10 22:32:55.944596 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:55.944430    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" containerID="cri-o://6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde" gracePeriod=30
Sep 10 22:32:56.679447 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.679407    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"]
Sep 10 22:32:56.679979 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.679956    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bebca841-dda9-4c20-b59e-9320fe34fac3" containerName="main"
Sep 10 22:32:56.679979 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.679979    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="bebca841-dda9-4c20-b59e-9320fe34fac3" containerName="main"
Sep 10 22:32:56.680162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680002    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy"
Sep 10 22:32:56.680162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680012    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy"
Sep 10 22:32:56.680162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680022    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01ec4d1b-e155-4807-a067-3938219859e1" containerName="maas-api"
Sep 10 22:32:56.680162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680030    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="01ec4d1b-e155-4807-a067-3938219859e1" containerName="maas-api"
Sep 10 22:32:56.680162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680057    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy"
Sep 10 22:32:56.680162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680065    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy"
Sep 10 22:32:56.680353 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680163    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="bebca841-dda9-4c20-b59e-9320fe34fac3" containerName="main"
Sep 10 22:32:56.680353 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680177    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy"
Sep 10 22:32:56.680353 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.680188    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="01ec4d1b-e155-4807-a067-3938219859e1" containerName="maas-api"
Sep 10 22:32:56.684910 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.684887    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.687180 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.687158    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-7989d5-openshift-default-dockercfg-dmlg5\""
Sep 10 22:32:56.698369 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.698336    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"]
Sep 10 22:32:56.773281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773227    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-credential-socket\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lxp7\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-kube-api-access-8lxp7\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773394    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istiod-ca-cert\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-certs\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773482    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-data\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-podinfo\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-socket\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773601    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-envoy\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.773771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.773649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-token\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.874797 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.874760    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lxp7\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-kube-api-access-8lxp7\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.874797 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.874807    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istiod-ca-cert\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.874840    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-certs\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.874858    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-data\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.874891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-podinfo\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.874912    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-socket\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-envoy\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-token\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-credential-socket\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-certs\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875636 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875587    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-socket\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875779 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875700    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-data\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875846 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875780    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-credential-socket\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.875918 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.875899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istiod-ca-cert\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.877591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.877566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-envoy\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.877831 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.877810    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-podinfo\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.883167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.883143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-token\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.883256 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.883172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lxp7\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-kube-api-access-8lxp7\") pod \"e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") " pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:56.996887 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:56.996851    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:57.272518 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:57.272446    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"]
Sep 10 22:32:57.274967 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:32:57.274933    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb8e5991_eb5f_4c83_8c0d_d4df5c3ee374.slice/crio-c462f42b2e89d5d00716e550145b45b3d004760365b04bf05dd701227646757a WatchSource:0}: Error finding container c462f42b2e89d5d00716e550145b45b3d004760365b04bf05dd701227646757a: Status 404 returned error can't find the container with id c462f42b2e89d5d00716e550145b45b3d004760365b04bf05dd701227646757a
Sep 10 22:32:57.277615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:57.277573    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:32:57.277703 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:57.277663    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:32:57.277703 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:57.277698    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:32:58.220767 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:58.220694    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" event={"ID":"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374","Type":"ContainerStarted","Data":"9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"}
Sep 10 22:32:58.221179 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:58.221147    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" event={"ID":"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374","Type":"ContainerStarted","Data":"c462f42b2e89d5d00716e550145b45b3d004760365b04bf05dd701227646757a"}
Sep 10 22:32:58.242493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:58.242440    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podStartSLOduration=2.242425308 podStartE2EDuration="2.242425308s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:32:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:32:58.240334039 +0000 UTC m=+878.651458157" watchObservedRunningTime="2026-09-10 22:32:58.242425308 +0000 UTC m=+878.653549405"
Sep 10 22:32:58.997639 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:58.997591    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:59.003513 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:59.003485    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:59.086071 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:59.086034    2582 patch_prober.go:28] interesting pod/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:32:59.086233 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:59.086098    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:32:59.225794 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:59.225750    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:32:59.226884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:32:59.226862    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:33:01.196191 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.196161    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:33:01.215937 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.215843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-socket\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.215937 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.215918    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-certs\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.215954    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-podinfo\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.215980    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4x2m\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-kube-api-access-l4x2m\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216011    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-token\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216078    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092453a1-f918-4054-b3b7-b5f7fe645a00-istiod-ca-cert\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216155 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-envoy\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216178    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-credential-socket\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216199    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:01.216417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216221    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-data\") pod \"092453a1-f918-4054-b3b7-b5f7fe645a00\" (UID: \"092453a1-f918-4054-b3b7-b5f7fe645a00\") "
Sep 10 22:33:01.216417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216260    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:01.216417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216411    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-data" (OuterVolumeSpecName: "istio-data") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:01.216708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216693    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.216822 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216711    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.216822 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216723    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.216921 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.216869    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:01.217190 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.217151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/092453a1-f918-4054-b3b7-b5f7fe645a00-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:33:01.219051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.218991    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:33:01.219528 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.219503    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-kube-api-access-l4x2m" (OuterVolumeSpecName: "kube-api-access-l4x2m") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "kube-api-access-l4x2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:01.219860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.219831    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-token" (OuterVolumeSpecName: "istio-token") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:33:01.220465 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.220430    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "092453a1-f918-4054-b3b7-b5f7fe645a00" (UID: "092453a1-f918-4054-b3b7-b5f7fe645a00"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:33:01.239322 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.239289    2582 generic.go:356] "Generic (PLEG): container finished" podID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerID="6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde" exitCode=0
Sep 10 22:33:01.239501 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.239341    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"
Sep 10 22:33:01.239501 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.239365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" event={"ID":"092453a1-f918-4054-b3b7-b5f7fe645a00","Type":"ContainerDied","Data":"6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde"}
Sep 10 22:33:01.239501 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.239424    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm" event={"ID":"092453a1-f918-4054-b3b7-b5f7fe645a00","Type":"ContainerDied","Data":"7319ccba17d6984bdf08acfcdeb86b8f7aad0909efe83b66447e529ee1ed1f61"}
Sep 10 22:33:01.239501 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.239454    2582 scope.go:117] "RemoveContainer" containerID="6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde"
Sep 10 22:33:01.250112 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.250084    2582 scope.go:117] "RemoveContainer" containerID="a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"
Sep 10 22:33:01.259897 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.259875    2582 scope.go:117] "RemoveContainer" containerID="6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde"
Sep 10 22:33:01.260257 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:33:01.260237    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde\": container with ID starting with 6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde not found: ID does not exist" containerID="6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde"
Sep 10 22:33:01.260305 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.260268    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde"} err="failed to get container status \"6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde\": rpc error: code = NotFound desc = could not find container \"6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde\": container with ID starting with 6eab4f675280ddee409baf9674e7940dec1eb9b6697d49908d4ce3e629e95cde not found: ID does not exist"
Sep 10 22:33:01.260305 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.260288    2582 scope.go:117] "RemoveContainer" containerID="a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"
Sep 10 22:33:01.260593 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:33:01.260571    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892\": container with ID starting with a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892 not found: ID does not exist" containerID="a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"
Sep 10 22:33:01.260593 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.260603    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892"} err="failed to get container status \"a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892\": rpc error: code = NotFound desc = could not find container \"a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892\": container with ID starting with a21cd6d6c99458fa4edf442e9061441339989e1ed7b97c18efa1b9ccf75ab892 not found: ID does not exist"
Sep 10 22:33:01.264251 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.264223    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"]
Sep 10 22:33:01.269818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.269791    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-cc3245-openshift-default-679c9c8966-wzcgm"]
Sep 10 22:33:01.276954 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.276925    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"]
Sep 10 22:33:01.277330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277316    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy"
Sep 10 22:33:01.277408 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277333    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy"
Sep 10 22:33:01.277408 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277345    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy"
Sep 10 22:33:01.277408 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277353    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy"
Sep 10 22:33:01.277589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277427    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy"
Sep 10 22:33:01.277589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277438    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" containerName="istio-proxy"
Sep 10 22:33:01.277589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.277445    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a31e5f8-f88c-4f4e-b337-a01bba9122b8" containerName="istio-proxy"
Sep 10 22:33:01.281446 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.281424    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.283838 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.283819    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-7989d5-serving-cert\""
Sep 10 22:33:01.292829 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.292728    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"]
Sep 10 22:33:01.317346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317304    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-openshift-service-ca\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.317346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317350    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-metrics-certs\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.317592 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317423    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvzkm\" (UniqueName: \"kubernetes.io/projected/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-kube-api-access-vvzkm\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.317701 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317656    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.317771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317741    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.317771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317754    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4x2m\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-kube-api-access-l4x2m\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.317771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317764    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.317879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317775    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/092453a1-f918-4054-b3b7-b5f7fe645a00-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.317879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317783    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.317879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.317790    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/092453a1-f918-4054-b3b7-b5f7fe645a00-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:33:01.419284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.419241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvzkm\" (UniqueName: \"kubernetes.io/projected/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-kube-api-access-vvzkm\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.419482 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.419385    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.419482 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.419434    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-openshift-service-ca\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.419482 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.419462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-metrics-certs\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.419687 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:33:01.419555    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-serving-cert: secret "maas-api-e2e-explicit-7989d5-serving-cert" not found
Sep 10 22:33:01.419687 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:33:01.419660    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls podName:d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b nodeName:}" failed. No retries permitted until 2026-09-10 22:33:01.919636827 +0000 UTC m=+882.330760919 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls") pod "maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" (UID: "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b") : secret "maas-api-e2e-explicit-7989d5-serving-cert" not found
Sep 10 22:33:01.420144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.420122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-openshift-service-ca\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.422160 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.422142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-metrics-certs\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.427825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.427799    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvzkm\" (UniqueName: \"kubernetes.io/projected/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-kube-api-access-vvzkm\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.924212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.924171    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.926816 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.926782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls\") pod \"maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:01.993400 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.993349    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"]
Sep 10 22:33:01.996735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.996699    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:01.999586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.999560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-7989d5\""
Sep 10 22:33:01.999750 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:01.999680    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-7989d5-dockercfg-jkvbz\""
Sep 10 22:33:02.007687 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.007658    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"]
Sep 10 22:33:02.025087 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.025053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275b5cd7-7c0e-4006-b161-1b3982df9e78-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7989d5-df8d468bf-47phc\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") " pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.025249 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.025177    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6hp4\" (UniqueName: \"kubernetes.io/projected/275b5cd7-7c0e-4006-b161-1b3982df9e78-kube-api-access-g6hp4\") pod \"payload-processing-e2e-explicit-7989d5-df8d468bf-47phc\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") " pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.052346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.052311    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="092453a1-f918-4054-b3b7-b5f7fe645a00" path="/var/lib/kubelet/pods/092453a1-f918-4054-b3b7-b5f7fe645a00/volumes"
Sep 10 22:33:02.126444 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.126410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275b5cd7-7c0e-4006-b161-1b3982df9e78-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7989d5-df8d468bf-47phc\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") " pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.126652 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.126512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6hp4\" (UniqueName: \"kubernetes.io/projected/275b5cd7-7c0e-4006-b161-1b3982df9e78-kube-api-access-g6hp4\") pod \"payload-processing-e2e-explicit-7989d5-df8d468bf-47phc\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") " pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.127393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.127362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275b5cd7-7c0e-4006-b161-1b3982df9e78-plugins-config-volume\") pod \"payload-processing-e2e-explicit-7989d5-df8d468bf-47phc\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") " pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.137762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.137721    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6hp4\" (UniqueName: \"kubernetes.io/projected/275b5cd7-7c0e-4006-b161-1b3982df9e78-kube-api-access-g6hp4\") pod \"payload-processing-e2e-explicit-7989d5-df8d468bf-47phc\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") " pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.196975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.196860    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:02.309575 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.309543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:02.474575 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.474552    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"]
Sep 10 22:33:02.476540 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:33:02.476512    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd61f6f82_0e46_4c5b_aa79_dd92fc19ec7b.slice/crio-60844362a80272b4e165667a64467beebf76c788831ea0c3bd818a4c1bbfbb13 WatchSource:0}: Error finding container 60844362a80272b4e165667a64467beebf76c788831ea0c3bd818a4c1bbfbb13: Status 404 returned error can't find the container with id 60844362a80272b4e165667a64467beebf76c788831ea0c3bd818a4c1bbfbb13
Sep 10 22:33:02.594790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:02.594755    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"]
Sep 10 22:33:02.596859 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:33:02.596834    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod275b5cd7_7c0e_4006_b161_1b3982df9e78.slice/crio-512c305e3b3c2a74c6810d7a567183dda6bfe08749b6ff800a930fc63b07e17d WatchSource:0}: Error finding container 512c305e3b3c2a74c6810d7a567183dda6bfe08749b6ff800a930fc63b07e17d: Status 404 returned error can't find the container with id 512c305e3b3c2a74c6810d7a567183dda6bfe08749b6ff800a930fc63b07e17d
Sep 10 22:33:03.253399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.253294    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc" event={"ID":"275b5cd7-7c0e-4006-b161-1b3982df9e78","Type":"ContainerStarted","Data":"bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef"}
Sep 10 22:33:03.253399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.253368    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:03.253399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.253389    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc" event={"ID":"275b5cd7-7c0e-4006-b161-1b3982df9e78","Type":"ContainerStarted","Data":"512c305e3b3c2a74c6810d7a567183dda6bfe08749b6ff800a930fc63b07e17d"}
Sep 10 22:33:03.255041 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.255016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" event={"ID":"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b","Type":"ContainerStarted","Data":"49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58"}
Sep 10 22:33:03.255131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.255063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:03.255131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.255081    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" event={"ID":"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b","Type":"ContainerStarted","Data":"60844362a80272b4e165667a64467beebf76c788831ea0c3bd818a4c1bbfbb13"}
Sep 10 22:33:03.271773 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.271722    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc" podStartSLOduration=2.271704006 podStartE2EDuration="2.271704006s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:33:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:33:03.270369419 +0000 UTC m=+883.681493517" watchObservedRunningTime="2026-09-10 22:33:03.271704006 +0000 UTC m=+883.682828126"
Sep 10 22:33:03.288650 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:03.288573    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" podStartSLOduration=1.794064106 podStartE2EDuration="2.288555236s" totalImagesPullingTime="494.49113ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:33:03.287808592 +0000 UTC m=+883.698932689" watchObservedRunningTime="2026-09-10 22:33:03.288555236 +0000 UTC m=+883.699679333"
Sep 10 22:33:09.266598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:09.266569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:33:14.263770 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:14.263682    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:33:22.367924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:22.367884    2582 generic.go:356] "Generic (PLEG): container finished" podID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerID="9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba" exitCode=0
Sep 10 22:33:22.368376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:22.367939    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" event={"ID":"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374","Type":"ContainerDied","Data":"9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"}
Sep 10 22:33:22.368376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:22.368319    2582 scope.go:117] "RemoveContainer" containerID="9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"
Sep 10 22:33:22.369410 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:22.369373    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:33:22.369535 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:22.369488    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:33:22.369605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:22.369541    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:33:23.375632 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:23.375595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" event={"ID":"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374","Type":"ContainerStarted","Data":"91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398"}
Sep 10 22:33:23.998034 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:23.997988    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:33:23.998256 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:23.998227    2582 patch_prober.go:28] interesting pod/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:33:23.998313 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:23.998289    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 22:33:24.997521 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:24.997485    2582 patch_prober.go:28] interesting pod/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:33:24.998037 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:24.997548    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 22:33:25.998165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:25.998119    2582 patch_prober.go:28] interesting pod/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:33:25.998583 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:25.998186    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 22:33:26.997819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:26.997779    2582 patch_prober.go:28] interesting pod/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:33:26.998007 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:26.997839    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 22:33:27.998181 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:27.998136    2582 patch_prober.go:28] interesting pod/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused" start-of-body=
Sep 10 22:33:27.998615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:27.998212    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": dial tcp 10.134.0.49:15021: connect: connection refused"
Sep 10 22:33:29.001571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:29.001544    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:33:29.002033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:29.001880    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:33:29.002741 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:33:29.002720    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:34:00.856818 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:00.856772    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"]
Sep 10 22:34:00.857298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:00.857039    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" podUID="d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" containerName="maas-api" containerID="cri-o://49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58" gracePeriod=30
Sep 10 22:34:00.916751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:00.916719    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"]
Sep 10 22:34:00.917164 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:00.916960    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc" podUID="275b5cd7-7c0e-4006-b161-1b3982df9e78" containerName="payload-processing" containerID="cri-o://bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef" gracePeriod=30
Sep 10 22:34:01.173766 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.173737    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:34:01.208018 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.207991    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:34:01.302197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302163    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-metrics-certs\") pod \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") "
Sep 10 22:34:01.302398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302213    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvzkm\" (UniqueName: \"kubernetes.io/projected/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-kube-api-access-vvzkm\") pod \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") "
Sep 10 22:34:01.302398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302257    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6hp4\" (UniqueName: \"kubernetes.io/projected/275b5cd7-7c0e-4006-b161-1b3982df9e78-kube-api-access-g6hp4\") pod \"275b5cd7-7c0e-4006-b161-1b3982df9e78\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") "
Sep 10 22:34:01.302398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302345    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-openshift-service-ca\") pod \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") "
Sep 10 22:34:01.302398 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302388    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275b5cd7-7c0e-4006-b161-1b3982df9e78-plugins-config-volume\") pod \"275b5cd7-7c0e-4006-b161-1b3982df9e78\" (UID: \"275b5cd7-7c0e-4006-b161-1b3982df9e78\") "
Sep 10 22:34:01.302608 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302432    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls\") pod \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\" (UID: \"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b\") "
Sep 10 22:34:01.305077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.302916    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" (UID: "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:01.305077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.303372    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/275b5cd7-7c0e-4006-b161-1b3982df9e78-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "275b5cd7-7c0e-4006-b161-1b3982df9e78" (UID: "275b5cd7-7c0e-4006-b161-1b3982df9e78"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:01.305706 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.305677    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" (UID: "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:34:01.305814 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.305744    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" (UID: "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:34:01.306445 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.306424    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-kube-api-access-vvzkm" (OuterVolumeSpecName: "kube-api-access-vvzkm") pod "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" (UID: "d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b"). InnerVolumeSpecName "kube-api-access-vvzkm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:01.306597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.306576    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/275b5cd7-7c0e-4006-b161-1b3982df9e78-kube-api-access-g6hp4" (OuterVolumeSpecName: "kube-api-access-g6hp4") pod "275b5cd7-7c0e-4006-b161-1b3982df9e78" (UID: "275b5cd7-7c0e-4006-b161-1b3982df9e78"). InnerVolumeSpecName "kube-api-access-g6hp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:01.403811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.403727    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.403811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.403754    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/275b5cd7-7c0e-4006-b161-1b3982df9e78-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.403811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.403765    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.403811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.403773    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.403811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.403781    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvzkm\" (UniqueName: \"kubernetes.io/projected/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b-kube-api-access-vvzkm\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.403811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.403789    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6hp4\" (UniqueName: \"kubernetes.io/projected/275b5cd7-7c0e-4006-b161-1b3982df9e78-kube-api-access-g6hp4\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:01.570117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.570078    2582 generic.go:356] "Generic (PLEG): container finished" podID="275b5cd7-7c0e-4006-b161-1b3982df9e78" containerID="bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef" exitCode=0
Sep 10 22:34:01.570285 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.570123    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"
Sep 10 22:34:01.570285 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.570165    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc" event={"ID":"275b5cd7-7c0e-4006-b161-1b3982df9e78","Type":"ContainerDied","Data":"bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef"}
Sep 10 22:34:01.570285 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.570215    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc" event={"ID":"275b5cd7-7c0e-4006-b161-1b3982df9e78","Type":"ContainerDied","Data":"512c305e3b3c2a74c6810d7a567183dda6bfe08749b6ff800a930fc63b07e17d"}
Sep 10 22:34:01.570285 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.570238    2582 scope.go:117] "RemoveContainer" containerID="bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef"
Sep 10 22:34:01.571674 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.571649    2582 generic.go:356] "Generic (PLEG): container finished" podID="d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" containerID="49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58" exitCode=0
Sep 10 22:34:01.571812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.571682    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"
Sep 10 22:34:01.571812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.571728    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" event={"ID":"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b","Type":"ContainerDied","Data":"49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58"}
Sep 10 22:34:01.571812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.571769    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j" event={"ID":"d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b","Type":"ContainerDied","Data":"60844362a80272b4e165667a64467beebf76c788831ea0c3bd818a4c1bbfbb13"}
Sep 10 22:34:01.580724 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.580703    2582 scope.go:117] "RemoveContainer" containerID="bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef"
Sep 10 22:34:01.581022 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:01.580996    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef\": container with ID starting with bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef not found: ID does not exist" containerID="bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef"
Sep 10 22:34:01.581118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.581031    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef"} err="failed to get container status \"bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef\": rpc error: code = NotFound desc = could not find container \"bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef\": container with ID starting with bedc846dd8c1e02317b7f14f8445738dbea233bde35dad1036a6d411849d32ef not found: ID does not exist"
Sep 10 22:34:01.581118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.581047    2582 scope.go:117] "RemoveContainer" containerID="49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58"
Sep 10 22:34:01.589553 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.589530    2582 scope.go:117] "RemoveContainer" containerID="49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58"
Sep 10 22:34:01.589951 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:01.589926    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58\": container with ID starting with 49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58 not found: ID does not exist" containerID="49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58"
Sep 10 22:34:01.589951 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.589960    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58"} err="failed to get container status \"49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58\": rpc error: code = NotFound desc = could not find container \"49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58\": container with ID starting with 49d083f2d7296d07da54f90d93b7075aa5ff7dacb2a6b1f144d794946df13d58 not found: ID does not exist"
Sep 10 22:34:01.591850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.591830    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"]
Sep 10 22:34:01.597114 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.597091    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-7989d5-df8d468bf-47phc"]
Sep 10 22:34:01.607502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.607482    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"]
Sep 10 22:34:01.612228 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:01.612208    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-7989d5-7f8c5b5b5c-4pc9j"]
Sep 10 22:34:02.052408 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:02.052363    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="275b5cd7-7c0e-4006-b161-1b3982df9e78" path="/var/lib/kubelet/pods/275b5cd7-7c0e-4006-b161-1b3982df9e78/volumes"
Sep 10 22:34:02.052996 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:02.052973    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" path="/var/lib/kubelet/pods/d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b/volumes"
Sep 10 22:34:08.832750 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:08.832716    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"]
Sep 10 22:34:08.833194 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:08.832959    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" containerID="cri-o://91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398" gracePeriod=30
Sep 10 22:34:09.566961 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.566907    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"]
Sep 10 22:34:09.569167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.569134    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" containerName="maas-api"
Sep 10 22:34:09.569167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.569166    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" containerName="maas-api"
Sep 10 22:34:09.569356 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.569213    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="275b5cd7-7c0e-4006-b161-1b3982df9e78" containerName="payload-processing"
Sep 10 22:34:09.569356 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.569222    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="275b5cd7-7c0e-4006-b161-1b3982df9e78" containerName="payload-processing"
Sep 10 22:34:09.569459 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.569410    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="275b5cd7-7c0e-4006-b161-1b3982df9e78" containerName="payload-processing"
Sep 10 22:34:09.569459 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.569423    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="d61f6f82-0e46-4c5b-aa79-dd92fc19ec7b" containerName="maas-api"
Sep 10 22:34:09.573219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.573196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.575596 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.575566    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-dfd2f1-openshift-default-dockercfg-cw6m2\""
Sep 10 22:34:09.583787 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.583769    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"]
Sep 10 22:34:09.688381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-envoy\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-data\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688416    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-token\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-podinfo\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688539    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-certs\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf733691-7b7c-4118-a81c-4b105d39b70c-istiod-ca-cert\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688661    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xqzh\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-kube-api-access-6xqzh\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-credential-socket\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.688944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.688821    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-socket\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-envoy\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790132 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790130    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-data\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-token\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790187    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-podinfo\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790226    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-certs\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790250    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf733691-7b7c-4118-a81c-4b105d39b70c-istiod-ca-cert\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790292    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6xqzh\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-kube-api-access-6xqzh\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790368 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790319    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-credential-socket\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790736 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-socket\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790736 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-data\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790736 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790713    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-certs\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.790876 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790803    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-socket\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.791041 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.790956    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-credential-socket\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.791150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.791037    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf733691-7b7c-4118-a81c-4b105d39b70c-istiod-ca-cert\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.792732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.792710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-envoy\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.792826 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.792770    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-podinfo\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.798452 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.798432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-token\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.798798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.798778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xqzh\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-kube-api-access-6xqzh\") pod \"e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") " pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:09.884816 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:09.884726    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:10.165881 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.165857    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"]
Sep 10 22:34:10.168437 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:34:10.168410    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf733691_7b7c_4118_a81c_4b105d39b70c.slice/crio-eda5cf04184fc7c0bff1b2226e07b65d74acb3e1305182a7a3ed49ce89235cfc WatchSource:0}: Error finding container eda5cf04184fc7c0bff1b2226e07b65d74acb3e1305182a7a3ed49ce89235cfc: Status 404 returned error can't find the container with id eda5cf04184fc7c0bff1b2226e07b65d74acb3e1305182a7a3ed49ce89235cfc
Sep 10 22:34:10.170511 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.170475    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:10.170610 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.170545    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:10.170610 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.170576    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:10.619316 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.619280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs" event={"ID":"cf733691-7b7c-4118-a81c-4b105d39b70c","Type":"ContainerStarted","Data":"4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd"}
Sep 10 22:34:10.619493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.619339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs" event={"ID":"cf733691-7b7c-4118-a81c-4b105d39b70c","Type":"ContainerStarted","Data":"eda5cf04184fc7c0bff1b2226e07b65d74acb3e1305182a7a3ed49ce89235cfc"}
Sep 10 22:34:10.885850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:10.885762    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:11.890315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:11.890286    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:11.912613 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:11.912556    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs" podStartSLOduration=2.912536933 podStartE2EDuration="2.912536933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:10.665004966 +0000 UTC m=+951.076129104" watchObservedRunningTime="2026-09-10 22:34:11.912536933 +0000 UTC m=+952.323661030"
Sep 10 22:34:12.629330 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:12.629294    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:12.630262 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:12.630238    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:14.106959 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.106883    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:34:14.235683 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.235592    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lxp7\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-kube-api-access-8lxp7\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.235864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.235707    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-podinfo\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.235864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.235847    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-data\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.235984 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.235970    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-token\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.236045 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236000    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-certs\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.236098 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236051    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-socket\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.236098 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236073    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-data" (OuterVolumeSpecName: "istio-data") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:14.236214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236099    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istiod-ca-cert\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.236214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236144    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-envoy\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.236214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236173    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-credential-socket\") pod \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\" (UID: \"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374\") "
Sep 10 22:34:14.236383 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236230    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:14.236591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236501    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.236591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236525    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.236997 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.236967    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:14.237379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.237342    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:14.237550 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.237526    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:14.238661 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.238562    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:34:14.238661 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.238587    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-kube-api-access-8lxp7" (OuterVolumeSpecName: "kube-api-access-8lxp7") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "kube-api-access-8lxp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:14.238828 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.238687    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-token" (OuterVolumeSpecName: "istio-token") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:14.239733 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.239703    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" (UID: "cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:14.337917 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337881    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.337917 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337909    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.337917 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337920    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lxp7\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-kube-api-access-8lxp7\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.338156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337930    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.338156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337938    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.338156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337947    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.338156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.337955    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:14.639890 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.639849    2582 generic.go:356] "Generic (PLEG): container finished" podID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerID="91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398" exitCode=0
Sep 10 22:34:14.640075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.639905    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"
Sep 10 22:34:14.640075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.639912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" event={"ID":"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374","Type":"ContainerDied","Data":"91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398"}
Sep 10 22:34:14.640075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.639972    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" event={"ID":"cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374","Type":"ContainerDied","Data":"c462f42b2e89d5d00716e550145b45b3d004760365b04bf05dd701227646757a"}
Sep 10 22:34:14.640075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.640000    2582 scope.go:117] "RemoveContainer" containerID="91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398"
Sep 10 22:34:14.650332 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.650315    2582 scope.go:117] "RemoveContainer" containerID="9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"
Sep 10 22:34:14.658143 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.658126    2582 scope.go:117] "RemoveContainer" containerID="91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398"
Sep 10 22:34:14.658422 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:14.658401    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398\": container with ID starting with 91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398 not found: ID does not exist" containerID="91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398"
Sep 10 22:34:14.658468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.658430    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398"} err="failed to get container status \"91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398\": rpc error: code = NotFound desc = could not find container \"91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398\": container with ID starting with 91defe52451c1b6640978ec8f112007da96782df433365776e77ce1ec7570398 not found: ID does not exist"
Sep 10 22:34:14.658468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.658447    2582 scope.go:117] "RemoveContainer" containerID="9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"
Sep 10 22:34:14.658744 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:14.658720    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba\": container with ID starting with 9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba not found: ID does not exist" containerID="9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"
Sep 10 22:34:14.658823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.658755    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba"} err="failed to get container status \"9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba\": rpc error: code = NotFound desc = could not find container \"9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba\": container with ID starting with 9cf9ef9465cfae15e0184c2b063498ade8daec5769a8241653aaf185de723dba not found: ID does not exist"
Sep 10 22:34:14.661809 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.661786    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"]
Sep 10 22:34:14.669754 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:14.669732    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt"]
Sep 10 22:34:15.003291 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:15.003255    2582 patch_prober.go:28] interesting pod/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:34:15.003463 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:15.003329    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-7989d5-openshift-default-74bd6647fb-mdbnt" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.49:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:34:16.052460 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:16.052428    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" path="/var/lib/kubelet/pods/cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374/volumes"
Sep 10 22:34:21.575180 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575146    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"]
Sep 10 22:34:21.575756 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575737    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy"
Sep 10 22:34:21.575756 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575758    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy"
Sep 10 22:34:21.575902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575789    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy"
Sep 10 22:34:21.575902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575798    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy"
Sep 10 22:34:21.575902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575889    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy"
Sep 10 22:34:21.576037 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.575903    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb8e5991-eb5f-4c83-8c0d-d4df5c3ee374" containerName="istio-proxy"
Sep 10 22:34:21.580453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.580433    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.582781 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.582762    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b902065f-openshift-default-dockercfg-s872p\""
Sep 10 22:34:21.590065 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.590041    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"]
Sep 10 22:34:21.610029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.609995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istiod-ca-cert\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610195 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-token\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610195 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610119    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-socket\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610195 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610138    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-podinfo\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610195 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610186    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-envoy\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610442 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610204    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2zm2\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-kube-api-access-c2zm2\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610442 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610259    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-credential-socket\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610442 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-certs\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.610442 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.610315    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-data\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.711713 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-credential-socket\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.711888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-certs\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.711888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-data\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.711888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711818    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istiod-ca-cert\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711891    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-token\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711925    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-socket\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.711950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-podinfo\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.712019    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-envoy\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.712048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2zm2\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-kube-api-access-c2zm2\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712313 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.712161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-credential-socket\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712759 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.712706    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istiod-ca-cert\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712901 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.712887    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-certs\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.712962 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.712929    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-socket\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.713326 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.713304    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-data\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.715457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.715429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-podinfo\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.715915 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.715891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-envoy\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.720584 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.720563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2zm2\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-kube-api-access-c2zm2\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.720751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.720732    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-token\") pod \"e2e-mt-b902065f-openshift-default-cd474c8dd-shrht\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") " pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:21.893276 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:21.893195    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:22.173138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.173108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"]
Sep 10 22:34:22.175058 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:34:22.175030    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod522f43e6_9dd6_4f3c_b0f4_9eddd3ba1cda.slice/crio-300aa974b50cc0bfe8f902d4a94a1eea3af1eb3546374870395e5758edceb9ed WatchSource:0}: Error finding container 300aa974b50cc0bfe8f902d4a94a1eea3af1eb3546374870395e5758edceb9ed: Status 404 returned error can't find the container with id 300aa974b50cc0bfe8f902d4a94a1eea3af1eb3546374870395e5758edceb9ed
Sep 10 22:34:22.177465 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.177428    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:22.177535 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.177519    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:22.177582 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.177567    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:22.692143 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.692089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" event={"ID":"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda","Type":"ContainerStarted","Data":"255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"}
Sep 10 22:34:22.692546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.692166    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" event={"ID":"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda","Type":"ContainerStarted","Data":"300aa974b50cc0bfe8f902d4a94a1eea3af1eb3546374870395e5758edceb9ed"}
Sep 10 22:34:22.714989 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.714924    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podStartSLOduration=1.7149046079999999 podStartE2EDuration="1.714904608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:22.713701143 +0000 UTC m=+963.124825255" watchObservedRunningTime="2026-09-10 22:34:22.714904608 +0000 UTC m=+963.126028707"
Sep 10 22:34:22.893573 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:22.893537    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:23.899297 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:23.899263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:24.702523 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:24.702485    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:24.703510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:24.703488    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:25.871953 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.871920    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"]
Sep 10 22:34:25.875543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.875524    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:25.878456 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.878434    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b902065f-serving-cert\""
Sep 10 22:34:25.885468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.885447    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"]
Sep 10 22:34:25.952678 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.952642    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:25.952837 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.952715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-metrics-certs\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:25.952837 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.952753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-openshift-service-ca\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:25.952837 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:25.952785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnvfj\" (UniqueName: \"kubernetes.io/projected/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-kube-api-access-gnvfj\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.053536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.053502    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.053728 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.053570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-metrics-certs\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.053728 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.053607    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-openshift-service-ca\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.053728 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.053656    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnvfj\" (UniqueName: \"kubernetes.io/projected/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-kube-api-access-gnvfj\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.053728 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:26.053680    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-serving-cert: secret "maas-api-e2e-mt-b902065f-serving-cert" not found
Sep 10 22:34:26.053949 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:26.053751    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls podName:26fd51e0-9866-4c3e-8437-c8da5bfc5b5a nodeName:}" failed. No retries permitted until 2026-09-10 22:34:26.553728544 +0000 UTC m=+966.964852619 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls") pod "maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" (UID: "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a") : secret "maas-api-e2e-mt-b902065f-serving-cert" not found
Sep 10 22:34:26.054294 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.054274    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-openshift-service-ca\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.056348 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.056326    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-metrics-certs\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.062692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.062675    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnvfj\" (UniqueName: \"kubernetes.io/projected/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-kube-api-access-gnvfj\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.559096 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.559058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.561734 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.561697    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls\") pod \"maas-api-e2e-mt-b902065f-78787c77c4-6jt9s\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.620353 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.620316    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"]
Sep 10 22:34:26.624006 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.623982    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.626346 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.626328    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-b902065f-dockercfg-qm5ms\""
Sep 10 22:34:26.626435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.626369    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-b902065f\""
Sep 10 22:34:26.634381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.634356    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"]
Sep 10 22:34:26.660415 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.660382    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ppz8j\" (UniqueName: \"kubernetes.io/projected/c2a3a539-3a05-47ef-841d-451373f81937-kube-api-access-ppz8j\") pod \"payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.660579 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.660469    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a3a539-3a05-47ef-841d-451373f81937-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.761213 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.761166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a3a539-3a05-47ef-841d-451373f81937-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.761422 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.761313    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ppz8j\" (UniqueName: \"kubernetes.io/projected/c2a3a539-3a05-47ef-841d-451373f81937-kube-api-access-ppz8j\") pod \"payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.762020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.761994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a3a539-3a05-47ef-841d-451373f81937-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.769768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.769737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ppz8j\" (UniqueName: \"kubernetes.io/projected/c2a3a539-3a05-47ef-841d-451373f81937-kube-api-access-ppz8j\") pod \"payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:26.788668 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.788608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:26.936316 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:26.936280    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:27.064165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.064132    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"]
Sep 10 22:34:27.064782 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:34:27.064760    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26fd51e0_9866_4c3e_8437_c8da5bfc5b5a.slice/crio-24f8eaf1250955d912619e11c3fd2f8afd7bf378814dbeb24924cfd9ef4f364d WatchSource:0}: Error finding container 24f8eaf1250955d912619e11c3fd2f8afd7bf378814dbeb24924cfd9ef4f364d: Status 404 returned error can't find the container with id 24f8eaf1250955d912619e11c3fd2f8afd7bf378814dbeb24924cfd9ef4f364d
Sep 10 22:34:27.208871 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.208835    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"]
Sep 10 22:34:27.210685 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:34:27.210656    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2a3a539_3a05_47ef_841d_451373f81937.slice/crio-3b1b93f2df150049c88be8b472176f84211669e0c4f14f8ab4c28d6ff2b041d7 WatchSource:0}: Error finding container 3b1b93f2df150049c88be8b472176f84211669e0c4f14f8ab4c28d6ff2b041d7: Status 404 returned error can't find the container with id 3b1b93f2df150049c88be8b472176f84211669e0c4f14f8ab4c28d6ff2b041d7
Sep 10 22:34:27.724030 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.723986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl" event={"ID":"c2a3a539-3a05-47ef-841d-451373f81937","Type":"ContainerStarted","Data":"c1fb1bbd645be396fccac3dce610dbd8559896882818616b8581eecb7a9752e1"}
Sep 10 22:34:27.724236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.724056    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:27.724236 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.724074    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl" event={"ID":"c2a3a539-3a05-47ef-841d-451373f81937","Type":"ContainerStarted","Data":"3b1b93f2df150049c88be8b472176f84211669e0c4f14f8ab4c28d6ff2b041d7"}
Sep 10 22:34:27.725361 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.725339    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" event={"ID":"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a","Type":"ContainerStarted","Data":"24f8eaf1250955d912619e11c3fd2f8afd7bf378814dbeb24924cfd9ef4f364d"}
Sep 10 22:34:27.741211 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:27.741158    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl" podStartSLOduration=1.741143263 podStartE2EDuration="1.741143263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:27.738810833 +0000 UTC m=+968.149934958" watchObservedRunningTime="2026-09-10 22:34:27.741143263 +0000 UTC m=+968.152267359"
Sep 10 22:34:28.731723 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:28.731683    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" event={"ID":"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a","Type":"ContainerStarted","Data":"c552af77a166204a3fbe19984b3199a8e873090ae1f057691a5559083aa52d8a"}
Sep 10 22:34:28.732164 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:28.731961    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:28.748588 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:28.748530    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" podStartSLOduration=3.043922165 podStartE2EDuration="3.748514604s" totalImagesPullingTime="704.592439ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:34:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:34:28.746956832 +0000 UTC m=+969.158080951" watchObservedRunningTime="2026-09-10 22:34:28.748514604 +0000 UTC m=+969.159638701"
Sep 10 22:34:31.140875 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:31.140841    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"]
Sep 10 22:34:31.141390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:31.141059    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs" podUID="cf733691-7b7c-4118-a81c-4b105d39b70c" containerName="istio-proxy" containerID="cri-o://4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd" gracePeriod=30
Sep 10 22:34:34.743229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:34.743203    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:34:36.408029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.407962    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:36.463533 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463502    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xqzh\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-kube-api-access-6xqzh\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf733691-7b7c-4118-a81c-4b105d39b70c-istiod-ca-cert\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463583    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-socket\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463602    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-certs\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463662    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-data\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463696    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-credential-socket\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463725    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-podinfo\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463788    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-envoy\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463862    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-token\") pod \"cf733691-7b7c-4118-a81c-4b105d39b70c\" (UID: \"cf733691-7b7c-4118-a81c-4b105d39b70c\") "
Sep 10 22:34:36.463975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:36.464166 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.463972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-data" (OuterVolumeSpecName: "istio-data") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:36.464166 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464063    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:36.464166 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464075    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cf733691-7b7c-4118-a81c-4b105d39b70c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:36.464338 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464257    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:36.464419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464398    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cf733691-7b7c-4118-a81c-4b105d39b70c-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.464570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464425    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.464570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464438    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.464570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.464451    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.465927 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.465905    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-kube-api-access-6xqzh" (OuterVolumeSpecName: "kube-api-access-6xqzh") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "kube-api-access-6xqzh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:36.466079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.466050    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:34:36.466140 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.466123    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:34:36.466212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.466199    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-token" (OuterVolumeSpecName: "istio-token") pod "cf733691-7b7c-4118-a81c-4b105d39b70c" (UID: "cf733691-7b7c-4118-a81c-4b105d39b70c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:36.565289 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.565252    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.565289 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.565289    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.565490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.565301    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.565490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.565313    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xqzh\" (UniqueName: \"kubernetes.io/projected/cf733691-7b7c-4118-a81c-4b105d39b70c-kube-api-access-6xqzh\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.565490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.565326    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cf733691-7b7c-4118-a81c-4b105d39b70c-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:36.777170 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.777126    2582 generic.go:356] "Generic (PLEG): container finished" podID="cf733691-7b7c-4118-a81c-4b105d39b70c" containerID="4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd" exitCode=0
Sep 10 22:34:36.777170 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.777163    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs" event={"ID":"cf733691-7b7c-4118-a81c-4b105d39b70c","Type":"ContainerDied","Data":"4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd"}
Sep 10 22:34:36.777382 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.777178    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"
Sep 10 22:34:36.777382 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.777221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs" event={"ID":"cf733691-7b7c-4118-a81c-4b105d39b70c","Type":"ContainerDied","Data":"eda5cf04184fc7c0bff1b2226e07b65d74acb3e1305182a7a3ed49ce89235cfc"}
Sep 10 22:34:36.777382 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.777245    2582 scope.go:117] "RemoveContainer" containerID="4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd"
Sep 10 22:34:36.786844 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.786824    2582 scope.go:117] "RemoveContainer" containerID="4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd"
Sep 10 22:34:36.787129 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:36.787113    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd\": container with ID starting with 4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd not found: ID does not exist" containerID="4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd"
Sep 10 22:34:36.787182 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.787137    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd"} err="failed to get container status \"4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd\": rpc error: code = NotFound desc = could not find container \"4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd\": container with ID starting with 4f0b9a2db490a33b5a73f76ea4afae565dbf83feb5a38ed62a88dd3b4a4924cd not found: ID does not exist"
Sep 10 22:34:36.799135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.799107    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"]
Sep 10 22:34:36.802707 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:36.802684    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-dfd2f1-openshift-default-7c5577bdf4-sv7fs"]
Sep 10 22:34:38.057439 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:38.057401    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cf733691-7b7c-4118-a81c-4b105d39b70c" path="/var/lib/kubelet/pods/cf733691-7b7c-4118-a81c-4b105d39b70c/volumes"
Sep 10 22:34:38.734835 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:38.734799    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:34:42.865343 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:42.865292    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"]
Sep 10 22:34:42.865849 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:42.865577    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf" podUID="3412d5aa-29c1-4e9d-8957-42a8351a31a4" containerName="payload-pre-processing" containerID="cri-o://d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8" gracePeriod=30
Sep 10 22:34:43.129543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.129385    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:34:43.239715 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.239679    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3412d5aa-29c1-4e9d-8957-42a8351a31a4-plugins-config-volume\") pod \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") "
Sep 10 22:34:43.239880 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.239820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zdvnz\" (UniqueName: \"kubernetes.io/projected/3412d5aa-29c1-4e9d-8957-42a8351a31a4-kube-api-access-zdvnz\") pod \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\" (UID: \"3412d5aa-29c1-4e9d-8957-42a8351a31a4\") "
Sep 10 22:34:43.240149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.240120    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3412d5aa-29c1-4e9d-8957-42a8351a31a4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3412d5aa-29c1-4e9d-8957-42a8351a31a4" (UID: "3412d5aa-29c1-4e9d-8957-42a8351a31a4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:34:43.242017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.241991    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3412d5aa-29c1-4e9d-8957-42a8351a31a4-kube-api-access-zdvnz" (OuterVolumeSpecName: "kube-api-access-zdvnz") pod "3412d5aa-29c1-4e9d-8957-42a8351a31a4" (UID: "3412d5aa-29c1-4e9d-8957-42a8351a31a4"). InnerVolumeSpecName "kube-api-access-zdvnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:34:43.341199 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.341152    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zdvnz\" (UniqueName: \"kubernetes.io/projected/3412d5aa-29c1-4e9d-8957-42a8351a31a4-kube-api-access-zdvnz\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.341199 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.341198    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3412d5aa-29c1-4e9d-8957-42a8351a31a4-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:34:43.833079 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.833044    2582 generic.go:356] "Generic (PLEG): container finished" podID="3412d5aa-29c1-4e9d-8957-42a8351a31a4" containerID="d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8" exitCode=0
Sep 10 22:34:43.833315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.833109    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"
Sep 10 22:34:43.833315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.833135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf" event={"ID":"3412d5aa-29c1-4e9d-8957-42a8351a31a4","Type":"ContainerDied","Data":"d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8"}
Sep 10 22:34:43.833315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.833192    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf" event={"ID":"3412d5aa-29c1-4e9d-8957-42a8351a31a4","Type":"ContainerDied","Data":"eec1814b7498b12f4571559a8d216f5406f042b9ac054aac2bc895189b8c269b"}
Sep 10 22:34:43.833315 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.833218    2582 scope.go:117] "RemoveContainer" containerID="d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8"
Sep 10 22:34:43.841964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.841945    2582 scope.go:117] "RemoveContainer" containerID="d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8"
Sep 10 22:34:43.842293 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:34:43.842270    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8\": container with ID starting with d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8 not found: ID does not exist" containerID="d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8"
Sep 10 22:34:43.842420 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.842301    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8"} err="failed to get container status \"d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8\": rpc error: code = NotFound desc = could not find container \"d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8\": container with ID starting with d5dcd6793a2970f1f2cf23913d4a43dac9af3f19ed4f3346b11ef80a40fef4c8 not found: ID does not exist"
Sep 10 22:34:43.857986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.857960    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"]
Sep 10 22:34:43.864291 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:43.864267    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-ddf324-7d4cfdff58-7m2bf"]
Sep 10 22:34:44.052614 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:44.052581    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3412d5aa-29c1-4e9d-8957-42a8351a31a4" path="/var/lib/kubelet/pods/3412d5aa-29c1-4e9d-8957-42a8351a31a4/volumes"
Sep 10 22:34:45.845994 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:45.845959    2582 generic.go:356] "Generic (PLEG): container finished" podID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerID="255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a" exitCode=0
Sep 10 22:34:45.846424 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:45.846033    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" event={"ID":"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda","Type":"ContainerDied","Data":"255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"}
Sep 10 22:34:45.846466 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:45.846443    2582 scope.go:117] "RemoveContainer" containerID="255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"
Sep 10 22:34:45.847540 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:45.847511    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:45.847600 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:45.847580    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:45.847650 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:45.847611    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:34:46.853298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:46.853262    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" event={"ID":"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda","Type":"ContainerStarted","Data":"d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e"}
Sep 10 22:34:46.894103 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:46.894063    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:46.894305 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:46.894280    2582 patch_prober.go:28] interesting pod/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 22:34:46.894383 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:46.894350    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 22:34:47.894269 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:47.894235    2582 patch_prober.go:28] interesting pod/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 22:34:47.894695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:47.894291    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 22:34:48.894159 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:48.894121    2582 patch_prober.go:28] interesting pod/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 22:34:48.894347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:48.894179    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 22:34:49.894044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:49.894002    2582 patch_prober.go:28] interesting pod/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 22:34:49.894219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:49.894058    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 22:34:50.893711 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:50.893670    2582 patch_prober.go:28] interesting pod/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 22:34:50.894183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:50.893733    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 22:34:51.894162 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:51.894120    2582 patch_prober.go:28] interesting pod/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused" start-of-body=
Sep 10 22:34:51.894560 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:51.894193    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.53:15021/healthz/ready\": dial tcp 10.134.0.53:15021: connect: connection refused"
Sep 10 22:34:52.897785 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:52.897756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:52.898210 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:52.898055    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:52.898746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:52.898728    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:34:59.347026 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:59.346995    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"]
Sep 10 22:34:59.347464 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:34:59.347210    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy" containerID="cri-o://0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8" gracePeriod=30
Sep 10 22:35:04.592033 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.592004    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:35:04.750897 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.750866    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b58565-b77e-4f23-b4b0-00fc1e480820-istiod-ca-cert\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.750916    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-podinfo\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.750955    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-token\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.750995    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-data\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-certs\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751079    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8bqf\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-kube-api-access-n8bqf\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751337 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751117    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-envoy\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751337 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751204    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-credential-socket\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751337 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751237    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-socket\") pod \"b2b58565-b77e-4f23-b4b0-00fc1e480820\" (UID: \"b2b58565-b77e-4f23-b4b0-00fc1e480820\") "
Sep 10 22:35:04.751506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751372    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:04.751506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751395    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:04.751506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751411    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2b58565-b77e-4f23-b4b0-00fc1e480820-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:04.751732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751580    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:04.751732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751594    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:04.751732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751697    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2b58565-b77e-4f23-b4b0-00fc1e480820-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.751732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751715    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.751732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751732    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.752050 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751748    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.752050 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.751762    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.753358 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.753332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:35:04.753520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.753504    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-kube-api-access-n8bqf" (OuterVolumeSpecName: "kube-api-access-n8bqf") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "kube-api-access-n8bqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:04.753590 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.753532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:04.753590 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.753532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2b58565-b77e-4f23-b4b0-00fc1e480820" (UID: "b2b58565-b77e-4f23-b4b0-00fc1e480820"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:04.852243 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.852205    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8bqf\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-kube-api-access-n8bqf\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.852243 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.852232    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.852243 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.852242    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.852243 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.852250    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2b58565-b77e-4f23-b4b0-00fc1e480820-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:04.942219 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.942186    2582 generic.go:356] "Generic (PLEG): container finished" podID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerID="0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8" exitCode=0
Sep 10 22:35:04.942419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.942232    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"
Sep 10 22:35:04.942419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.942276    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" event={"ID":"b2b58565-b77e-4f23-b4b0-00fc1e480820","Type":"ContainerDied","Data":"0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8"}
Sep 10 22:35:04.942419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.942336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474" event={"ID":"b2b58565-b77e-4f23-b4b0-00fc1e480820","Type":"ContainerDied","Data":"cde944c9afc45cc6e505f4dc1f09a308534ef228bc7b3ed48bc75d2a3c51beb5"}
Sep 10 22:35:04.942419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.942365    2582 scope.go:117] "RemoveContainer" containerID="0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8"
Sep 10 22:35:04.951815 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.951800    2582 scope.go:117] "RemoveContainer" containerID="1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"
Sep 10 22:35:04.960119 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.960101    2582 scope.go:117] "RemoveContainer" containerID="0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8"
Sep 10 22:35:04.960396 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:04.960380    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8\": container with ID starting with 0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8 not found: ID does not exist" containerID="0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8"
Sep 10 22:35:04.960440 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.960405    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8"} err="failed to get container status \"0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8\": rpc error: code = NotFound desc = could not find container \"0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8\": container with ID starting with 0bde47b8c66e2d58656f5bea405bf9398f2a83ce6f419109cdb312fe3a882ca8 not found: ID does not exist"
Sep 10 22:35:04.960440 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.960422    2582 scope.go:117] "RemoveContainer" containerID="1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"
Sep 10 22:35:04.960896 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:04.960874    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43\": container with ID starting with 1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43 not found: ID does not exist" containerID="1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"
Sep 10 22:35:04.961049 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.960899    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43"} err="failed to get container status \"1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43\": rpc error: code = NotFound desc = could not find container \"1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43\": container with ID starting with 1a7346d37e914bc57bbe66f064232f7d5d442806522acc51926340d0a8d75e43 not found: ID does not exist"
Sep 10 22:35:04.963184 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.963162    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"]
Sep 10 22:35:04.967581 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:04.967561    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-ddf324-openshift-default-7b5c898f9b-ln474"]
Sep 10 22:35:06.051929 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:06.051886    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" path="/var/lib/kubelet/pods/b2b58565-b77e-4f23-b4b0-00fc1e480820/volumes"
Sep 10 22:35:10.239657 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.239602    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"]
Sep 10 22:35:10.240081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.239973    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv" podUID="f81a328a-21a0-4c1d-842b-76b6ebc8c823" containerName="payload-processing" containerID="cri-o://a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946" gracePeriod=30
Sep 10 22:35:10.493557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.493483    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:35:10.503894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.503043    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81a328a-21a0-4c1d-842b-76b6ebc8c823-plugins-config-volume\") pod \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") "
Sep 10 22:35:10.503894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.503133    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvlhb\" (UniqueName: \"kubernetes.io/projected/f81a328a-21a0-4c1d-842b-76b6ebc8c823-kube-api-access-xvlhb\") pod \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\" (UID: \"f81a328a-21a0-4c1d-842b-76b6ebc8c823\") "
Sep 10 22:35:10.504507 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.504472    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f81a328a-21a0-4c1d-842b-76b6ebc8c823-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f81a328a-21a0-4c1d-842b-76b6ebc8c823" (UID: "f81a328a-21a0-4c1d-842b-76b6ebc8c823"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:10.506496 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.506456    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f81a328a-21a0-4c1d-842b-76b6ebc8c823-kube-api-access-xvlhb" (OuterVolumeSpecName: "kube-api-access-xvlhb") pod "f81a328a-21a0-4c1d-842b-76b6ebc8c823" (UID: "f81a328a-21a0-4c1d-842b-76b6ebc8c823"). InnerVolumeSpecName "kube-api-access-xvlhb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:10.604369 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.604325    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f81a328a-21a0-4c1d-842b-76b6ebc8c823-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:10.604369 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.604361    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvlhb\" (UniqueName: \"kubernetes.io/projected/f81a328a-21a0-4c1d-842b-76b6ebc8c823-kube-api-access-xvlhb\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:10.980185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.980148    2582 generic.go:356] "Generic (PLEG): container finished" podID="f81a328a-21a0-4c1d-842b-76b6ebc8c823" containerID="a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946" exitCode=0
Sep 10 22:35:10.980372 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.980214    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"
Sep 10 22:35:10.980372 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.980223    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv" event={"ID":"f81a328a-21a0-4c1d-842b-76b6ebc8c823","Type":"ContainerDied","Data":"a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946"}
Sep 10 22:35:10.980372 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.980309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv" event={"ID":"f81a328a-21a0-4c1d-842b-76b6ebc8c823","Type":"ContainerDied","Data":"744e2a9b1af7f4079f75c148ab16cc94ae851d4dc7a997e01bd8b2a118a6385c"}
Sep 10 22:35:10.980372 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.980339    2582 scope.go:117] "RemoveContainer" containerID="a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946"
Sep 10 22:35:10.990066 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.990050    2582 scope.go:117] "RemoveContainer" containerID="a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946"
Sep 10 22:35:10.990328 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:10.990305    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946\": container with ID starting with a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946 not found: ID does not exist" containerID="a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946"
Sep 10 22:35:10.990392 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:10.990340    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946"} err="failed to get container status \"a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946\": rpc error: code = NotFound desc = could not find container \"a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946\": container with ID starting with a14afd4d003247d172861a7b9ce650bd74311dd3422bc19a7c4748f49d129946 not found: ID does not exist"
Sep 10 22:35:11.001540 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:11.001511    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"]
Sep 10 22:35:11.007730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:11.007703    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d1a134-7f9c56c8f5-hswxv"]
Sep 10 22:35:12.052535 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:12.052497    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f81a328a-21a0-4c1d-842b-76b6ebc8c823" path="/var/lib/kubelet/pods/f81a328a-21a0-4c1d-842b-76b6ebc8c823/volumes"
Sep 10 22:35:16.996313 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:16.996278    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"]
Sep 10 22:35:16.996862 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:16.996538    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy" containerID="cri-o://053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91" gracePeriod=30
Sep 10 22:35:21.797279 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.797235    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"]
Sep 10 22:35:21.798085 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798062    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798088    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798117    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3412d5aa-29c1-4e9d-8957-42a8351a31a4" containerName="payload-pre-processing"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798126    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3412d5aa-29c1-4e9d-8957-42a8351a31a4" containerName="payload-pre-processing"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798135    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798143    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798152    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f81a328a-21a0-4c1d-842b-76b6ebc8c823" containerName="payload-processing"
Sep 10 22:35:21.798183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798166    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f81a328a-21a0-4c1d-842b-76b6ebc8c823" containerName="payload-processing"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798191    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cf733691-7b7c-4118-a81c-4b105d39b70c" containerName="istio-proxy"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798200    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cf733691-7b7c-4118-a81c-4b105d39b70c" containerName="istio-proxy"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798369    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cf733691-7b7c-4118-a81c-4b105d39b70c" containerName="istio-proxy"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798387    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f81a328a-21a0-4c1d-842b-76b6ebc8c823" containerName="payload-processing"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798398    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798407    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3412d5aa-29c1-4e9d-8957-42a8351a31a4" containerName="payload-pre-processing"
Sep 10 22:35:21.798487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.798423    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2b58565-b77e-4f23-b4b0-00fc1e480820" containerName="istio-proxy"
Sep 10 22:35:21.804505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.804482    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:21.806790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.806767    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-58cd39-serving-cert\""
Sep 10 22:35:21.815468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.815438    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"]
Sep 10 22:35:21.909500 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.909431    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a542758c-316c-4692-8063-66fe40cfe3bf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:21.910147 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.910099    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtwhr\" (UniqueName: \"kubernetes.io/projected/a542758c-316c-4692-8063-66fe40cfe3bf-kube-api-access-rtwhr\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:21.910781 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.910569    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:21.911124 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:21.911051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.012437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.012407    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a542758c-316c-4692-8063-66fe40cfe3bf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.012566 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.012475    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtwhr\" (UniqueName: \"kubernetes.io/projected/a542758c-316c-4692-8063-66fe40cfe3bf-kube-api-access-rtwhr\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.012566 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.012510    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.012689 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.012667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.013278 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.013191    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a542758c-316c-4692-8063-66fe40cfe3bf-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.015004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.014966    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.015094 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.015045    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.021051 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.021021    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtwhr\" (UniqueName: \"kubernetes.io/projected/a542758c-316c-4692-8063-66fe40cfe3bf-kube-api-access-rtwhr\") pod \"maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.117906 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.117879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:22.280113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.280030    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:35:22.399550 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.399527    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"]
Sep 10 22:35:22.402141 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:22.402112    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda542758c_316c_4692_8063_66fe40cfe3bf.slice/crio-84f8ebdea0d73662f37096daf740dc27c94bf3ebee4ffdb0030d3b3fc8bcd844 WatchSource:0}: Error finding container 84f8ebdea0d73662f37096daf740dc27c94bf3ebee4ffdb0030d3b3fc8bcd844: Status 404 returned error can't find the container with id 84f8ebdea0d73662f37096daf740dc27c94bf3ebee4ffdb0030d3b3fc8bcd844
Sep 10 22:35:22.403656 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.403606    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:35:22.416649 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416616    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-envoy\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.416769 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416660    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-credential-socket\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.416769 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416698    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac99625-c1b8-45a9-8201-5774d10a1922-istiod-ca-cert\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.416769 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416725    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-socket\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.416925 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416774    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-token\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.416925 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416898    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56v9s\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-kube-api-access-56v9s\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.417025 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.416949    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.417150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417022    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-certs\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.417150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417032    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.417150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417121    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-podinfo\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.417294 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417159    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-data\") pod \"0ac99625-c1b8-45a9-8201-5774d10a1922\" (UID: \"0ac99625-c1b8-45a9-8201-5774d10a1922\") "
Sep 10 22:35:22.417379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417286    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.417379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417337    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0ac99625-c1b8-45a9-8201-5774d10a1922-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:22.417646 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417487    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-data" (OuterVolumeSpecName: "istio-data") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.417710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417649    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.417710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417671    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.417710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417682    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.417710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417693    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0ac99625-c1b8-45a9-8201-5774d10a1922-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.417710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.417706    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.419113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.419083    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-token" (OuterVolumeSpecName: "istio-token") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:22.419202 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.419172    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:22.419293 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.419272    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-kube-api-access-56v9s" (OuterVolumeSpecName: "kube-api-access-56v9s") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "kube-api-access-56v9s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:22.419637 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.419599    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0ac99625-c1b8-45a9-8201-5774d10a1922" (UID: "0ac99625-c1b8-45a9-8201-5774d10a1922"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:35:22.518005 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.517966    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"]
Sep 10 22:35:22.518468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518447    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.518520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518475    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.518520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518488    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.518520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518500    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56v9s\" (UniqueName: \"kubernetes.io/projected/0ac99625-c1b8-45a9-8201-5774d10a1922-kube-api-access-56v9s\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:22.518520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518501    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy"
Sep 10 22:35:22.518520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518517    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy"
Sep 10 22:35:22.518700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518595    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy"
Sep 10 22:35:22.518700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.518604    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy"
Sep 10 22:35:22.523003 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.522965    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.525149 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.525124    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-58cd39\""
Sep 10 22:35:22.533574 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.533550    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"]
Sep 10 22:35:22.547903 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.547878    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"]
Sep 10 22:35:22.548275 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.548257    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy"
Sep 10 22:35:22.548275 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.548275    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerName="istio-proxy"
Sep 10 22:35:22.551377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.551355    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.553611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.553593    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-58cd39-dockercfg-f4jjp\""
Sep 10 22:35:22.560897 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.560876    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"]
Sep 10 22:35:22.619198 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.619164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.619387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.619220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5h6n\" (UniqueName: \"kubernetes.io/projected/85f675a9-f57c-4520-84c8-95749de171f0-kube-api-access-w5h6n\") pod \"payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.619387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.619295    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8www\" (UniqueName: \"kubernetes.io/projected/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-kube-api-access-m8www\") pod \"payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.619387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.619346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f675a9-f57c-4520-84c8-95749de171f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.701930 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.701833    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"]
Sep 10 22:35:22.702102 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.702057    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" podUID="26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" containerName="maas-api" containerID="cri-o://c552af77a166204a3fbe19984b3199a8e873090ae1f057691a5559083aa52d8a" gracePeriod=30
Sep 10 22:35:22.720743 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.720704    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5h6n\" (UniqueName: \"kubernetes.io/projected/85f675a9-f57c-4520-84c8-95749de171f0-kube-api-access-w5h6n\") pod \"payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.720900 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.720764    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8www\" (UniqueName: \"kubernetes.io/projected/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-kube-api-access-m8www\") pod \"payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.720900 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.720804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f675a9-f57c-4520-84c8-95749de171f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.720900 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.720883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.721539 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.721515    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.721732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.721710    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f675a9-f57c-4520-84c8-95749de171f0-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.731576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.731544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5h6n\" (UniqueName: \"kubernetes.io/projected/85f675a9-f57c-4520-84c8-95749de171f0-kube-api-access-w5h6n\") pod \"payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.731705 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.731544    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8www\" (UniqueName: \"kubernetes.io/projected/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-kube-api-access-m8www\") pod \"payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:22.777031 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.776826    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"]
Sep 10 22:35:22.777209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.777068    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl" podUID="c2a3a539-3a05-47ef-841d-451373f81937" containerName="payload-pre-processing" containerID="cri-o://c1fb1bbd645be396fccac3dce610dbd8559896882818616b8581eecb7a9752e1" gracePeriod=30
Sep 10 22:35:22.834796 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.834762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:22.863128 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:22.863105    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:23.050484 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.048126    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96" event={"ID":"a542758c-316c-4692-8063-66fe40cfe3bf","Type":"ContainerStarted","Data":"fa44116faeb5831126a47e8385fa5538a0ee50443cf605a1ca613cdda7bf6d8e"}
Sep 10 22:35:23.050484 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.048185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96" event={"ID":"a542758c-316c-4692-8063-66fe40cfe3bf","Type":"ContainerStarted","Data":"84f8ebdea0d73662f37096daf740dc27c94bf3ebee4ffdb0030d3b3fc8bcd844"}
Sep 10 22:35:23.050484 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.048970    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:23.051044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.051006    2582 generic.go:356] "Generic (PLEG): container finished" podID="0ac99625-c1b8-45a9-8201-5774d10a1922" containerID="053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91" exitCode=0
Sep 10 22:35:23.051170 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.051138    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"
Sep 10 22:35:23.051566 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.051298    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" event={"ID":"0ac99625-c1b8-45a9-8201-5774d10a1922","Type":"ContainerDied","Data":"053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91"}
Sep 10 22:35:23.051566 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.051368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn" event={"ID":"0ac99625-c1b8-45a9-8201-5774d10a1922","Type":"ContainerDied","Data":"32e4042b25b6fa1a7d9d65beea2acdbc240402808d356d0d66e2c1c028f86d28"}
Sep 10 22:35:23.051566 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.051402    2582 scope.go:117] "RemoveContainer" containerID="053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91"
Sep 10 22:35:23.058244 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.056892    2582 generic.go:356] "Generic (PLEG): container finished" podID="26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" containerID="c552af77a166204a3fbe19984b3199a8e873090ae1f057691a5559083aa52d8a" exitCode=0
Sep 10 22:35:23.058244 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.057025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" event={"ID":"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a","Type":"ContainerDied","Data":"c552af77a166204a3fbe19984b3199a8e873090ae1f057691a5559083aa52d8a"}
Sep 10 22:35:23.060615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.060509    2582 generic.go:356] "Generic (PLEG): container finished" podID="c2a3a539-3a05-47ef-841d-451373f81937" containerID="c1fb1bbd645be396fccac3dce610dbd8559896882818616b8581eecb7a9752e1" exitCode=0
Sep 10 22:35:23.060615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.060553    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl" event={"ID":"c2a3a539-3a05-47ef-841d-451373f81937","Type":"ContainerDied","Data":"c1fb1bbd645be396fccac3dce610dbd8559896882818616b8581eecb7a9752e1"}
Sep 10 22:35:23.087928 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.087883    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96" podStartSLOduration=1.643026256 podStartE2EDuration="2.087864019s" totalImagesPullingTime="444.837763ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:23.072412918 +0000 UTC m=+1023.483537007" watchObservedRunningTime="2026-09-10 22:35:23.087864019 +0000 UTC m=+1023.498988116"
Sep 10 22:35:23.089353 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.089329    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"]
Sep 10 22:35:23.096269 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.096241    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-d1a134-openshift-default-5f6bcb6596-xnjrn"]
Sep 10 22:35:23.096834 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.096729    2582 scope.go:117] "RemoveContainer" containerID="86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"
Sep 10 22:35:23.114931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.114724    2582 scope.go:117] "RemoveContainer" containerID="053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91"
Sep 10 22:35:23.115110 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:23.115082    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91\": container with ID starting with 053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91 not found: ID does not exist" containerID="053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91"
Sep 10 22:35:23.115214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.115122    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91"} err="failed to get container status \"053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91\": rpc error: code = NotFound desc = could not find container \"053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91\": container with ID starting with 053adc0c12bf6657da9740993bfcb80b0426c3273b4cf3dc2b72eb360776cb91 not found: ID does not exist"
Sep 10 22:35:23.115214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.115149    2582 scope.go:117] "RemoveContainer" containerID="86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"
Sep 10 22:35:23.115458 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:23.115439    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000\": container with ID starting with 86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000 not found: ID does not exist" containerID="86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"
Sep 10 22:35:23.115515 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.115471    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000"} err="failed to get container status \"86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000\": rpc error: code = NotFound desc = could not find container \"86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000\": container with ID starting with 86110cc1d4af54512b0a45c0bbec8fbb55aa15a4a6b85c4db8c7ff4d76a94000 not found: ID does not exist"
Sep 10 22:35:23.119268 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.119247    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:35:23.121662 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.121647    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:35:23.129232 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.129204    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"]
Sep 10 22:35:23.132402 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:23.132379    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f675a9_f57c_4520_84c8_95749de171f0.slice/crio-d77e7c036d98b544e3dc19bf339074ab11092c3e51af5d602537beac614039ad WatchSource:0}: Error finding container d77e7c036d98b544e3dc19bf339074ab11092c3e51af5d602537beac614039ad: Status 404 returned error can't find the container with id d77e7c036d98b544e3dc19bf339074ab11092c3e51af5d602537beac614039ad
Sep 10 22:35:23.176367 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.176301    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"]
Sep 10 22:35:23.180763 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:23.180735    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59ae1a9b_0aad_4055_a6d7_55f6db3fe679.slice/crio-8ec8364cb1eea252b85d0320705bbf7d79d9916e3359c6d95e446e928947ad40 WatchSource:0}: Error finding container 8ec8364cb1eea252b85d0320705bbf7d79d9916e3359c6d95e446e928947ad40: Status 404 returned error can't find the container with id 8ec8364cb1eea252b85d0320705bbf7d79d9916e3359c6d95e446e928947ad40
Sep 10 22:35:23.227894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.227870    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gnvfj\" (UniqueName: \"kubernetes.io/projected/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-kube-api-access-gnvfj\") pod \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") "
Sep 10 22:35:23.228060 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.227943    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls\") pod \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") "
Sep 10 22:35:23.228060 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.227967    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a3a539-3a05-47ef-841d-451373f81937-plugins-config-volume\") pod \"c2a3a539-3a05-47ef-841d-451373f81937\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") "
Sep 10 22:35:23.228060 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.228019    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-metrics-certs\") pod \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") "
Sep 10 22:35:23.228060 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.228035    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ppz8j\" (UniqueName: \"kubernetes.io/projected/c2a3a539-3a05-47ef-841d-451373f81937-kube-api-access-ppz8j\") pod \"c2a3a539-3a05-47ef-841d-451373f81937\" (UID: \"c2a3a539-3a05-47ef-841d-451373f81937\") "
Sep 10 22:35:23.228894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.228064    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-openshift-service-ca\") pod \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\" (UID: \"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a\") "
Sep 10 22:35:23.228894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.228317    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2a3a539-3a05-47ef-841d-451373f81937-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c2a3a539-3a05-47ef-841d-451373f81937" (UID: "c2a3a539-3a05-47ef-841d-451373f81937"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:23.228894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.228481    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c2a3a539-3a05-47ef-841d-451373f81937-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.228894 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.228804    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" (UID: "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:23.230568 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.230530    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2a3a539-3a05-47ef-841d-451373f81937-kube-api-access-ppz8j" (OuterVolumeSpecName: "kube-api-access-ppz8j") pod "c2a3a539-3a05-47ef-841d-451373f81937" (UID: "c2a3a539-3a05-47ef-841d-451373f81937"). InnerVolumeSpecName "kube-api-access-ppz8j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:23.230568 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.230549    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" (UID: "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:35:23.230781 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.230572    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-kube-api-access-gnvfj" (OuterVolumeSpecName: "kube-api-access-gnvfj") pod "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" (UID: "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a"). InnerVolumeSpecName "kube-api-access-gnvfj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:23.231131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.231111    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" (UID: "26fd51e0-9866-4c3e-8437-c8da5bfc5b5a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:35:23.329516 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.329489    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gnvfj\" (UniqueName: \"kubernetes.io/projected/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-kube-api-access-gnvfj\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.329516 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.329515    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.329732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.329528    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.329732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.329540    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ppz8j\" (UniqueName: \"kubernetes.io/projected/c2a3a539-3a05-47ef-841d-451373f81937-kube-api-access-ppz8j\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:23.329732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:23.329551    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:24.053059 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.053012    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac99625-c1b8-45a9-8201-5774d10a1922" path="/var/lib/kubelet/pods/0ac99625-c1b8-45a9-8201-5774d10a1922/volumes"
Sep 10 22:35:24.068401 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.068374    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"
Sep 10 22:35:24.068524 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.068399    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s" event={"ID":"26fd51e0-9866-4c3e-8437-c8da5bfc5b5a","Type":"ContainerDied","Data":"24f8eaf1250955d912619e11c3fd2f8afd7bf378814dbeb24924cfd9ef4f364d"}
Sep 10 22:35:24.068524 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.068464    2582 scope.go:117] "RemoveContainer" containerID="c552af77a166204a3fbe19984b3199a8e873090ae1f057691a5559083aa52d8a"
Sep 10 22:35:24.070156 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.070136    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"
Sep 10 22:35:24.070300 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.070280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl" event={"ID":"c2a3a539-3a05-47ef-841d-451373f81937","Type":"ContainerDied","Data":"3b1b93f2df150049c88be8b472176f84211669e0c4f14f8ab4c28d6ff2b041d7"}
Sep 10 22:35:24.072148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.072119    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4" event={"ID":"59ae1a9b-0aad-4055-a6d7-55f6db3fe679","Type":"ContainerStarted","Data":"85d268b79aa488bb02b4947d5ce12d3805fcf5c1b024e15ac0de83abee8011c8"}
Sep 10 22:35:24.072303 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.072285    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:24.072762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.072739    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4" event={"ID":"59ae1a9b-0aad-4055-a6d7-55f6db3fe679","Type":"ContainerStarted","Data":"8ec8364cb1eea252b85d0320705bbf7d79d9916e3359c6d95e446e928947ad40"}
Sep 10 22:35:24.081751 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.081717    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr" event={"ID":"85f675a9-f57c-4520-84c8-95749de171f0","Type":"ContainerStarted","Data":"36cb2280eb57eab85ab0e6f9f82499a2cc51dcf0b3337b25f8643fb6504af0de"}
Sep 10 22:35:24.081911 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.081824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr" event={"ID":"85f675a9-f57c-4520-84c8-95749de171f0","Type":"ContainerStarted","Data":"d77e7c036d98b544e3dc19bf339074ab11092c3e51af5d602537beac614039ad"}
Sep 10 22:35:24.082211 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.082188    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:24.090202 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.090182    2582 scope.go:117] "RemoveContainer" containerID="c1fb1bbd645be396fccac3dce610dbd8559896882818616b8581eecb7a9752e1"
Sep 10 22:35:24.099336 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.099294    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr" podStartSLOduration=2.099279182 podStartE2EDuration="2.099279182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:24.097955261 +0000 UTC m=+1024.509079378" watchObservedRunningTime="2026-09-10 22:35:24.099279182 +0000 UTC m=+1024.510403279"
Sep 10 22:35:24.116571 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.116538    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"]
Sep 10 22:35:24.121392 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.121362    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b902065f-78787c77c4-6jt9s"]
Sep 10 22:35:24.135188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.135135    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4" podStartSLOduration=2.135118933 podStartE2EDuration="2.135118933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:24.133757309 +0000 UTC m=+1024.544881431" watchObservedRunningTime="2026-09-10 22:35:24.135118933 +0000 UTC m=+1024.546243061"
Sep 10 22:35:24.155747 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.155715    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"]
Sep 10 22:35:24.159186 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:24.159157    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-b902065f-597876cd4b-269pl"]
Sep 10 22:35:26.052864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:26.052822    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" path="/var/lib/kubelet/pods/26fd51e0-9866-4c3e-8437-c8da5bfc5b5a/volumes"
Sep 10 22:35:26.053344 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:26.053325    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2a3a539-3a05-47ef-841d-451373f81937" path="/var/lib/kubelet/pods/c2a3a539-3a05-47ef-841d-451373f81937/volumes"
Sep 10 22:35:29.361083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:29.361045    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"]
Sep 10 22:35:29.361502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:29.361266    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy" containerID="cri-o://d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e" gracePeriod=30
Sep 10 22:35:30.094950 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:30.094912    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:35:34.606808 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.606782    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:35:34.739964 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.739932    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-data\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.739974    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-credential-socket\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-certs\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740027    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2zm2\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-kube-api-access-c2zm2\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740053    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-token\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740077    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istiod-ca-cert\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740107    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-envoy\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740169    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-socket\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740517 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740273    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-podinfo\") pod \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\" (UID: \"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda\") "
Sep 10 22:35:34.740517 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740275    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-data" (OuterVolumeSpecName: "istio-data") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:34.740517 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740304    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:34.740517 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740320    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:34.740517 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740474    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:34.740766 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740572    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.740766 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740590    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.740766 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740606    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.740766 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.740615    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:35:34.742534 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.742512    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:35:34.742666 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.742642    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-token" (OuterVolumeSpecName: "istio-token") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:34.742924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.742898    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-kube-api-access-c2zm2" (OuterVolumeSpecName: "kube-api-access-c2zm2") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "kube-api-access-c2zm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:35:34.742924 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.742912    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" (UID: "522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:35:34.841823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.841782    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.841823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.841817    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2zm2\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-kube-api-access-c2zm2\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.841823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.841827    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.841823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.841835    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.842078 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.841843    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:34.842078 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:34.841850    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:35:35.092733 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.092656    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:35:35.092878 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.092785    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:35:35.139939 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.139907    2582 generic.go:356] "Generic (PLEG): container finished" podID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerID="d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e" exitCode=0
Sep 10 22:35:35.140148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.139955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" event={"ID":"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda","Type":"ContainerDied","Data":"d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e"}
Sep 10 22:35:35.140148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.139968    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"
Sep 10 22:35:35.140148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.140010    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht" event={"ID":"522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda","Type":"ContainerDied","Data":"300aa974b50cc0bfe8f902d4a94a1eea3af1eb3546374870395e5758edceb9ed"}
Sep 10 22:35:35.140148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.140039    2582 scope.go:117] "RemoveContainer" containerID="d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e"
Sep 10 22:35:35.151163 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.151141    2582 scope.go:117] "RemoveContainer" containerID="255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"
Sep 10 22:35:35.159899 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.159876    2582 scope.go:117] "RemoveContainer" containerID="d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e"
Sep 10 22:35:35.160238 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:35.160216    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e\": container with ID starting with d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e not found: ID does not exist" containerID="d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e"
Sep 10 22:35:35.160296 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.160249    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e"} err="failed to get container status \"d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e\": rpc error: code = NotFound desc = could not find container \"d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e\": container with ID starting with d8b85b4e720fd5474761b3e30c94e9da7d050314d44a00e4c52772fc5630f59e not found: ID does not exist"
Sep 10 22:35:35.160296 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.160267    2582 scope.go:117] "RemoveContainer" containerID="255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"
Sep 10 22:35:35.160532 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:35:35.160515    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a\": container with ID starting with 255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a not found: ID does not exist" containerID="255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"
Sep 10 22:35:35.160614 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.160536    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a"} err="failed to get container status \"255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a\": rpc error: code = NotFound desc = could not find container \"255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a\": container with ID starting with 255e419fbc1752c06463ac192e7c46871443c1264838e45eb7b8a0bf72d9a71a not found: ID does not exist"
Sep 10 22:35:35.163312 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.163284    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"]
Sep 10 22:35:35.167118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:35.167093    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b902065f-openshift-default-cd474c8dd-shrht"]
Sep 10 22:35:36.051641 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:36.051586    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" path="/var/lib/kubelet/pods/522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda/volumes"
Sep 10 22:35:42.909338 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.909303    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"]
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910265    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" containerName="maas-api"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910290    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" containerName="maas-api"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910388    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2a3a539-3a05-47ef-841d-451373f81937" containerName="payload-pre-processing"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910414    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2a3a539-3a05-47ef-841d-451373f81937" containerName="payload-pre-processing"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910506    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910516    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910540    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910549    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910840    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910854    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="26fd51e0-9866-4c3e-8437-c8da5bfc5b5a" containerName="maas-api"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910880    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="522f43e6-9dd6-4f3c-b0f4-9eddd3ba1cda" containerName="istio-proxy"
Sep 10 22:35:42.917477 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.910888    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2a3a539-3a05-47ef-841d-451373f81937" containerName="payload-pre-processing"
Sep 10 22:35:42.921402 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.921377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:42.924309 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.924271    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-7a7e94-openshift-default-dockercfg-ljwsv\""
Sep 10 22:35:42.926154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:42.926127    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"]
Sep 10 22:35:43.120363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120321    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-certs\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120532 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120390    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-data\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120532 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-credential-socket\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120532 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120444    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-envoy\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120535    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-podinfo\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flq94\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-kube-api-access-flq94\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-socket\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120719    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00450bcf-beac-4a10-9697-638f67fbd4f4-istiod-ca-cert\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.120762 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.120761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-token\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.221997 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.221968    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-data\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222157 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-credential-socket\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222157 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-envoy\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222157 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-podinfo\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222157 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222111    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flq94\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-kube-api-access-flq94\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222157 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222149    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-socket\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222169    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00450bcf-beac-4a10-9697-638f67fbd4f4-istiod-ca-cert\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-token\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222245    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-certs\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-data\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-credential-socket\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222807 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222778    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-socket\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.222882 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.222850    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-certs\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.223040 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.223023    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00450bcf-beac-4a10-9697-638f67fbd4f4-istiod-ca-cert\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.224795 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.224773    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-podinfo\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.224902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.224839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-envoy\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.230187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.230164    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flq94\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-kube-api-access-flq94\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.230551 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.230535    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-token\") pod \"e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") " pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.233537 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.233515    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:43.514574 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.514549    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"]
Sep 10 22:35:43.517325 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:43.517291    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00450bcf_beac_4a10_9697_638f67fbd4f4.slice/crio-12851875f88868969d16f58191c7bb3a92713655569e456d7aeddf9dbbeaf9d4 WatchSource:0}: Error finding container 12851875f88868969d16f58191c7bb3a92713655569e456d7aeddf9dbbeaf9d4: Status 404 returned error can't find the container with id 12851875f88868969d16f58191c7bb3a92713655569e456d7aeddf9dbbeaf9d4
Sep 10 22:35:43.519676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.519590    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:35:43.519774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.519741    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:35:43.519840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:43.519791    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:35:44.186386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:44.186351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" event={"ID":"00450bcf-beac-4a10-9697-638f67fbd4f4","Type":"ContainerStarted","Data":"f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"}
Sep 10 22:35:44.186771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:44.186407    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" event={"ID":"00450bcf-beac-4a10-9697-638f67fbd4f4","Type":"ContainerStarted","Data":"12851875f88868969d16f58191c7bb3a92713655569e456d7aeddf9dbbeaf9d4"}
Sep 10 22:35:44.234596 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:44.234562    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:44.239550 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:44.239526    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:44.295440 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:44.295376    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podStartSLOduration=2.295358603 podStartE2EDuration="2.295358603s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:44.230251301 +0000 UTC m=+1044.641375398" watchObservedRunningTime="2026-09-10 22:35:44.295358603 +0000 UTC m=+1044.706482700"
Sep 10 22:35:45.191563 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:45.191532    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:45.192683 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:45.192663    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:35:46.294557 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.294526    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"]
Sep 10 22:35:46.297917 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.297894    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.302457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.302438    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w3-33b4cf-openshift-default-dockercfg-w28z7\""
Sep 10 22:35:46.312046 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.312018    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"]
Sep 10 22:35:46.345141 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345103    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-certs\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345141 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345139    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4267\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-kube-api-access-q4267\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345171    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-socket\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97c080c-464b-43cf-83cc-eded16d6cbdb-istiod-ca-cert\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345235    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-token\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-envoy\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-data\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345377 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-credential-socket\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.345768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.345396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-podinfo\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446572    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-podinfo\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446707    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-certs\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446735    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4267\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-kube-api-access-q4267\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-socket\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97c080c-464b-43cf-83cc-eded16d6cbdb-istiod-ca-cert\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-token\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.446867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-envoy\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447266 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446871    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-data\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447266 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.446921    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-credential-socket\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447380 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.447264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-certs\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447380 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.447351    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-credential-socket\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447476 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.447450    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-socket\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447608 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.447584    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-data\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.447685 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.447590    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97c080c-464b-43cf-83cc-eded16d6cbdb-istiod-ca-cert\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.449186 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.449162    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-envoy\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.449302 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.449223    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-podinfo\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.454378 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.454357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-token\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.454775 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.454758    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4267\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-kube-api-access-q4267\") pod \"e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") " pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.609841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.609741    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:46.889803 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.889775    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"]
Sep 10 22:35:46.891546 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:46.891512    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda97c080c_464b_43cf_83cc_eded16d6cbdb.slice/crio-eafa80470711ea2a87447b3f9b49436892f99c526d57389f33e4ace48abfaf0e WatchSource:0}: Error finding container eafa80470711ea2a87447b3f9b49436892f99c526d57389f33e4ace48abfaf0e: Status 404 returned error can't find the container with id eafa80470711ea2a87447b3f9b49436892f99c526d57389f33e4ace48abfaf0e
Sep 10 22:35:46.893959 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.893920    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:35:46.894029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.893987    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:35:46.894029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:46.894015    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:35:47.203234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:47.203132    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" event={"ID":"a97c080c-464b-43cf-83cc-eded16d6cbdb","Type":"ContainerStarted","Data":"25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"}
Sep 10 22:35:47.203234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:47.203197    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" event={"ID":"a97c080c-464b-43cf-83cc-eded16d6cbdb","Type":"ContainerStarted","Data":"eafa80470711ea2a87447b3f9b49436892f99c526d57389f33e4ace48abfaf0e"}
Sep 10 22:35:47.226143 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:47.226087    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podStartSLOduration=1.226069699 podStartE2EDuration="1.226069699s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:47.225034792 +0000 UTC m=+1047.636158951" watchObservedRunningTime="2026-09-10 22:35:47.226069699 +0000 UTC m=+1047.637193795"
Sep 10 22:35:47.610505 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:47.610463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:47.615935 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:47.615907    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:48.208574 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:48.208542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:48.209526 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:48.209504    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:35:51.064000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.063962    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"]
Sep 10 22:35:51.067562 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.067543    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.070150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.070131    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-33b4cf-dockercfg-f9lrs\""
Sep 10 22:35:51.070251 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.070167    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-33b4cf\""
Sep 10 22:35:51.078931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.078907    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"]
Sep 10 22:35:51.094424 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.094386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2e878a-3a8e-4356-b4e7-43577fc84aec-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.094424 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.094418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l97jn\" (UniqueName: \"kubernetes.io/projected/1b2e878a-3a8e-4356-b4e7-43577fc84aec-kube-api-access-l97jn\") pod \"payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.114514 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.114485    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"]
Sep 10 22:35:51.117841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.117826    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.127390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.127368    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"]
Sep 10 22:35:51.195667 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.195598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e111a3-efc4-4736-8b51-7d340daba8a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.201209 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.201170    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2e878a-3a8e-4356-b4e7-43577fc84aec-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.201374 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.201230    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l97jn\" (UniqueName: \"kubernetes.io/projected/1b2e878a-3a8e-4356-b4e7-43577fc84aec-kube-api-access-l97jn\") pod \"payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.201374 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.201328    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftv5r\" (UniqueName: \"kubernetes.io/projected/39e111a3-efc4-4736-8b51-7d340daba8a7-kube-api-access-ftv5r\") pod \"payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.202609 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.202582    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2e878a-3a8e-4356-b4e7-43577fc84aec-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.210997 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.210957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l97jn\" (UniqueName: \"kubernetes.io/projected/1b2e878a-3a8e-4356-b4e7-43577fc84aec-kube-api-access-l97jn\") pod \"payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.302519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.302482    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e111a3-efc4-4736-8b51-7d340daba8a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.302774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.302532    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftv5r\" (UniqueName: \"kubernetes.io/projected/39e111a3-efc4-4736-8b51-7d340daba8a7-kube-api-access-ftv5r\") pod \"payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.303296 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.303269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e111a3-efc4-4736-8b51-7d340daba8a7-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.315712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.315608    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftv5r\" (UniqueName: \"kubernetes.io/projected/39e111a3-efc4-4736-8b51-7d340daba8a7-kube-api-access-ftv5r\") pod \"payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.378636 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.378598    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:51.429952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.429473    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:51.655381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.655357    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"]
Sep 10 22:35:51.657284 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:51.657255    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2e878a_3a8e_4356_b4e7_43577fc84aec.slice/crio-723ef3940e8acb5acbc9a6bd1e80984186167799a04837f77529132afdac961f WatchSource:0}: Error finding container 723ef3940e8acb5acbc9a6bd1e80984186167799a04837f77529132afdac961f: Status 404 returned error can't find the container with id 723ef3940e8acb5acbc9a6bd1e80984186167799a04837f77529132afdac961f
Sep 10 22:35:51.721694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:51.721664    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"]
Sep 10 22:35:51.723818 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:35:51.723783    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e111a3_efc4_4736_8b51_7d340daba8a7.slice/crio-8f75e713f34237088d98dca3fdad55478ff0639c0d0b62d8eee9fe9dc695d65b WatchSource:0}: Error finding container 8f75e713f34237088d98dca3fdad55478ff0639c0d0b62d8eee9fe9dc695d65b: Status 404 returned error can't find the container with id 8f75e713f34237088d98dca3fdad55478ff0639c0d0b62d8eee9fe9dc695d65b
Sep 10 22:35:52.230758 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.230722    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g" event={"ID":"39e111a3-efc4-4736-8b51-7d340daba8a7","Type":"ContainerStarted","Data":"3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb"}
Sep 10 22:35:52.231197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.230787    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g" event={"ID":"39e111a3-efc4-4736-8b51-7d340daba8a7","Type":"ContainerStarted","Data":"8f75e713f34237088d98dca3fdad55478ff0639c0d0b62d8eee9fe9dc695d65b"}
Sep 10 22:35:52.231197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.230816    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:35:52.232393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.232365    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj" event={"ID":"1b2e878a-3a8e-4356-b4e7-43577fc84aec","Type":"ContainerStarted","Data":"815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c"}
Sep 10 22:35:52.232520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.232405    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj" event={"ID":"1b2e878a-3a8e-4356-b4e7-43577fc84aec","Type":"ContainerStarted","Data":"723ef3940e8acb5acbc9a6bd1e80984186167799a04837f77529132afdac961f"}
Sep 10 22:35:52.232520 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.232487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:35:52.248098 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.248034    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g" podStartSLOduration=1.248012902 podStartE2EDuration="1.248012902s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:52.246534164 +0000 UTC m=+1052.657658312" watchObservedRunningTime="2026-09-10 22:35:52.248012902 +0000 UTC m=+1052.659137002"
Sep 10 22:35:52.261381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:35:52.261330    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj" podStartSLOduration=1.261313015 podStartE2EDuration="1.261313015s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:35:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:35:52.260944625 +0000 UTC m=+1052.672068747" watchObservedRunningTime="2026-09-10 22:35:52.261313015 +0000 UTC m=+1052.672437111"
Sep 10 22:36:03.239073 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:03.239038    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:36:03.239475 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:03.239197    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:36:04.250850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:04.250810    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 10 22:36:04.251352 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:04.250888    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:36:05.320531 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.320496    2582 generic.go:356] "Generic (PLEG): container finished" podID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerID="25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184" exitCode=0
Sep 10 22:36:05.321041 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.320574    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" event={"ID":"a97c080c-464b-43cf-83cc-eded16d6cbdb","Type":"ContainerDied","Data":"25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"}
Sep 10 22:36:05.321110 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.321095    2582 scope.go:117] "RemoveContainer" containerID="25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"
Sep 10 22:36:05.322327 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.322290    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:36:05.322438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.322325    2582 generic.go:356] "Generic (PLEG): container finished" podID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerID="f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9" exitCode=0
Sep 10 22:36:05.322438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.322356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" event={"ID":"00450bcf-beac-4a10-9697-638f67fbd4f4","Type":"ContainerDied","Data":"f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"}
Sep 10 22:36:05.322438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.322392    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:36:05.322606 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.322440    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:36:05.322697 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.322683    2582 scope.go:117] "RemoveContainer" containerID="f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"
Sep 10 22:36:05.323730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.323702    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:36:05.323806 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.323786    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:36:05.323863 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:05.323831    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:36:06.333682 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:06.333640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" event={"ID":"00450bcf-beac-4a10-9697-638f67fbd4f4","Type":"ContainerStarted","Data":"22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf"}
Sep 10 22:36:06.336543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:06.336506    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" event={"ID":"a97c080c-464b-43cf-83cc-eded16d6cbdb","Type":"ContainerStarted","Data":"64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8"}
Sep 10 22:36:06.610308 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:06.610200    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:36:06.610494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:06.610468    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:36:06.610573 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:06.610529    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:36:07.234589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:07.233763    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:36:07.234589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:07.234251    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 10 22:36:07.234589 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:07.234304    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 10 22:36:07.610281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:07.610182    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:36:07.610281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:07.610243    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:36:08.234678 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:08.234610    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 10 22:36:08.235400 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:08.234967    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 10 22:36:08.611058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:08.610962    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:36:08.611058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:08.611027    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:36:09.234928 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:09.234879    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 10 22:36:09.235154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:09.234967    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 10 22:36:09.610611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:09.610525    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:36:09.610839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:09.610753    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:36:10.235510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:10.235021    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 10 22:36:10.235510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:10.235091    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 10 22:36:10.610823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:10.610730    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:36:10.610823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:10.610786    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:36:11.235070 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:11.234966    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body=
Sep 10 22:36:11.235070 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:11.235035    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused"
Sep 10 22:36:11.611142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:11.611060    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body=
Sep 10 22:36:11.611582 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:11.611555    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused"
Sep 10 22:36:12.255046 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:12.255008    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:36:12.255484 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:12.255444    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:36:12.256350 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:12.256326    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:36:12.613690 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:12.613600    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:36:12.614071 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:12.613873    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:36:12.614502 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:12.614487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:36:16.274059 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.274019    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"]
Sep 10 22:36:16.277411 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.277380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.280201 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.280176    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-25e5bd-serving-cert\""
Sep 10 22:36:16.290323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.290295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"]
Sep 10 22:36:16.369022 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.368973    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.369022 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.369015    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drhf4\" (UniqueName: \"kubernetes.io/projected/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-kube-api-access-drhf4\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.369241 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.369109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.369241 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.369149    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.470057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.470010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.470057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.470059    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drhf4\" (UniqueName: \"kubernetes.io/projected/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-kube-api-access-drhf4\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.470281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.470116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.470281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.470156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.470281 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:36:16.470261    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-serving-cert: secret "maas-api-e2e-shared-b-w2-25e5bd-serving-cert" not found
Sep 10 22:36:16.470383 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:36:16.470336    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls podName:7e0eecd4-b631-4a03-8d81-f8c4c3fbca45 nodeName:}" failed. No retries permitted until 2026-09-10 22:36:16.970316123 +0000 UTC m=+1077.381440198 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls") pod "maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" (UID: "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45") : secret "maas-api-e2e-shared-b-w2-25e5bd-serving-cert" not found
Sep 10 22:36:16.470735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.470708    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.472862 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.472839    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.479194 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.479169    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-drhf4\" (UniqueName: \"kubernetes.io/projected/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-kube-api-access-drhf4\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.974824 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.974788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:16.977417 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:16.977391    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:17.188472 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:17.188431    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:17.466830 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:17.466807    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"]
Sep 10 22:36:17.469110 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:36:17.469080    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e0eecd4_b631_4a03_8d81_f8c4c3fbca45.slice/crio-df44a15c159056ea03c0e324e748b48c0a178eeaf5bf47c3415d8a107f697591 WatchSource:0}: Error finding container df44a15c159056ea03c0e324e748b48c0a178eeaf5bf47c3415d8a107f697591: Status 404 returned error can't find the container with id df44a15c159056ea03c0e324e748b48c0a178eeaf5bf47c3415d8a107f697591
Sep 10 22:36:18.410888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:18.410852    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" event={"ID":"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45","Type":"ContainerStarted","Data":"5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114"}
Sep 10 22:36:18.411108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:18.410900    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" event={"ID":"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45","Type":"ContainerStarted","Data":"df44a15c159056ea03c0e324e748b48c0a178eeaf5bf47c3415d8a107f697591"}
Sep 10 22:36:18.411108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:18.410965    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:18.428899 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:18.428837    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" podStartSLOduration=1.977459025 podStartE2EDuration="2.428818305s" totalImagesPullingTime="451.35928ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:18.427381043 +0000 UTC m=+1078.838505159" watchObservedRunningTime="2026-09-10 22:36:18.428818305 +0000 UTC m=+1078.839942432"
Sep 10 22:36:24.422464 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:24.422438    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:36:56.476434 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.476393    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"]
Sep 10 22:36:56.478907 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.478886    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.481024 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.481003    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-022f2a6a-serving-cert\""
Sep 10 22:36:56.490813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.490788    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"]
Sep 10 22:36:56.554237 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.554193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.554431 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.554264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x24xt\" (UniqueName: \"kubernetes.io/projected/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-kube-api-access-x24xt\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.554431 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.554298    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-metrics-certs\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.554567 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.554456    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-openshift-service-ca\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.655458 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.655415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x24xt\" (UniqueName: \"kubernetes.io/projected/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-kube-api-access-x24xt\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.655694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.655486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-metrics-certs\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.655694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.655643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-openshift-service-ca\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.655694 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.655682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.655890 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:36:56.655820    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-serving-cert: secret "maas-api-e2e-mt-022f2a6a-serving-cert" not found
Sep 10 22:36:56.655949 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:36:56.655898    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls podName:3243f8cc-aebd-4135-97a4-2cc611d4e1d8 nodeName:}" failed. No retries permitted until 2026-09-10 22:36:57.155873675 +0000 UTC m=+1117.566997755 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls") pod "maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" (UID: "3243f8cc-aebd-4135-97a4-2cc611d4e1d8") : secret "maas-api-e2e-mt-022f2a6a-serving-cert" not found
Sep 10 22:36:56.656613 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.656586    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-openshift-service-ca\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.659889 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.659857    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-metrics-certs\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:56.667223 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:56.667197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x24xt\" (UniqueName: \"kubernetes.io/projected/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-kube-api-access-x24xt\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:57.147462 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.147424    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"]
Sep 10 22:36:57.150017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.149995    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.152383 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.152353    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-022f2a6a-dockercfg-r5sn7\""
Sep 10 22:36:57.152511 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.152366    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-022f2a6a\""
Sep 10 22:36:57.160944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.160914    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:57.161580 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.161556    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"]
Sep 10 22:36:57.163840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.163815    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls\") pod \"maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:57.184486 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.184455    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"]
Sep 10 22:36:57.186845 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.186829    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.200569 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.200535    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"]
Sep 10 22:36:57.262374 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.262338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9bhx\" (UniqueName: \"kubernetes.io/projected/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-kube-api-access-p9bhx\") pod \"payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") " pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.262705 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.262680    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1064c3c2-0232-4318-a8a1-25e5850b81fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.262975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.262900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-plugins-config-volume\") pod \"payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") " pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.262975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.262966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5mdz\" (UniqueName: \"kubernetes.io/projected/1064c3c2-0232-4318-a8a1-25e5850b81fb-kube-api-access-n5mdz\") pod \"payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.364252 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.364215    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9bhx\" (UniqueName: \"kubernetes.io/projected/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-kube-api-access-p9bhx\") pod \"payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") " pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.364252 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.364256    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1064c3c2-0232-4318-a8a1-25e5850b81fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.364511 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.364298    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-plugins-config-volume\") pod \"payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") " pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.364511 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.364369    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n5mdz\" (UniqueName: \"kubernetes.io/projected/1064c3c2-0232-4318-a8a1-25e5850b81fb-kube-api-access-n5mdz\") pod \"payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.365046 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.365024    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-plugins-config-volume\") pod \"payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") " pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.365108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.365074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1064c3c2-0232-4318-a8a1-25e5850b81fb-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.373165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.373140    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9bhx\" (UniqueName: \"kubernetes.io/projected/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-kube-api-access-p9bhx\") pod \"payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") " pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.373323 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.373301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5mdz\" (UniqueName: \"kubernetes.io/projected/1064c3c2-0232-4318-a8a1-25e5850b81fb-kube-api-access-n5mdz\") pod \"payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.390076 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.390043    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:57.461734 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.461686    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:57.499999 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.499942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:57.661494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.661460    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"]
Sep 10 22:36:57.663160 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:36:57.663133    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3243f8cc_aebd_4135_97a4_2cc611d4e1d8.slice/crio-ac089c07d22776d66207db8c229d4b5494e9d3b17a35ea371a7b1b5de6992059 WatchSource:0}: Error finding container ac089c07d22776d66207db8c229d4b5494e9d3b17a35ea371a7b1b5de6992059: Status 404 returned error can't find the container with id ac089c07d22776d66207db8c229d4b5494e9d3b17a35ea371a7b1b5de6992059
Sep 10 22:36:57.739069 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.739002    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"]
Sep 10 22:36:57.741811 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:36:57.741778    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1064c3c2_0232_4318_a8a1_25e5850b81fb.slice/crio-800b9fdf6d6635c788c1c1f52c9825df0742d871da6366ca320f4138c92c7504 WatchSource:0}: Error finding container 800b9fdf6d6635c788c1c1f52c9825df0742d871da6366ca320f4138c92c7504: Status 404 returned error can't find the container with id 800b9fdf6d6635c788c1c1f52c9825df0742d871da6366ca320f4138c92c7504
Sep 10 22:36:57.782036 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:57.782011    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"]
Sep 10 22:36:57.787993 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:36:57.787960    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5e6fc9b_8552_44f7_8b0a_c3ece50cfea1.slice/crio-927d3d6cfa21ff4be115f38c2d72938f8745494320d0474d4d751c05e312b4df WatchSource:0}: Error finding container 927d3d6cfa21ff4be115f38c2d72938f8745494320d0474d4d751c05e312b4df: Status 404 returned error can't find the container with id 927d3d6cfa21ff4be115f38c2d72938f8745494320d0474d4d751c05e312b4df
Sep 10 22:36:58.617020 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.616976    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" event={"ID":"1064c3c2-0232-4318-a8a1-25e5850b81fb","Type":"ContainerStarted","Data":"018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04"}
Sep 10 22:36:58.617584 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.617560    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" event={"ID":"1064c3c2-0232-4318-a8a1-25e5850b81fb","Type":"ContainerStarted","Data":"800b9fdf6d6635c788c1c1f52c9825df0742d871da6366ca320f4138c92c7504"}
Sep 10 22:36:58.618799 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.618779    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:36:58.621111 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.621089    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" event={"ID":"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1","Type":"ContainerStarted","Data":"0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604"}
Sep 10 22:36:58.626951 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.626928    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" event={"ID":"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1","Type":"ContainerStarted","Data":"927d3d6cfa21ff4be115f38c2d72938f8745494320d0474d4d751c05e312b4df"}
Sep 10 22:36:58.627147 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.627133    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:36:58.627272 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.627261    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:36:58.627395 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.627381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" event={"ID":"3243f8cc-aebd-4135-97a4-2cc611d4e1d8","Type":"ContainerStarted","Data":"fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63"}
Sep 10 22:36:58.627528 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.627512    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" event={"ID":"3243f8cc-aebd-4135-97a4-2cc611d4e1d8","Type":"ContainerStarted","Data":"ac089c07d22776d66207db8c229d4b5494e9d3b17a35ea371a7b1b5de6992059"}
Sep 10 22:36:58.643334 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.642074    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" podStartSLOduration=1.64205086 podStartE2EDuration="1.64205086s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:58.635796839 +0000 UTC m=+1119.046920962" watchObservedRunningTime="2026-09-10 22:36:58.64205086 +0000 UTC m=+1119.053174959"
Sep 10 22:36:58.661197 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.661125    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" podStartSLOduration=1.661106932 podStartE2EDuration="1.661106932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:58.658900176 +0000 UTC m=+1119.070024297" watchObservedRunningTime="2026-09-10 22:36:58.661106932 +0000 UTC m=+1119.072231029"
Sep 10 22:36:58.677503 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:36:58.677442    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" podStartSLOduration=2.327360713 podStartE2EDuration="2.677419446s" totalImagesPullingTime="350.058733ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:36:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:36:58.675779836 +0000 UTC m=+1119.086903957" watchObservedRunningTime="2026-09-10 22:36:58.677419446 +0000 UTC m=+1119.088543548"
Sep 10 22:37:05.652354 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:37:05.652322    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:37:10.648829 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:37:10.648793    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:37:10.649259 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:37:10.649155    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:38:20.354214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.354178    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"]
Sep 10 22:38:20.354823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.354425    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" podUID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" containerName="maas-api" containerID="cri-o://fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63" gracePeriod=30
Sep 10 22:38:20.410002 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.409970    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"]
Sep 10 22:38:20.410224 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.410196    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" podUID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" containerName="payload-processing" containerID="cri-o://0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604" gracePeriod=30
Sep 10 22:38:20.419473 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.419448    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"]
Sep 10 22:38:20.419812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.419764    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" podUID="1064c3c2-0232-4318-a8a1-25e5850b81fb" containerName="payload-pre-processing" containerID="cri-o://018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04" gracePeriod=30
Sep 10 22:38:20.647465 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.647310    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" podUID="1064c3c2-0232-4318-a8a1-25e5850b81fb" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.65:9004: connect: connection refused"
Sep 10 22:38:20.696098 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.692382    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:38:20.734441 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.734411    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:38:20.748381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.748355    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818442    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-openshift-service-ca\") pod \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") "
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818512    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-plugins-config-volume\") pod \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") "
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818572    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-metrics-certs\") pod \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") "
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818778    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9bhx\" (UniqueName: \"kubernetes.io/projected/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-kube-api-access-p9bhx\") pod \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\" (UID: \"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1\") "
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818836    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls\") pod \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") "
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818904    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x24xt\" (UniqueName: \"kubernetes.io/projected/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-kube-api-access-x24xt\") pod \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\" (UID: \"3243f8cc-aebd-4135-97a4-2cc611d4e1d8\") "
Sep 10 22:38:20.818506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.818907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3243f8cc-aebd-4135-97a4-2cc611d4e1d8" (UID: "3243f8cc-aebd-4135-97a4-2cc611d4e1d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:38:20.819525 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.819036    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" (UID: "c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:38:20.819525 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.819276    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:20.819525 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.819296    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:20.822108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.822073    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-kube-api-access-p9bhx" (OuterVolumeSpecName: "kube-api-access-p9bhx") pod "c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" (UID: "c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1"). InnerVolumeSpecName "kube-api-access-p9bhx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:38:20.822231 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.822177    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-kube-api-access-x24xt" (OuterVolumeSpecName: "kube-api-access-x24xt") pod "3243f8cc-aebd-4135-97a4-2cc611d4e1d8" (UID: "3243f8cc-aebd-4135-97a4-2cc611d4e1d8"). InnerVolumeSpecName "kube-api-access-x24xt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:38:20.822497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.822462    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3243f8cc-aebd-4135-97a4-2cc611d4e1d8" (UID: "3243f8cc-aebd-4135-97a4-2cc611d4e1d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:38:20.822602 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.822472    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3243f8cc-aebd-4135-97a4-2cc611d4e1d8" (UID: "3243f8cc-aebd-4135-97a4-2cc611d4e1d8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:38:20.920584 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920488    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1064c3c2-0232-4318-a8a1-25e5850b81fb-plugins-config-volume\") pod \"1064c3c2-0232-4318-a8a1-25e5850b81fb\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") "
Sep 10 22:38:20.920584 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920577    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5mdz\" (UniqueName: \"kubernetes.io/projected/1064c3c2-0232-4318-a8a1-25e5850b81fb-kube-api-access-n5mdz\") pod \"1064c3c2-0232-4318-a8a1-25e5850b81fb\" (UID: \"1064c3c2-0232-4318-a8a1-25e5850b81fb\") "
Sep 10 22:38:20.920921 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920899    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x24xt\" (UniqueName: \"kubernetes.io/projected/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-kube-api-access-x24xt\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:20.920963 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920928    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:20.920963 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920945    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9bhx\" (UniqueName: \"kubernetes.io/projected/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1-kube-api-access-p9bhx\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:20.920963 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920959    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3243f8cc-aebd-4135-97a4-2cc611d4e1d8-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:20.921057 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.920972    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1064c3c2-0232-4318-a8a1-25e5850b81fb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1064c3c2-0232-4318-a8a1-25e5850b81fb" (UID: "1064c3c2-0232-4318-a8a1-25e5850b81fb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:38:20.922895 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:20.922871    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1064c3c2-0232-4318-a8a1-25e5850b81fb-kube-api-access-n5mdz" (OuterVolumeSpecName: "kube-api-access-n5mdz") pod "1064c3c2-0232-4318-a8a1-25e5850b81fb" (UID: "1064c3c2-0232-4318-a8a1-25e5850b81fb"). InnerVolumeSpecName "kube-api-access-n5mdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:38:21.021828 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.021787    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1064c3c2-0232-4318-a8a1-25e5850b81fb-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:21.021828 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.021819    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5mdz\" (UniqueName: \"kubernetes.io/projected/1064c3c2-0232-4318-a8a1-25e5850b81fb-kube-api-access-n5mdz\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:38:21.061471 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.061431    2582 generic.go:356] "Generic (PLEG): container finished" podID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" containerID="fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63" exitCode=0
Sep 10 22:38:21.061692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.061495    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"
Sep 10 22:38:21.061692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.061527    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" event={"ID":"3243f8cc-aebd-4135-97a4-2cc611d4e1d8","Type":"ContainerDied","Data":"fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63"}
Sep 10 22:38:21.061692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.061586    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" event={"ID":"3243f8cc-aebd-4135-97a4-2cc611d4e1d8","Type":"ContainerDied","Data":"ac089c07d22776d66207db8c229d4b5494e9d3b17a35ea371a7b1b5de6992059"}
Sep 10 22:38:21.061692 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.061609    2582 scope.go:117] "RemoveContainer" containerID="fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63"
Sep 10 22:38:21.063039 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.063020    2582 generic.go:356] "Generic (PLEG): container finished" podID="1064c3c2-0232-4318-a8a1-25e5850b81fb" containerID="018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04" exitCode=0
Sep 10 22:38:21.063144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.063090    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"
Sep 10 22:38:21.063144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.063111    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" event={"ID":"1064c3c2-0232-4318-a8a1-25e5850b81fb","Type":"ContainerDied","Data":"018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04"}
Sep 10 22:38:21.063251 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.063167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw" event={"ID":"1064c3c2-0232-4318-a8a1-25e5850b81fb","Type":"ContainerDied","Data":"800b9fdf6d6635c788c1c1f52c9825df0742d871da6366ca320f4138c92c7504"}
Sep 10 22:38:21.064427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.064402    2582 generic.go:356] "Generic (PLEG): container finished" podID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" containerID="0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604" exitCode=0
Sep 10 22:38:21.064536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.064438    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" event={"ID":"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1","Type":"ContainerDied","Data":"0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604"}
Sep 10 22:38:21.064536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.064455    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"
Sep 10 22:38:21.064536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.064476    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" event={"ID":"c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1","Type":"ContainerDied","Data":"927d3d6cfa21ff4be115f38c2d72938f8745494320d0474d4d751c05e312b4df"}
Sep 10 22:38:21.071500 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.071483    2582 scope.go:117] "RemoveContainer" containerID="fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63"
Sep 10 22:38:21.071899 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:38:21.071869    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63\": container with ID starting with fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63 not found: ID does not exist" containerID="fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63"
Sep 10 22:38:21.071973 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.071913    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63"} err="failed to get container status \"fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63\": rpc error: code = NotFound desc = could not find container \"fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63\": container with ID starting with fa65c0144531363bdda3f28654bdcd5c4afe626b34fbd0851ed015a47faaea63 not found: ID does not exist"
Sep 10 22:38:21.071973 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.071939    2582 scope.go:117] "RemoveContainer" containerID="018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04"
Sep 10 22:38:21.081546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.081528    2582 scope.go:117] "RemoveContainer" containerID="018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04"
Sep 10 22:38:21.081960 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:38:21.081940    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04\": container with ID starting with 018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04 not found: ID does not exist" containerID="018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04"
Sep 10 22:38:21.082044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.081966    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04"} err="failed to get container status \"018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04\": rpc error: code = NotFound desc = could not find container \"018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04\": container with ID starting with 018cb5ee3f86be819b7fac01d571ac68fc73b73fd1fb4f74c430c87bde051b04 not found: ID does not exist"
Sep 10 22:38:21.082044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.081983    2582 scope.go:117] "RemoveContainer" containerID="0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604"
Sep 10 22:38:21.090700 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.090682    2582 scope.go:117] "RemoveContainer" containerID="0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604"
Sep 10 22:38:21.091003 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:38:21.090983    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604\": container with ID starting with 0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604 not found: ID does not exist" containerID="0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604"
Sep 10 22:38:21.091081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.091011    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604"} err="failed to get container status \"0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604\": rpc error: code = NotFound desc = could not find container \"0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604\": container with ID starting with 0f5f3b9a65b59bba7f2f3a19130cdc4634a3d30005c490dd30db53acf82b3604 not found: ID does not exist"
Sep 10 22:38:21.091233 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.091213    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"]
Sep 10 22:38:21.094957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.094934    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd"]
Sep 10 22:38:21.108282 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.108254    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"]
Sep 10 22:38:21.114487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.114458    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5"]
Sep 10 22:38:21.125580 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.125551    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"]
Sep 10 22:38:21.129584 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.129561    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-022f2a6a-79d469986-4tdcw"]
Sep 10 22:38:21.647819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:21.647718    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-mt-022f2a6a-678549bfdf-6bfvd" podUID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.66:9004: i/o timeout"
Sep 10 22:38:22.052364 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:22.052331    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1064c3c2-0232-4318-a8a1-25e5850b81fb" path="/var/lib/kubelet/pods/1064c3c2-0232-4318-a8a1-25e5850b81fb/volumes"
Sep 10 22:38:22.052765 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:22.052751    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" path="/var/lib/kubelet/pods/3243f8cc-aebd-4135-97a4-2cc611d4e1d8/volumes"
Sep 10 22:38:22.053067 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:22.053056    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" path="/var/lib/kubelet/pods/c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1/volumes"
Sep 10 22:38:23.647397 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:38:23.647347    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-022f2a6a-56ff66dd5d-nlrt5" podUID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.64:8443/health\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 10 22:40:09.789923 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.789890    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"]
Sep 10 22:40:09.790530 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790509    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1064c3c2-0232-4318-a8a1-25e5850b81fb" containerName="payload-pre-processing"
Sep 10 22:40:09.790612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790533    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1064c3c2-0232-4318-a8a1-25e5850b81fb" containerName="payload-pre-processing"
Sep 10 22:40:09.790612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790546    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" containerName="payload-processing"
Sep 10 22:40:09.790612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790554    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" containerName="payload-processing"
Sep 10 22:40:09.790612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790565    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" containerName="maas-api"
Sep 10 22:40:09.790612 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790574    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" containerName="maas-api"
Sep 10 22:40:09.790888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790704    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5e6fc9b-8552-44f7-8b0a-c3ece50cfea1" containerName="payload-processing"
Sep 10 22:40:09.790888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790723    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1064c3c2-0232-4318-a8a1-25e5850b81fb" containerName="payload-pre-processing"
Sep 10 22:40:09.790888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.790733    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3243f8cc-aebd-4135-97a4-2cc611d4e1d8" containerName="maas-api"
Sep 10 22:40:09.793901 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.793879    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.796240 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.796219    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-03e78e-serving-cert\""
Sep 10 22:40:09.804396 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.804364    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"]
Sep 10 22:40:09.864409 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.864380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.864597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.864415    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wt2r6\" (UniqueName: \"kubernetes.io/projected/64dd22da-3fed-4caf-9b07-6dacfda68595-kube-api-access-wt2r6\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.864597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.864468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-metrics-certs\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.864597 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.864552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dd22da-3fed-4caf-9b07-6dacfda68595-openshift-service-ca\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.965131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.965088    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.965131 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.965135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wt2r6\" (UniqueName: \"kubernetes.io/projected/64dd22da-3fed-4caf-9b07-6dacfda68595-kube-api-access-wt2r6\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.965404 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.965216    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-metrics-certs\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.965404 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:40:09.965240    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-serving-cert: secret "maas-api-e2e-api-a-03e78e-serving-cert" not found
Sep 10 22:40:09.965404 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.965258    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dd22da-3fed-4caf-9b07-6dacfda68595-openshift-service-ca\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.965404 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:40:09.965304    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls podName:64dd22da-3fed-4caf-9b07-6dacfda68595 nodeName:}" failed. No retries permitted until 2026-09-10 22:40:10.465287487 +0000 UTC m=+1310.876411562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls") pod "maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" (UID: "64dd22da-3fed-4caf-9b07-6dacfda68595") : secret "maas-api-e2e-api-a-03e78e-serving-cert" not found
Sep 10 22:40:09.965994 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.965971    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dd22da-3fed-4caf-9b07-6dacfda68595-openshift-service-ca\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.967801 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.967785    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-metrics-certs\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:09.974154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:09.974137    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wt2r6\" (UniqueName: \"kubernetes.io/projected/64dd22da-3fed-4caf-9b07-6dacfda68595-kube-api-access-wt2r6\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:10.436169 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.436137    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"]
Sep 10 22:40:10.439791 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.439771    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.442345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.442324    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-03e78e\""
Sep 10 22:40:10.442453 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.442382    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-03e78e-dockercfg-x8cqr\""
Sep 10 22:40:10.446369 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.446345    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"]
Sep 10 22:40:10.449788 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.449768    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.451819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.451657    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"]
Sep 10 22:40:10.467119 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.467095    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"]
Sep 10 22:40:10.469288 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.469255    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:10.471972 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.471947    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls\") pod \"maas-api-e2e-api-a-03e78e-796644d5c-6mzcl\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:10.570591 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.570558    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-03e78e-95fc55df9-z964h\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") " pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.570815 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.570596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3571c93-5ac7-489a-8c1d-ec22efb767b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.570815 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.570649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7ptz\" (UniqueName: \"kubernetes.io/projected/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-kube-api-access-w7ptz\") pod \"payload-processing-e2e-api-a-03e78e-95fc55df9-z964h\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") " pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.570957 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.570839    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2m9k\" (UniqueName: \"kubernetes.io/projected/b3571c93-5ac7-489a-8c1d-ec22efb767b9-kube-api-access-j2m9k\") pod \"payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.672170 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.672127    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2m9k\" (UniqueName: \"kubernetes.io/projected/b3571c93-5ac7-489a-8c1d-ec22efb767b9-kube-api-access-j2m9k\") pod \"payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.672170 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.672176    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-03e78e-95fc55df9-z964h\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") " pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.672432 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.672198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3571c93-5ac7-489a-8c1d-ec22efb767b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.672432 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.672224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7ptz\" (UniqueName: \"kubernetes.io/projected/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-kube-api-access-w7ptz\") pod \"payload-processing-e2e-api-a-03e78e-95fc55df9-z964h\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") " pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.672898 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.672877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-plugins-config-volume\") pod \"payload-processing-e2e-api-a-03e78e-95fc55df9-z964h\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") " pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.672951 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.672906    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3571c93-5ac7-489a-8c1d-ec22efb767b9-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.681420 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.681395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7ptz\" (UniqueName: \"kubernetes.io/projected/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-kube-api-access-w7ptz\") pod \"payload-processing-e2e-api-a-03e78e-95fc55df9-z964h\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") " pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.681554 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.681462    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2m9k\" (UniqueName: \"kubernetes.io/projected/b3571c93-5ac7-489a-8c1d-ec22efb767b9-kube-api-access-j2m9k\") pod \"payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.705397 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.705328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:10.751949 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.751915    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:10.773019 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.772985    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:10.980021 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:10.979983    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"]
Sep 10 22:40:10.981421 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:40:10.981391    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64dd22da_3fed_4caf_9b07_6dacfda68595.slice/crio-6792e011ce90df311a0ff03a4e93c961a5b7611ec167e9c58c775f467ab2c2ce WatchSource:0}: Error finding container 6792e011ce90df311a0ff03a4e93c961a5b7611ec167e9c58c775f467ab2c2ce: Status 404 returned error can't find the container with id 6792e011ce90df311a0ff03a4e93c961a5b7611ec167e9c58c775f467ab2c2ce
Sep 10 22:40:11.034664 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.034634    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"]
Sep 10 22:40:11.036425 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:40:11.036398    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3571c93_5ac7_489a_8c1d_ec22efb767b9.slice/crio-3cb5aa737527f9898b64c031f9cc8d1f056ac37fe662fa24692dd31b1e34049a WatchSource:0}: Error finding container 3cb5aa737527f9898b64c031f9cc8d1f056ac37fe662fa24692dd31b1e34049a: Status 404 returned error can't find the container with id 3cb5aa737527f9898b64c031f9cc8d1f056ac37fe662fa24692dd31b1e34049a
Sep 10 22:40:11.059999 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.059974    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"]
Sep 10 22:40:11.061920 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:40:11.061899    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f85283_d176_47b0_9ab6_f6ef50e0e9a3.slice/crio-67904efd4066fc4ebe7aede7e000477fb138b805318e9432aac99284e8ff2d0b WatchSource:0}: Error finding container 67904efd4066fc4ebe7aede7e000477fb138b805318e9432aac99284e8ff2d0b: Status 404 returned error can't find the container with id 67904efd4066fc4ebe7aede7e000477fb138b805318e9432aac99284e8ff2d0b
Sep 10 22:40:11.623802 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.623741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg" event={"ID":"b3571c93-5ac7-489a-8c1d-ec22efb767b9","Type":"ContainerStarted","Data":"f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1"}
Sep 10 22:40:11.623926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.623803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg" event={"ID":"b3571c93-5ac7-489a-8c1d-ec22efb767b9","Type":"ContainerStarted","Data":"3cb5aa737527f9898b64c031f9cc8d1f056ac37fe662fa24692dd31b1e34049a"}
Sep 10 22:40:11.623926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.623835    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:11.625662 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.625612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h" event={"ID":"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3","Type":"ContainerStarted","Data":"b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af"}
Sep 10 22:40:11.625781 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.625681    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h" event={"ID":"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3","Type":"ContainerStarted","Data":"67904efd4066fc4ebe7aede7e000477fb138b805318e9432aac99284e8ff2d0b"}
Sep 10 22:40:11.625781 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.625734    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:40:11.627037 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.627016    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" event={"ID":"64dd22da-3fed-4caf-9b07-6dacfda68595","Type":"ContainerStarted","Data":"6792e011ce90df311a0ff03a4e93c961a5b7611ec167e9c58c775f467ab2c2ce"}
Sep 10 22:40:11.643351 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.643309    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg" podStartSLOduration=1.64329584 podStartE2EDuration="1.64329584s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:40:11.64128096 +0000 UTC m=+1312.052405078" watchObservedRunningTime="2026-09-10 22:40:11.64329584 +0000 UTC m=+1312.054419986"
Sep 10 22:40:11.658374 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:11.658325    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h" podStartSLOduration=1.658305865 podStartE2EDuration="1.658305865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:40:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:40:11.657017295 +0000 UTC m=+1312.068141415" watchObservedRunningTime="2026-09-10 22:40:11.658305865 +0000 UTC m=+1312.069429969"
Sep 10 22:40:12.633281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:12.633248    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" event={"ID":"64dd22da-3fed-4caf-9b07-6dacfda68595","Type":"ContainerStarted","Data":"90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3"}
Sep 10 22:40:12.633708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:12.633586    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:12.654437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:12.654374    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" podStartSLOduration=3.040946407 podStartE2EDuration="3.654352389s" totalImagesPullingTime="613.405982ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:40:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:40:12.652905111 +0000 UTC m=+1313.064029226" watchObservedRunningTime="2026-09-10 22:40:12.654352389 +0000 UTC m=+1313.065476486"
Sep 10 22:40:18.644769 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:18.644741    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:40:22.635336 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:22.635305    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:40:22.635718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:40:22.635380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:41:21.295298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.295254    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"]
Sep 10 22:41:21.297901 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.295523    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" podUID="64dd22da-3fed-4caf-9b07-6dacfda68595" containerName="maas-api" containerID="cri-o://90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3" gracePeriod=30
Sep 10 22:41:21.366001 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.365962    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"]
Sep 10 22:41:21.366260 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.366212    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h" podUID="e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" containerName="payload-processing" containerID="cri-o://b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af" gracePeriod=30
Sep 10 22:41:21.376686 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.376580    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"]
Sep 10 22:41:21.377264 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.377211    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg" podUID="b3571c93-5ac7-489a-8c1d-ec22efb767b9" containerName="payload-pre-processing" containerID="cri-o://f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1" gracePeriod=30
Sep 10 22:41:21.672446 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.672412    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:41:21.688395 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.688367    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:41:21.705294 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.705270    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:41:21.775876 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.775845    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls\") pod \"64dd22da-3fed-4caf-9b07-6dacfda68595\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") "
Sep 10 22:41:21.775876 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.775881    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-metrics-certs\") pod \"64dd22da-3fed-4caf-9b07-6dacfda68595\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") "
Sep 10 22:41:21.776137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.775911    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-plugins-config-volume\") pod \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") "
Sep 10 22:41:21.776137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.775940    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wt2r6\" (UniqueName: \"kubernetes.io/projected/64dd22da-3fed-4caf-9b07-6dacfda68595-kube-api-access-wt2r6\") pod \"64dd22da-3fed-4caf-9b07-6dacfda68595\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") "
Sep 10 22:41:21.776137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.775970    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dd22da-3fed-4caf-9b07-6dacfda68595-openshift-service-ca\") pod \"64dd22da-3fed-4caf-9b07-6dacfda68595\" (UID: \"64dd22da-3fed-4caf-9b07-6dacfda68595\") "
Sep 10 22:41:21.776137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.775989    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3571c93-5ac7-489a-8c1d-ec22efb767b9-plugins-config-volume\") pod \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") "
Sep 10 22:41:21.776412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.776170    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j2m9k\" (UniqueName: \"kubernetes.io/projected/b3571c93-5ac7-489a-8c1d-ec22efb767b9-kube-api-access-j2m9k\") pod \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\" (UID: \"b3571c93-5ac7-489a-8c1d-ec22efb767b9\") "
Sep 10 22:41:21.776468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.776430    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/64dd22da-3fed-4caf-9b07-6dacfda68595-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "64dd22da-3fed-4caf-9b07-6dacfda68595" (UID: "64dd22da-3fed-4caf-9b07-6dacfda68595"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:21.776538 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.776454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" (UID: "e8f85283-d176-47b0-9ab6-f6ef50e0e9a3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:21.776538 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.776491    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3571c93-5ac7-489a-8c1d-ec22efb767b9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b3571c93-5ac7-489a-8c1d-ec22efb767b9" (UID: "b3571c93-5ac7-489a-8c1d-ec22efb767b9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:41:21.776681 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.776533    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7ptz\" (UniqueName: \"kubernetes.io/projected/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-kube-api-access-w7ptz\") pod \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\" (UID: \"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3\") "
Sep 10 22:41:21.777109 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.777085    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.777224 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.777112    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/64dd22da-3fed-4caf-9b07-6dacfda68595-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.777224 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.777127    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b3571c93-5ac7-489a-8c1d-ec22efb767b9-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.778284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.778256    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "64dd22da-3fed-4caf-9b07-6dacfda68595" (UID: "64dd22da-3fed-4caf-9b07-6dacfda68595"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:41:21.778363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.778297    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "64dd22da-3fed-4caf-9b07-6dacfda68595" (UID: "64dd22da-3fed-4caf-9b07-6dacfda68595"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:41:21.778363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.778312    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/64dd22da-3fed-4caf-9b07-6dacfda68595-kube-api-access-wt2r6" (OuterVolumeSpecName: "kube-api-access-wt2r6") pod "64dd22da-3fed-4caf-9b07-6dacfda68595" (UID: "64dd22da-3fed-4caf-9b07-6dacfda68595"). InnerVolumeSpecName "kube-api-access-wt2r6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:21.778829 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.778813    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3571c93-5ac7-489a-8c1d-ec22efb767b9-kube-api-access-j2m9k" (OuterVolumeSpecName: "kube-api-access-j2m9k") pod "b3571c93-5ac7-489a-8c1d-ec22efb767b9" (UID: "b3571c93-5ac7-489a-8c1d-ec22efb767b9"). InnerVolumeSpecName "kube-api-access-j2m9k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:21.779016 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.779003    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-kube-api-access-w7ptz" (OuterVolumeSpecName: "kube-api-access-w7ptz") pod "e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" (UID: "e8f85283-d176-47b0-9ab6-f6ef50e0e9a3"). InnerVolumeSpecName "kube-api-access-w7ptz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:41:21.878138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.878053    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2m9k\" (UniqueName: \"kubernetes.io/projected/b3571c93-5ac7-489a-8c1d-ec22efb767b9-kube-api-access-j2m9k\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.878138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.878081    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7ptz\" (UniqueName: \"kubernetes.io/projected/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3-kube-api-access-w7ptz\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.878138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.878094    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.878138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.878102    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/64dd22da-3fed-4caf-9b07-6dacfda68595-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.878138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.878110    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wt2r6\" (UniqueName: \"kubernetes.io/projected/64dd22da-3fed-4caf-9b07-6dacfda68595-kube-api-access-wt2r6\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:41:21.995273 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.995234    2582 generic.go:356] "Generic (PLEG): container finished" podID="b3571c93-5ac7-489a-8c1d-ec22efb767b9" containerID="f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1" exitCode=0
Sep 10 22:41:21.995427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.995277    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"
Sep 10 22:41:21.995427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.995315    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg" event={"ID":"b3571c93-5ac7-489a-8c1d-ec22efb767b9","Type":"ContainerDied","Data":"f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1"}
Sep 10 22:41:21.995427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.995370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg" event={"ID":"b3571c93-5ac7-489a-8c1d-ec22efb767b9","Type":"ContainerDied","Data":"3cb5aa737527f9898b64c031f9cc8d1f056ac37fe662fa24692dd31b1e34049a"}
Sep 10 22:41:21.995427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.995392    2582 scope.go:117] "RemoveContainer" containerID="f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1"
Sep 10 22:41:21.996774 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.996739    2582 generic.go:356] "Generic (PLEG): container finished" podID="e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" containerID="b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af" exitCode=0
Sep 10 22:41:21.997050 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.996777    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"
Sep 10 22:41:21.997050 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.996829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h" event={"ID":"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3","Type":"ContainerDied","Data":"b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af"}
Sep 10 22:41:21.997050 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.996875    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h" event={"ID":"e8f85283-d176-47b0-9ab6-f6ef50e0e9a3","Type":"ContainerDied","Data":"67904efd4066fc4ebe7aede7e000477fb138b805318e9432aac99284e8ff2d0b"}
Sep 10 22:41:21.998288 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.998265    2582 generic.go:356] "Generic (PLEG): container finished" podID="64dd22da-3fed-4caf-9b07-6dacfda68595" containerID="90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3" exitCode=0
Sep 10 22:41:21.998288 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.998309    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" event={"ID":"64dd22da-3fed-4caf-9b07-6dacfda68595","Type":"ContainerDied","Data":"90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3"}
Sep 10 22:41:21.998490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.998347    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl" event={"ID":"64dd22da-3fed-4caf-9b07-6dacfda68595","Type":"ContainerDied","Data":"6792e011ce90df311a0ff03a4e93c961a5b7611ec167e9c58c775f467ab2c2ce"}
Sep 10 22:41:21.998490 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:21.998314    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"
Sep 10 22:41:22.006176 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.006155    2582 scope.go:117] "RemoveContainer" containerID="f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1"
Sep 10 22:41:22.006485 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:41:22.006468    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1\": container with ID starting with f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1 not found: ID does not exist" containerID="f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1"
Sep 10 22:41:22.006561 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.006493    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1"} err="failed to get container status \"f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1\": rpc error: code = NotFound desc = could not find container \"f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1\": container with ID starting with f8a992088fedbbcb8dcd32475ccb20aa7cc21c9fa4d3d7ad643eefc4887176f1 not found: ID does not exist"
Sep 10 22:41:22.006561 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.006509    2582 scope.go:117] "RemoveContainer" containerID="b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af"
Sep 10 22:41:22.014663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.014643    2582 scope.go:117] "RemoveContainer" containerID="b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af"
Sep 10 22:41:22.014921 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:41:22.014903    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af\": container with ID starting with b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af not found: ID does not exist" containerID="b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af"
Sep 10 22:41:22.015013 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.014936    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af"} err="failed to get container status \"b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af\": rpc error: code = NotFound desc = could not find container \"b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af\": container with ID starting with b142a5a6d81fc9ad67d6a79c6552b78ba9a3ebef35b360a532baadec94fd09af not found: ID does not exist"
Sep 10 22:41:22.015013 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.014952    2582 scope.go:117] "RemoveContainer" containerID="90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3"
Sep 10 22:41:22.020200 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.020182    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"]
Sep 10 22:41:22.023470 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.023449    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-03e78e-c89f98bdb-xfgxg"]
Sep 10 22:41:22.024988 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.024966    2582 scope.go:117] "RemoveContainer" containerID="90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3"
Sep 10 22:41:22.025252 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:41:22.025235    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3\": container with ID starting with 90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3 not found: ID does not exist" containerID="90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3"
Sep 10 22:41:22.025325 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.025261    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3"} err="failed to get container status \"90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3\": rpc error: code = NotFound desc = could not find container \"90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3\": container with ID starting with 90564acddd854e9a8b425cb6d17c041292f56486ce14c6d72ba3dfec7b696cb3 not found: ID does not exist"
Sep 10 22:41:22.040089 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.040048    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"]
Sep 10 22:41:22.046128 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.046104    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-03e78e-796644d5c-6mzcl"]
Sep 10 22:41:22.058852 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.058815    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="64dd22da-3fed-4caf-9b07-6dacfda68595" path="/var/lib/kubelet/pods/64dd22da-3fed-4caf-9b07-6dacfda68595/volumes"
Sep 10 22:41:22.059476 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.059449    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3571c93-5ac7-489a-8c1d-ec22efb767b9" path="/var/lib/kubelet/pods/b3571c93-5ac7-489a-8c1d-ec22efb767b9/volumes"
Sep 10 22:41:22.061341 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.061317    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"]
Sep 10 22:41:22.065696 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:22.065673    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-03e78e-95fc55df9-z964h"]
Sep 10 22:41:24.052586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:24.052555    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" path="/var/lib/kubelet/pods/e8f85283-d176-47b0-9ab6-f6ef50e0e9a3/volumes"
Sep 10 22:41:31.546335 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546302    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"]
Sep 10 22:41:31.546854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546786    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" containerName="payload-processing"
Sep 10 22:41:31.546854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546800    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" containerName="payload-processing"
Sep 10 22:41:31.546854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546817    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="64dd22da-3fed-4caf-9b07-6dacfda68595" containerName="maas-api"
Sep 10 22:41:31.546854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546822    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="64dd22da-3fed-4caf-9b07-6dacfda68595" containerName="maas-api"
Sep 10 22:41:31.546854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546842    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3571c93-5ac7-489a-8c1d-ec22efb767b9" containerName="payload-pre-processing"
Sep 10 22:41:31.546854 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546848    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3571c93-5ac7-489a-8c1d-ec22efb767b9" containerName="payload-pre-processing"
Sep 10 22:41:31.547103 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546910    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="64dd22da-3fed-4caf-9b07-6dacfda68595" containerName="maas-api"
Sep 10 22:41:31.547103 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546921    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8f85283-d176-47b0-9ab6-f6ef50e0e9a3" containerName="payload-processing"
Sep 10 22:41:31.547103 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.546939    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3571c93-5ac7-489a-8c1d-ec22efb767b9" containerName="payload-pre-processing"
Sep 10 22:41:31.551643 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.551595    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.554304 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.554279    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"kube-root-ca.crt\""
Sep 10 22:41:31.555089 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.555070    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"rate-test-model-58cd39-kserve-self-signed-certs\""
Sep 10 22:41:31.555187 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.555102    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"openshift-service-ca.crt\""
Sep 10 22:41:31.555242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.555189    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-58cd39\"/\"default-dockercfg-dr76r\""
Sep 10 22:41:31.562657 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.562616    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"]
Sep 10 22:41:31.680407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.680375    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-model-cache\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.680598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.680422    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-home\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.680598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.680524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-tmp-dir\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.680598 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.680579    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5228fa8f-2837-4e29-907b-740e19f9bc6a-tls-certs\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.680753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.680663    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-dshm\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.680753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.680698    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs8rt\" (UniqueName: \"kubernetes.io/projected/5228fa8f-2837-4e29-907b-740e19f9bc6a-kube-api-access-vs8rt\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.781735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.781698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5228fa8f-2837-4e29-907b-740e19f9bc6a-tls-certs\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.781960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.781752    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-dshm\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.781960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.781886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs8rt\" (UniqueName: \"kubernetes.io/projected/5228fa8f-2837-4e29-907b-740e19f9bc6a-kube-api-access-vs8rt\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.782084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.782009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-model-cache\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.782084 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.782057    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-home\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.782196 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.782093    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-tmp-dir\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.782350 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.782330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-model-cache\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.782411 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.782381    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-tmp-dir\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.782467 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.782410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-home\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.784148 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.784129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-dshm\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.784521 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.784500    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5228fa8f-2837-4e29-907b-740e19f9bc6a-tls-certs\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.790467 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.790446    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs8rt\" (UniqueName: \"kubernetes.io/projected/5228fa8f-2837-4e29-907b-740e19f9bc6a-kube-api-access-vs8rt\") pod \"rate-test-model-58cd39-kserve-59f7f48747-896nt\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") " pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:31.861817 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:31.861724    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:32.136778 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:32.136710    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"]
Sep 10 22:41:32.139083 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:41:32.139054    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5228fa8f_2837_4e29_907b_740e19f9bc6a.slice/crio-5844692c32f2637bd12e96e4d479a7e93bd91e1d5fb5038c5acf2bf9553c201e WatchSource:0}: Error finding container 5844692c32f2637bd12e96e4d479a7e93bd91e1d5fb5038c5acf2bf9553c201e: Status 404 returned error can't find the container with id 5844692c32f2637bd12e96e4d479a7e93bd91e1d5fb5038c5acf2bf9553c201e
Sep 10 22:41:33.060572 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:33.060541    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt" event={"ID":"5228fa8f-2837-4e29-907b-740e19f9bc6a","Type":"ContainerStarted","Data":"3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e"}
Sep 10 22:41:33.060984 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:33.060583    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt" event={"ID":"5228fa8f-2837-4e29-907b-740e19f9bc6a","Type":"ContainerStarted","Data":"5844692c32f2637bd12e96e4d479a7e93bd91e1d5fb5038c5acf2bf9553c201e"}
Sep 10 22:41:33.080014 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:33.079964    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt" podStartSLOduration=2.079945651 podStartE2EDuration="2.079945651s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:41:33.07792628 +0000 UTC m=+1393.489050401" watchObservedRunningTime="2026-09-10 22:41:33.079945651 +0000 UTC m=+1393.491069747"
Sep 10 22:41:41.862380 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:41.862342    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:41.862860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:41.862401    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:41.874980 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:41.874937    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:41:42.115643 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:41:42.115527    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:42:07.861973 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:07.861938    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"]
Sep 10 22:42:07.862573 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:07.862217    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" containerID="cri-o://22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf" gracePeriod=30
Sep 10 22:42:12.257886 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:12.257679    2582 patch_prober.go:28] interesting pod/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:42:12.257886 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:12.257766    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:42:13.115732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.115693    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:42:13.200779 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-data\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200779 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200737    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-token\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200827    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flq94\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-kube-api-access-flq94\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200856    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00450bcf-beac-4a10-9697-638f67fbd4f4-istiod-ca-cert\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200885    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-certs\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200909    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-credential-socket\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200945    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-socket\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.200986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200977    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-podinfo\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.201284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.200986    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:42:13.201284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.201003    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-envoy\") pod \"00450bcf-beac-4a10-9697-638f67fbd4f4\" (UID: \"00450bcf-beac-4a10-9697-638f67fbd4f4\") "
Sep 10 22:42:13.201284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.201253    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:42:13.201435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.201281    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:42:13.201435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.201309    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.201435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.201369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00450bcf-beac-4a10-9697-638f67fbd4f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:13.201708 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.201554    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:42:13.203359 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.203330    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-kube-api-access-flq94" (OuterVolumeSpecName: "kube-api-access-flq94") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "kube-api-access-flq94". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:13.203487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.203372    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:42:13.203487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.203426    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:13.203768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.203752    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "00450bcf-beac-4a10-9697-638f67fbd4f4" (UID: "00450bcf-beac-4a10-9697-638f67fbd4f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:42:13.267402 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.267369    2582 generic.go:356] "Generic (PLEG): container finished" podID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerID="22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf" exitCode=0
Sep 10 22:42:13.267839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.267422    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"
Sep 10 22:42:13.267839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.267461    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" event={"ID":"00450bcf-beac-4a10-9697-638f67fbd4f4","Type":"ContainerDied","Data":"22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf"}
Sep 10 22:42:13.267839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.267542    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4" event={"ID":"00450bcf-beac-4a10-9697-638f67fbd4f4","Type":"ContainerDied","Data":"12851875f88868969d16f58191c7bb3a92713655569e456d7aeddf9dbbeaf9d4"}
Sep 10 22:42:13.267839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.267564    2582 scope.go:117] "RemoveContainer" containerID="22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf"
Sep 10 22:42:13.277127 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.277108    2582 scope.go:117] "RemoveContainer" containerID="f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"
Sep 10 22:42:13.285680 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.285664    2582 scope.go:117] "RemoveContainer" containerID="22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf"
Sep 10 22:42:13.285969 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:42:13.285950    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf\": container with ID starting with 22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf not found: ID does not exist" containerID="22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf"
Sep 10 22:42:13.286036 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.285979    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf"} err="failed to get container status \"22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf\": rpc error: code = NotFound desc = could not find container \"22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf\": container with ID starting with 22f6c4af4623aaa904ca364630dbe3ec67ce555b954fba09ece89f164181ffaf not found: ID does not exist"
Sep 10 22:42:13.286036 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.285998    2582 scope.go:117] "RemoveContainer" containerID="f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"
Sep 10 22:42:13.286276 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:42:13.286259    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9\": container with ID starting with f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9 not found: ID does not exist" containerID="f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"
Sep 10 22:42:13.286321 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.286281    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9"} err="failed to get container status \"f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9\": rpc error: code = NotFound desc = could not find container \"f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9\": container with ID starting with f1cad1eb42bdd705f7f7419970e4fc77cd18968461aba0966c33c956311795b9 not found: ID does not exist"
Sep 10 22:42:13.289387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.289362    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"]
Sep 10 22:42:13.293359 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.293340    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-7a7e94-openshift-default-5c6d8c98f6-67rr4"]
Sep 10 22:42:13.302695 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302673    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flq94\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-kube-api-access-flq94\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302697    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/00450bcf-beac-4a10-9697-638f67fbd4f4-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302708    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302716    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302724    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302734    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302742    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:13.302780 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:13.302750    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/00450bcf-beac-4a10-9697-638f67fbd4f4-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:14.051926 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:14.051892    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" path="/var/lib/kubelet/pods/00450bcf-beac-4a10-9697-638f67fbd4f4/volumes"
Sep 10 22:42:18.822469 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:18.822436    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"]
Sep 10 22:42:18.823017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:18.822842    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" podUID="7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" containerName="maas-api" containerID="cri-o://5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114" gracePeriod=30
Sep 10 22:42:19.089317 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.089251    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:42:19.263664 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.263602    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drhf4\" (UniqueName: \"kubernetes.io/projected/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-kube-api-access-drhf4\") pod \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") "
Sep 10 22:42:19.263898 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.263668    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls\") pod \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") "
Sep 10 22:42:19.263898 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.263747    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-openshift-service-ca\") pod \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") "
Sep 10 22:42:19.263898 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.263799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-metrics-certs\") pod \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\" (UID: \"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45\") "
Sep 10 22:42:19.264415 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.264380    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" (UID: "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:42:19.266545 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.266502    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" (UID: "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:42:19.266702 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.266609    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-kube-api-access-drhf4" (OuterVolumeSpecName: "kube-api-access-drhf4") pod "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" (UID: "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45"). InnerVolumeSpecName "kube-api-access-drhf4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:42:19.266702 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.266653    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" (UID: "7e0eecd4-b631-4a03-8d81-f8c4c3fbca45"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:42:19.302563 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.302528    2582 generic.go:356] "Generic (PLEG): container finished" podID="7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" containerID="5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114" exitCode=0
Sep 10 22:42:19.302790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.302584    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" event={"ID":"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45","Type":"ContainerDied","Data":"5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114"}
Sep 10 22:42:19.302790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.302590    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"
Sep 10 22:42:19.302790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.302668    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5" event={"ID":"7e0eecd4-b631-4a03-8d81-f8c4c3fbca45","Type":"ContainerDied","Data":"df44a15c159056ea03c0e324e748b48c0a178eeaf5bf47c3415d8a107f697591"}
Sep 10 22:42:19.302790 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.302700    2582 scope.go:117] "RemoveContainer" containerID="5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114"
Sep 10 22:42:19.314728 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.314704    2582 scope.go:117] "RemoveContainer" containerID="5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114"
Sep 10 22:42:19.315102 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:42:19.315081    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114\": container with ID starting with 5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114 not found: ID does not exist" containerID="5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114"
Sep 10 22:42:19.315168 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.315112    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114"} err="failed to get container status \"5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114\": rpc error: code = NotFound desc = could not find container \"5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114\": container with ID starting with 5798de14e9af10f29cb76697a15b482127cc63c388f8a6946006c09f94179114 not found: ID does not exist"
Sep 10 22:42:19.337475 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.337442    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"]
Sep 10 22:42:19.363153 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.363058    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-25e5bd-555c4697f4-9s8r5"]
Sep 10 22:42:19.364996 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.364968    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.364996 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.364994    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drhf4\" (UniqueName: \"kubernetes.io/projected/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-kube-api-access-drhf4\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.365173 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.365003    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:19.365173 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:19.365012    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:42:20.053138 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:20.053106    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" path="/var/lib/kubelet/pods/7e0eecd4-b631-4a03-8d81-f8c4c3fbca45/volumes"
Sep 10 22:42:52.972080 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:52.972047    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"]
Sep 10 22:42:58.904371 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904296    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"]
Sep 10 22:42:58.904771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904719    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" containerName="maas-api"
Sep 10 22:42:58.904771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904730    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" containerName="maas-api"
Sep 10 22:42:58.904771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904753    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy"
Sep 10 22:42:58.904771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904760    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy"
Sep 10 22:42:58.904771 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904769    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy"
Sep 10 22:42:58.905014 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904775    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy"
Sep 10 22:42:58.905014 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904840    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy"
Sep 10 22:42:58.905014 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.904848    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e0eecd4-b631-4a03-8d81-f8c4c3fbca45" containerName="maas-api"
Sep 10 22:42:58.908077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.908062    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:58.912781 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.912758    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-16d0fd-serving-cert\""
Sep 10 22:42:58.922545 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:58.922520    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"]
Sep 10 22:42:59.044501 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.044468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-metrics-certs\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.044686 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.044538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.044686 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.044570    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.044686 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.044673    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlg8l\" (UniqueName: \"kubernetes.io/projected/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-kube-api-access-nlg8l\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.145545 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.145512    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-metrics-certs\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.145727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.145566    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.145727 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.145689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.145823 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.145787    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlg8l\" (UniqueName: \"kubernetes.io/projected/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-kube-api-access-nlg8l\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.146367 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.146340    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.148157 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.148134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-metrics-certs\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.148255 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.148172    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-maas-api-tls\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.154474 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.154419    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlg8l\" (UniqueName: \"kubernetes.io/projected/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-kube-api-access-nlg8l\") pod \"maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.217994 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.217960    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:42:59.517592 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.517555    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"]
Sep 10 22:42:59.519988 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:42:59.519964    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb21edd3_3f12_43de_96ad_81ae0f8d81e2.slice/crio-f5dc5dcae25be5b354347f329f146d5911a79d4802422ce7cd88f9e26e5341e1 WatchSource:0}: Error finding container f5dc5dcae25be5b354347f329f146d5911a79d4802422ce7cd88f9e26e5341e1: Status 404 returned error can't find the container with id f5dc5dcae25be5b354347f329f146d5911a79d4802422ce7cd88f9e26e5341e1
Sep 10 22:42:59.521564 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:42:59.521545    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:43:00.520024 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:00.519986    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd" event={"ID":"cb21edd3-3f12-43de-96ad-81ae0f8d81e2","Type":"ContainerStarted","Data":"5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000"}
Sep 10 22:43:00.520449 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:00.520042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd" event={"ID":"cb21edd3-3f12-43de-96ad-81ae0f8d81e2","Type":"ContainerStarted","Data":"f5dc5dcae25be5b354347f329f146d5911a79d4802422ce7cd88f9e26e5341e1"}
Sep 10 22:43:00.520449 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:00.520074    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:43:00.538755 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:00.538696    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd" podStartSLOduration=2.098830803 podStartE2EDuration="2.538676403s" totalImagesPullingTime="439.8456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:42:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:43:00.538484501 +0000 UTC m=+1480.949608603" watchObservedRunningTime="2026-09-10 22:43:00.538676403 +0000 UTC m=+1480.949800502"
Sep 10 22:43:06.531250 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:06.531221    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:43:07.991950 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:07.991912    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt" podUID="5228fa8f-2837-4e29-907b-740e19f9bc6a" containerName="main" containerID="cri-o://3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e" gracePeriod=45
Sep 10 22:43:08.243360 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.243295    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:43:08.336331 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336298    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-tmp-dir\") pod \"5228fa8f-2837-4e29-907b-740e19f9bc6a\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") "
Sep 10 22:43:08.336519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336368    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-home\") pod \"5228fa8f-2837-4e29-907b-740e19f9bc6a\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") "
Sep 10 22:43:08.336519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs8rt\" (UniqueName: \"kubernetes.io/projected/5228fa8f-2837-4e29-907b-740e19f9bc6a-kube-api-access-vs8rt\") pod \"5228fa8f-2837-4e29-907b-740e19f9bc6a\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") "
Sep 10 22:43:08.336519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336417    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5228fa8f-2837-4e29-907b-740e19f9bc6a-tls-certs\") pod \"5228fa8f-2837-4e29-907b-740e19f9bc6a\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") "
Sep 10 22:43:08.336519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336438    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-model-cache\") pod \"5228fa8f-2837-4e29-907b-740e19f9bc6a\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") "
Sep 10 22:43:08.336519 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336457    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-dshm\") pod \"5228fa8f-2837-4e29-907b-740e19f9bc6a\" (UID: \"5228fa8f-2837-4e29-907b-740e19f9bc6a\") "
Sep 10 22:43:08.336811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336586    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5228fa8f-2837-4e29-907b-740e19f9bc6a" (UID: "5228fa8f-2837-4e29-907b-740e19f9bc6a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:08.336811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336754    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-model-cache" (OuterVolumeSpecName: "model-cache") pod "5228fa8f-2837-4e29-907b-740e19f9bc6a" (UID: "5228fa8f-2837-4e29-907b-740e19f9bc6a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:08.336811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336772    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-home" (OuterVolumeSpecName: "home") pod "5228fa8f-2837-4e29-907b-740e19f9bc6a" (UID: "5228fa8f-2837-4e29-907b-740e19f9bc6a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:08.336935 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336863    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-tmp-dir\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:43:08.336935 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.336884    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-model-cache\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:43:08.338888 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.338850    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-dshm" (OuterVolumeSpecName: "dshm") pod "5228fa8f-2837-4e29-907b-740e19f9bc6a" (UID: "5228fa8f-2837-4e29-907b-740e19f9bc6a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:43:08.339022 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.338917    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5228fa8f-2837-4e29-907b-740e19f9bc6a-kube-api-access-vs8rt" (OuterVolumeSpecName: "kube-api-access-vs8rt") pod "5228fa8f-2837-4e29-907b-740e19f9bc6a" (UID: "5228fa8f-2837-4e29-907b-740e19f9bc6a"). InnerVolumeSpecName "kube-api-access-vs8rt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:43:08.339022 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.338943    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5228fa8f-2837-4e29-907b-740e19f9bc6a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5228fa8f-2837-4e29-907b-740e19f9bc6a" (UID: "5228fa8f-2837-4e29-907b-740e19f9bc6a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:43:08.438118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.438083    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-home\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:43:08.438118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.438112    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs8rt\" (UniqueName: \"kubernetes.io/projected/5228fa8f-2837-4e29-907b-740e19f9bc6a-kube-api-access-vs8rt\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:43:08.438118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.438124    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5228fa8f-2837-4e29-907b-740e19f9bc6a-tls-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:43:08.438118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.438132    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5228fa8f-2837-4e29-907b-740e19f9bc6a-dshm\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:43:08.565457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.565363    2582 generic.go:356] "Generic (PLEG): container finished" podID="5228fa8f-2837-4e29-907b-740e19f9bc6a" containerID="3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e" exitCode=0
Sep 10 22:43:08.565457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.565411    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"
Sep 10 22:43:08.565666 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.565454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt" event={"ID":"5228fa8f-2837-4e29-907b-740e19f9bc6a","Type":"ContainerDied","Data":"3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e"}
Sep 10 22:43:08.565666 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.565501    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt" event={"ID":"5228fa8f-2837-4e29-907b-740e19f9bc6a","Type":"ContainerDied","Data":"5844692c32f2637bd12e96e4d479a7e93bd91e1d5fb5038c5acf2bf9553c201e"}
Sep 10 22:43:08.565666 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.565519    2582 scope.go:117] "RemoveContainer" containerID="3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e"
Sep 10 22:43:08.574668 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.574649    2582 scope.go:117] "RemoveContainer" containerID="3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e"
Sep 10 22:43:08.574963 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:43:08.574943    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e\": container with ID starting with 3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e not found: ID does not exist" containerID="3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e"
Sep 10 22:43:08.575013 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.574971    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e"} err="failed to get container status \"3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e\": rpc error: code = NotFound desc = could not find container \"3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e\": container with ID starting with 3ce94f7724ed4bd19e43e02c8fc8684c50916bae6227d5923c23fe933815132e not found: ID does not exist"
Sep 10 22:43:08.593382 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.588267    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"]
Sep 10 22:43:08.596920 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:08.596890    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-58cd39/rate-test-model-58cd39-kserve-59f7f48747-896nt"]
Sep 10 22:43:10.052376 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:10.052345    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5228fa8f-2837-4e29-907b-740e19f9bc6a" path="/var/lib/kubelet/pods/5228fa8f-2837-4e29-907b-740e19f9bc6a/volumes"
Sep 10 22:43:28.761796 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.761749    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"]
Sep 10 22:43:28.762347 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.762327    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5228fa8f-2837-4e29-907b-740e19f9bc6a" containerName="main"
Sep 10 22:43:28.762428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.762350    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5228fa8f-2837-4e29-907b-740e19f9bc6a" containerName="main"
Sep 10 22:43:28.762487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.762457    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5228fa8f-2837-4e29-907b-740e19f9bc6a" containerName="main"
Sep 10 22:43:28.762487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.762471    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="00450bcf-beac-4a10-9697-638f67fbd4f4" containerName="istio-proxy"
Sep 10 22:43:28.766900 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.766878    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:28.769428 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.769408    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-d28770\""
Sep 10 22:43:28.769534 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.769484    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-d28770-dockercfg-r29br\""
Sep 10 22:43:28.777099 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.777074    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"]
Sep 10 22:43:28.838166 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.838122    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:28.838342 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.838216    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v7qdd\" (UniqueName: \"kubernetes.io/projected/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-kube-api-access-v7qdd\") pod \"payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:28.939031 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.938992    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:28.939230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.939040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v7qdd\" (UniqueName: \"kubernetes.io/projected/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-kube-api-access-v7qdd\") pod \"payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:28.939710 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.939684    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:28.947182 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:28.947149    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v7qdd\" (UniqueName: \"kubernetes.io/projected/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-kube-api-access-v7qdd\") pod \"payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:29.078763 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:29.078663    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:29.351093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:29.351017    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"]
Sep 10 22:43:29.354191 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:43:29.354165    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode167894c_67b6_4413_a6a3_eaf1a4ff85bd.slice/crio-a4efb06324b916bbea0d581b587b5b7b105f502ffb2d840309c9f55b114742d5 WatchSource:0}: Error finding container a4efb06324b916bbea0d581b587b5b7b105f502ffb2d840309c9f55b114742d5: Status 404 returned error can't find the container with id a4efb06324b916bbea0d581b587b5b7b105f502ffb2d840309c9f55b114742d5
Sep 10 22:43:29.685577 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:29.685490    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf" event={"ID":"e167894c-67b6-4413-a6a3-eaf1a4ff85bd","Type":"ContainerStarted","Data":"8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b"}
Sep 10 22:43:29.685577 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:29.685540    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf" event={"ID":"e167894c-67b6-4413-a6a3-eaf1a4ff85bd","Type":"ContainerStarted","Data":"a4efb06324b916bbea0d581b587b5b7b105f502ffb2d840309c9f55b114742d5"}
Sep 10 22:43:29.685816 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:29.685602    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:43:29.705569 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:29.705516    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf" podStartSLOduration=1.7055017540000001 podStartE2EDuration="1.705501754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:43:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:43:29.704516885 +0000 UTC m=+1510.115640999" watchObservedRunningTime="2026-09-10 22:43:29.705501754 +0000 UTC m=+1510.116625851"
Sep 10 22:43:40.692826 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:43:40.692796    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:44:38.370767 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.370733    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"]
Sep 10 22:44:38.374167 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.374145    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.377503 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.377474    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-6b8825-openshift-default-dockercfg-shwsw\""
Sep 10 22:44:38.384749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384529    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-certs\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.384749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384573    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rvtq\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-kube-api-access-6rvtq\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.384749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-token\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.384749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384649    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc76e72a-0692-4d67-acf3-15e962f04bcb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.384749 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-envoy\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.385185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-credential-socket\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.385185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-socket\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.385185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384885    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-data\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.385185 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.384935    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-podinfo\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.387469 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.387441    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"]
Sep 10 22:44:38.486181 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-podinfo\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486237    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-certs\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rvtq\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-kube-api-access-6rvtq\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-token\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc76e72a-0692-4d67-acf3-15e962f04bcb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486332    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-envoy\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486380    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-credential-socket\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-socket\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.486735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.486442    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-data\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.487164 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.487123    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-certs\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.487267 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.487219    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-data\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.487474 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.487412    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-credential-socket\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.494879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.487798    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-socket\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.494879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.487827    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc76e72a-0692-4d67-acf3-15e962f04bcb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.494879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.489485    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-podinfo\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.494879 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.489892    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-envoy\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.498568 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.498519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-token\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.498701 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.498588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rvtq\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-kube-api-access-6rvtq\") pod \"e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") " pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.686137 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.686036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:38.966787 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.966757    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"]
Sep 10 22:44:38.969026 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:44:38.968991    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc76e72a_0692_4d67_acf3_15e962f04bcb.slice/crio-fd06e5972e2073d0282af4ab97ed973569d16a40114eeb9fb3b1bb7a11a40854 WatchSource:0}: Error finding container fd06e5972e2073d0282af4ab97ed973569d16a40114eeb9fb3b1bb7a11a40854: Status 404 returned error can't find the container with id fd06e5972e2073d0282af4ab97ed973569d16a40114eeb9fb3b1bb7a11a40854
Sep 10 22:44:38.971506 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.971466    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:44:38.971610 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.971572    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:44:38.971711 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:38.971640    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:44:39.035302 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:39.035266    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" event={"ID":"fc76e72a-0692-4d67-acf3-15e962f04bcb","Type":"ContainerStarted","Data":"fd06e5972e2073d0282af4ab97ed973569d16a40114eeb9fb3b1bb7a11a40854"}
Sep 10 22:44:40.042952 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:40.042907    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" event={"ID":"fc76e72a-0692-4d67-acf3-15e962f04bcb","Type":"ContainerStarted","Data":"a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"}
Sep 10 22:44:40.063451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:40.063393    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podStartSLOduration=2.063375045 podStartE2EDuration="2.063375045s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:44:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:44:40.06096592 +0000 UTC m=+1580.472090044" watchObservedRunningTime="2026-09-10 22:44:40.063375045 +0000 UTC m=+1580.474499141"
Sep 10 22:44:40.686789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:40.686754    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:40.692570 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:40.692546    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:41.048492 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:41.048449    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:41.049592 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:41.049573    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:44:43.267160 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.267117    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"]
Sep 10 22:44:43.271082 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.271056    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.274313 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.274288    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-6b8825-serving-cert\""
Sep 10 22:44:43.297459 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.297423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"]
Sep 10 22:44:43.335105 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.335070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.335284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.335126    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.335284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.335224    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcfjf\" (UniqueName: \"kubernetes.io/projected/ad60e807-10b6-4328-9013-761d74de1b8a-kube-api-access-dcfjf\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.335284 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.335255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e807-10b6-4328-9013-761d74de1b8a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.436358 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.436321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcfjf\" (UniqueName: \"kubernetes.io/projected/ad60e807-10b6-4328-9013-761d74de1b8a-kube-api-access-dcfjf\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.436358 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.436360    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e807-10b6-4328-9013-761d74de1b8a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.436583 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.436415    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.436583 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.436450    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.436687 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:44:43.436602    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-serving-cert: secret "maas-api-e2e-ipp-cleanup-6b8825-serving-cert" not found
Sep 10 22:44:43.436721 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:44:43.436707    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls podName:ad60e807-10b6-4328-9013-761d74de1b8a nodeName:}" failed. No retries permitted until 2026-09-10 22:44:43.936684111 +0000 UTC m=+1584.347808186 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" (UID: "ad60e807-10b6-4328-9013-761d74de1b8a") : secret "maas-api-e2e-ipp-cleanup-6b8825-serving-cert" not found
Sep 10 22:44:43.437215 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.437147    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e807-10b6-4328-9013-761d74de1b8a-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.439075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.439053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.449545 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.449519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcfjf\" (UniqueName: \"kubernetes.io/projected/ad60e807-10b6-4328-9013-761d74de1b8a-kube-api-access-dcfjf\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.942390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.942355    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:43.945077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:43.945050    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:44.182097 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:44.182053    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:44.460413 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:44.460276    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"]
Sep 10 22:44:44.463199 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:44:44.463173    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad60e807_10b6_4328_9013_761d74de1b8a.slice/crio-14d2b2371545183a631e2a4bb480f141035a3e7db97a64c31fa061e3e38a9e85 WatchSource:0}: Error finding container 14d2b2371545183a631e2a4bb480f141035a3e7db97a64c31fa061e3e38a9e85: Status 404 returned error can't find the container with id 14d2b2371545183a631e2a4bb480f141035a3e7db97a64c31fa061e3e38a9e85
Sep 10 22:44:45.071499 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:45.071395    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" event={"ID":"ad60e807-10b6-4328-9013-761d74de1b8a","Type":"ContainerStarted","Data":"20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931"}
Sep 10 22:44:45.071499 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:45.071483    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" event={"ID":"ad60e807-10b6-4328-9013-761d74de1b8a","Type":"ContainerStarted","Data":"14d2b2371545183a631e2a4bb480f141035a3e7db97a64c31fa061e3e38a9e85"}
Sep 10 22:44:45.071718 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:45.071508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:44:45.101292 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:45.101239    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" podStartSLOduration=1.7575804229999998 podStartE2EDuration="2.101222131s" totalImagesPullingTime="343.641708ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:44:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:44:45.100897607 +0000 UTC m=+1585.512021731" watchObservedRunningTime="2026-09-10 22:44:45.101222131 +0000 UTC m=+1585.512346280"
Sep 10 22:44:51.082078 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:44:51.082048    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:45:02.173543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:02.173441    2582 generic.go:356] "Generic (PLEG): container finished" podID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerID="a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679" exitCode=0
Sep 10 22:45:02.173543 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:02.173499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" event={"ID":"fc76e72a-0692-4d67-acf3-15e962f04bcb","Type":"ContainerDied","Data":"a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"}
Sep 10 22:45:02.174008 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:02.173916    2582 scope.go:117] "RemoveContainer" containerID="a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"
Sep 10 22:45:02.175231 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:02.175198    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:45:02.175302 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:02.175268    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:45:02.175302 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:02.175298    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 10 22:45:03.180610 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:03.180573    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" event={"ID":"fc76e72a-0692-4d67-acf3-15e962f04bcb","Type":"ContainerStarted","Data":"899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650"}
Sep 10 22:45:03.686531 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:03.686484    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:45:03.686833 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:03.686808    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 10 22:45:03.686946 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:03.686901    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 10 22:45:04.687421 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:04.687378    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 10 22:45:04.687864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:04.687441    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 10 22:45:05.686912 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:05.686876    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 10 22:45:05.687106 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:05.686940    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 10 22:45:06.686364 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:06.686327    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 10 22:45:06.686865 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:06.686389    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 10 22:45:07.687359 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:07.687323    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 10 22:45:07.687806 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:07.687377    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 10 22:45:08.691062 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:08.691030    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:45:08.691508 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:08.691386    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:45:08.692246 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:08.692228    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:45:13.714497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:13.714407    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"]
Sep 10 22:45:13.715087 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:13.714647    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" podUID="ad60e807-10b6-4328-9013-761d74de1b8a" containerName="maas-api" containerID="cri-o://20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931" gracePeriod=30
Sep 10 22:45:13.974776 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:13.974754    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:45:14.049229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.049195    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls\") pod \"ad60e807-10b6-4328-9013-761d74de1b8a\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") "
Sep 10 22:45:14.049229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.049230    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-metrics-certs\") pod \"ad60e807-10b6-4328-9013-761d74de1b8a\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") "
Sep 10 22:45:14.049510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.049266    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e807-10b6-4328-9013-761d74de1b8a-openshift-service-ca\") pod \"ad60e807-10b6-4328-9013-761d74de1b8a\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") "
Sep 10 22:45:14.049510 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.049300    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcfjf\" (UniqueName: \"kubernetes.io/projected/ad60e807-10b6-4328-9013-761d74de1b8a-kube-api-access-dcfjf\") pod \"ad60e807-10b6-4328-9013-761d74de1b8a\" (UID: \"ad60e807-10b6-4328-9013-761d74de1b8a\") "
Sep 10 22:45:14.049732 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.049701    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad60e807-10b6-4328-9013-761d74de1b8a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ad60e807-10b6-4328-9013-761d74de1b8a" (UID: "ad60e807-10b6-4328-9013-761d74de1b8a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:14.051688 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.051615    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad60e807-10b6-4328-9013-761d74de1b8a-kube-api-access-dcfjf" (OuterVolumeSpecName: "kube-api-access-dcfjf") pod "ad60e807-10b6-4328-9013-761d74de1b8a" (UID: "ad60e807-10b6-4328-9013-761d74de1b8a"). InnerVolumeSpecName "kube-api-access-dcfjf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:14.052042 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.052022    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ad60e807-10b6-4328-9013-761d74de1b8a" (UID: "ad60e807-10b6-4328-9013-761d74de1b8a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:45:14.052135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.052121    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ad60e807-10b6-4328-9013-761d74de1b8a" (UID: "ad60e807-10b6-4328-9013-761d74de1b8a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:45:14.150768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.150724    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcfjf\" (UniqueName: \"kubernetes.io/projected/ad60e807-10b6-4328-9013-761d74de1b8a-kube-api-access-dcfjf\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.150768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.150762    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.150768 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.150776    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ad60e807-10b6-4328-9013-761d74de1b8a-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.151031 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.150788    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ad60e807-10b6-4328-9013-761d74de1b8a-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:14.240321 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.240228    2582 generic.go:356] "Generic (PLEG): container finished" podID="ad60e807-10b6-4328-9013-761d74de1b8a" containerID="20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931" exitCode=0
Sep 10 22:45:14.240321 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.240277    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"
Sep 10 22:45:14.240493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.240319    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" event={"ID":"ad60e807-10b6-4328-9013-761d74de1b8a","Type":"ContainerDied","Data":"20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931"}
Sep 10 22:45:14.240493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.240376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl" event={"ID":"ad60e807-10b6-4328-9013-761d74de1b8a","Type":"ContainerDied","Data":"14d2b2371545183a631e2a4bb480f141035a3e7db97a64c31fa061e3e38a9e85"}
Sep 10 22:45:14.240493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.240398    2582 scope.go:117] "RemoveContainer" containerID="20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931"
Sep 10 22:45:14.249709 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.249689    2582 scope.go:117] "RemoveContainer" containerID="20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931"
Sep 10 22:45:14.250016 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:45:14.249997    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931\": container with ID starting with 20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931 not found: ID does not exist" containerID="20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931"
Sep 10 22:45:14.250089 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.250025    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931"} err="failed to get container status \"20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931\": rpc error: code = NotFound desc = could not find container \"20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931\": container with ID starting with 20d7b54fe903cf169fed6aa52b92cf1ea130623f517525adc4cd4febf8ede931 not found: ID does not exist"
Sep 10 22:45:14.257786 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.257764    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"]
Sep 10 22:45:14.262086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:14.262064    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-6b8825-5465fb69b-z6wsl"]
Sep 10 22:45:16.051677 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:16.051638    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad60e807-10b6-4328-9013-761d74de1b8a" path="/var/lib/kubelet/pods/ad60e807-10b6-4328-9013-761d74de1b8a/volumes"
Sep 10 22:45:20.379016 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:20.378977    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"]
Sep 10 22:45:20.379437 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:20.379244    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" containerID="cri-o://899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650" gracePeriod=30
Sep 10 22:45:23.693729 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:23.693688    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:45:23.694116 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:23.693748    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:45:25.625007 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.624982    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:45:25.665345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665260    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc76e72a-0692-4d67-acf3-15e962f04bcb-istiod-ca-cert\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665309    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-data\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665341    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-podinfo\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665377    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-socket\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665401    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-token\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665424    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-credential-socket\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665477    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-certs\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rvtq\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-kube-api-access-6rvtq\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.665663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665587    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-envoy\") pod \"fc76e72a-0692-4d67-acf3-15e962f04bcb\" (UID: \"fc76e72a-0692-4d67-acf3-15e962f04bcb\") "
Sep 10 22:45:25.666004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665691    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-data" (OuterVolumeSpecName: "istio-data") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:45:25.666004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665741    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc76e72a-0692-4d67-acf3-15e962f04bcb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:25.666004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665980    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fc76e72a-0692-4d67-acf3-15e962f04bcb-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.666004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.665998    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.666230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.666201    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:45:25.667401 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.666363    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:45:25.667576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.667550    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:45:25.668191 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.668162    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-kube-api-access-6rvtq" (OuterVolumeSpecName: "kube-api-access-6rvtq") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "kube-api-access-6rvtq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:25.668281 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.668186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-token" (OuterVolumeSpecName: "istio-token") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:25.668393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.668374    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:45:25.668393 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.668383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fc76e72a-0692-4d67-acf3-15e962f04bcb" (UID: "fc76e72a-0692-4d67-acf3-15e962f04bcb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:45:25.766931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766886    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rvtq\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-kube-api-access-6rvtq\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.766931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766917    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.766931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766935    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.766931 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766943    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.767205 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766953    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fc76e72a-0692-4d67-acf3-15e962f04bcb-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.767205 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766962    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:25.767205 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:25.766969    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fc76e72a-0692-4d67-acf3-15e962f04bcb-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:26.303073 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.303037    2582 generic.go:356] "Generic (PLEG): container finished" podID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerID="899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650" exitCode=0
Sep 10 22:45:26.303258 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.303084    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"
Sep 10 22:45:26.303258 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.303122    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" event={"ID":"fc76e72a-0692-4d67-acf3-15e962f04bcb","Type":"ContainerDied","Data":"899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650"}
Sep 10 22:45:26.303258 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.303173    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m" event={"ID":"fc76e72a-0692-4d67-acf3-15e962f04bcb","Type":"ContainerDied","Data":"fd06e5972e2073d0282af4ab97ed973569d16a40114eeb9fb3b1bb7a11a40854"}
Sep 10 22:45:26.303258 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.303196    2582 scope.go:117] "RemoveContainer" containerID="899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650"
Sep 10 22:45:26.312419 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.312405    2582 scope.go:117] "RemoveContainer" containerID="a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"
Sep 10 22:45:26.320899 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.320878    2582 scope.go:117] "RemoveContainer" containerID="899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650"
Sep 10 22:45:26.321221 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:45:26.321199    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650\": container with ID starting with 899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650 not found: ID does not exist" containerID="899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650"
Sep 10 22:45:26.321275 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.321234    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650"} err="failed to get container status \"899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650\": rpc error: code = NotFound desc = could not find container \"899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650\": container with ID starting with 899eea6644db16f59297ee79430244f06b228cbd3792942bb9b9c8e4a0e62650 not found: ID does not exist"
Sep 10 22:45:26.321275 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.321260    2582 scope.go:117] "RemoveContainer" containerID="a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"
Sep 10 22:45:26.321354 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.321289    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"]
Sep 10 22:45:26.321542 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:45:26.321524    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679\": container with ID starting with a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679 not found: ID does not exist" containerID="a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"
Sep 10 22:45:26.321587 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.321545    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679"} err="failed to get container status \"a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679\": rpc error: code = NotFound desc = could not find container \"a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679\": container with ID starting with a84fe9eef4908bfb551c875a54abe5f8eaa4384ef834114dc6a585fbe3205679 not found: ID does not exist"
Sep 10 22:45:26.324874 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:26.324850    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6b8825-openshift-default-56c6f94d4b-g286m"]
Sep 10 22:45:28.052143 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:28.052107    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" path="/var/lib/kubelet/pods/fc76e72a-0692-4d67-acf3-15e962f04bcb/volumes"
Sep 10 22:45:39.384040 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.384004    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"]
Sep 10 22:45:39.384487 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.384293    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd" podUID="cb21edd3-3f12-43de-96ad-81ae0f8d81e2" containerName="maas-api" containerID="cri-o://5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000" gracePeriod=30
Sep 10 22:45:39.644289 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.644230    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:45:39.800105 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.800076    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlg8l\" (UniqueName: \"kubernetes.io/projected/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-kube-api-access-nlg8l\") pod \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") "
Sep 10 22:45:39.800286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.800143    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-openshift-service-ca\") pod \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") "
Sep 10 22:45:39.800286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.800175    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-maas-api-tls\") pod \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") "
Sep 10 22:45:39.800286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.800240    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-metrics-certs\") pod \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\" (UID: \"cb21edd3-3f12-43de-96ad-81ae0f8d81e2\") "
Sep 10 22:45:39.800512 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.800486    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "cb21edd3-3f12-43de-96ad-81ae0f8d81e2" (UID: "cb21edd3-3f12-43de-96ad-81ae0f8d81e2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:45:39.800657 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.800609    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.802471 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.802436    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cb21edd3-3f12-43de-96ad-81ae0f8d81e2" (UID: "cb21edd3-3f12-43de-96ad-81ae0f8d81e2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:45:39.802585 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.802477    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-kube-api-access-nlg8l" (OuterVolumeSpecName: "kube-api-access-nlg8l") pod "cb21edd3-3f12-43de-96ad-81ae0f8d81e2" (UID: "cb21edd3-3f12-43de-96ad-81ae0f8d81e2"). InnerVolumeSpecName "kube-api-access-nlg8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:45:39.802585 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.802504    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "cb21edd3-3f12-43de-96ad-81ae0f8d81e2" (UID: "cb21edd3-3f12-43de-96ad-81ae0f8d81e2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:45:39.901183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.901097    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlg8l\" (UniqueName: \"kubernetes.io/projected/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-kube-api-access-nlg8l\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.901183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.901126    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:39.901183 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:39.901135    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb21edd3-3f12-43de-96ad-81ae0f8d81e2-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:45:40.373932 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.373896    2582 generic.go:356] "Generic (PLEG): container finished" podID="cb21edd3-3f12-43de-96ad-81ae0f8d81e2" containerID="5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000" exitCode=0
Sep 10 22:45:40.374108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.373946    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"
Sep 10 22:45:40.374108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.373987    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd" event={"ID":"cb21edd3-3f12-43de-96ad-81ae0f8d81e2","Type":"ContainerDied","Data":"5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000"}
Sep 10 22:45:40.374108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.374045    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd" event={"ID":"cb21edd3-3f12-43de-96ad-81ae0f8d81e2","Type":"ContainerDied","Data":"f5dc5dcae25be5b354347f329f146d5911a79d4802422ce7cd88f9e26e5341e1"}
Sep 10 22:45:40.374108 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.374068    2582 scope.go:117] "RemoveContainer" containerID="5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000"
Sep 10 22:45:40.383497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.383478    2582 scope.go:117] "RemoveContainer" containerID="5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000"
Sep 10 22:45:40.383825 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:45:40.383805    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000\": container with ID starting with 5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000 not found: ID does not exist" containerID="5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000"
Sep 10 22:45:40.383902 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.383835    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000"} err="failed to get container status \"5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000\": rpc error: code = NotFound desc = could not find container \"5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000\": container with ID starting with 5eeb6bee87633536ecc98bfd7919507ea8da88505d33d5b2dbf30e87f01ef000 not found: ID does not exist"
Sep 10 22:45:40.391686 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.391664    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"]
Sep 10 22:45:40.394804 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:40.394772    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-16d0fd-7cf574f67-4lwgd"]
Sep 10 22:45:42.053144 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:45:42.053096    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb21edd3-3f12-43de-96ad-81ae0f8d81e2" path="/var/lib/kubelet/pods/cb21edd3-3f12-43de-96ad-81ae0f8d81e2/volumes"
Sep 10 22:46:44.920086 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:44.919998    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"]
Sep 10 22:46:44.920734 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:44.920296    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf" podUID="e167894c-67b6-4413-a6a3-eaf1a4ff85bd" containerName="payload-pre-processing" containerID="cri-o://8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b" gracePeriod=30
Sep 10 22:46:45.184077 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.184011    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:46:45.204075 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.204044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v7qdd\" (UniqueName: \"kubernetes.io/projected/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-kube-api-access-v7qdd\") pod \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") "
Sep 10 22:46:45.204259 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.204145    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-plugins-config-volume\") pod \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\" (UID: \"e167894c-67b6-4413-a6a3-eaf1a4ff85bd\") "
Sep 10 22:46:45.204641 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.204596    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e167894c-67b6-4413-a6a3-eaf1a4ff85bd" (UID: "e167894c-67b6-4413-a6a3-eaf1a4ff85bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:46:45.206418 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.206388    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-kube-api-access-v7qdd" (OuterVolumeSpecName: "kube-api-access-v7qdd") pod "e167894c-67b6-4413-a6a3-eaf1a4ff85bd" (UID: "e167894c-67b6-4413-a6a3-eaf1a4ff85bd"). InnerVolumeSpecName "kube-api-access-v7qdd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:46:45.305473 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.305420    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:46:45.305473 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.305466    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v7qdd\" (UniqueName: \"kubernetes.io/projected/e167894c-67b6-4413-a6a3-eaf1a4ff85bd-kube-api-access-v7qdd\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:46:45.701995 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.701960    2582 generic.go:356] "Generic (PLEG): container finished" podID="e167894c-67b6-4413-a6a3-eaf1a4ff85bd" containerID="8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b" exitCode=0
Sep 10 22:46:45.701995 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.702000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf" event={"ID":"e167894c-67b6-4413-a6a3-eaf1a4ff85bd","Type":"ContainerDied","Data":"8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b"}
Sep 10 22:46:45.702212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.702005    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"
Sep 10 22:46:45.702212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.702039    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf" event={"ID":"e167894c-67b6-4413-a6a3-eaf1a4ff85bd","Type":"ContainerDied","Data":"a4efb06324b916bbea0d581b587b5b7b105f502ffb2d840309c9f55b114742d5"}
Sep 10 22:46:45.702212 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.702061    2582 scope.go:117] "RemoveContainer" containerID="8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b"
Sep 10 22:46:45.710841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.710821    2582 scope.go:117] "RemoveContainer" containerID="8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b"
Sep 10 22:46:45.711113 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:46:45.711091    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b\": container with ID starting with 8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b not found: ID does not exist" containerID="8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b"
Sep 10 22:46:45.711168 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.711122    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b"} err="failed to get container status \"8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b\": rpc error: code = NotFound desc = could not find container \"8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b\": container with ID starting with 8671c064a67480a8946df9b3928de83c56a7fee742a863c5a3453059fafe6b8b not found: ID does not exist"
Sep 10 22:46:45.724746 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.724717    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"]
Sep 10 22:46:45.729001 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:45.728981    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-d28770-6c44f9d9c8-d64vf"]
Sep 10 22:46:46.052427 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:46:46.052391    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e167894c-67b6-4413-a6a3-eaf1a4ff85bd" path="/var/lib/kubelet/pods/e167894c-67b6-4413-a6a3-eaf1a4ff85bd/volumes"
Sep 10 22:47:02.547524 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.547489    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"]
Sep 10 22:47:02.548006 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.547751    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96" podUID="a542758c-316c-4692-8063-66fe40cfe3bf" containerName="maas-api" containerID="cri-o://fa44116faeb5831126a47e8385fa5538a0ee50443cf605a1ca613cdda7bf6d8e" gracePeriod=30
Sep 10 22:47:02.612903 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.612867    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"]
Sep 10 22:47:02.613121 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.613088    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4" podUID="59ae1a9b-0aad-4055-a6d7-55f6db3fe679" containerName="payload-processing" containerID="cri-o://85d268b79aa488bb02b4947d5ce12d3805fcf5c1b024e15ac0de83abee8011c8" gracePeriod=30
Sep 10 22:47:02.619826 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.618838    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"]
Sep 10 22:47:02.619826 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.619095    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr" podUID="85f675a9-f57c-4520-84c8-95749de171f0" containerName="payload-pre-processing" containerID="cri-o://36cb2280eb57eab85ab0e6f9f82499a2cc51dcf0b3337b25f8643fb6504af0de" gracePeriod=30
Sep 10 22:47:02.798299 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.798088    2582 generic.go:356] "Generic (PLEG): container finished" podID="a542758c-316c-4692-8063-66fe40cfe3bf" containerID="fa44116faeb5831126a47e8385fa5538a0ee50443cf605a1ca613cdda7bf6d8e" exitCode=0
Sep 10 22:47:02.798299 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.798185    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96" event={"ID":"a542758c-316c-4692-8063-66fe40cfe3bf","Type":"ContainerDied","Data":"fa44116faeb5831126a47e8385fa5538a0ee50443cf605a1ca613cdda7bf6d8e"}
Sep 10 22:47:02.801494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.801457    2582 generic.go:356] "Generic (PLEG): container finished" podID="59ae1a9b-0aad-4055-a6d7-55f6db3fe679" containerID="85d268b79aa488bb02b4947d5ce12d3805fcf5c1b024e15ac0de83abee8011c8" exitCode=0
Sep 10 22:47:02.801722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.801514    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4" event={"ID":"59ae1a9b-0aad-4055-a6d7-55f6db3fe679","Type":"ContainerDied","Data":"85d268b79aa488bb02b4947d5ce12d3805fcf5c1b024e15ac0de83abee8011c8"}
Sep 10 22:47:02.803965 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.803847    2582 generic.go:356] "Generic (PLEG): container finished" podID="85f675a9-f57c-4520-84c8-95749de171f0" containerID="36cb2280eb57eab85ab0e6f9f82499a2cc51dcf0b3337b25f8643fb6504af0de" exitCode=0
Sep 10 22:47:02.804118 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.803993    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr" event={"ID":"85f675a9-f57c-4520-84c8-95749de171f0","Type":"ContainerDied","Data":"36cb2280eb57eab85ab0e6f9f82499a2cc51dcf0b3337b25f8643fb6504af0de"}
Sep 10 22:47:02.897387 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.897335    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:47:02.931730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.931707    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:47:02.935060 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.935039    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:47:02.965311 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.965275    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-metrics-certs\") pod \"a542758c-316c-4692-8063-66fe40cfe3bf\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") "
Sep 10 22:47:02.965500 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.965435    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtwhr\" (UniqueName: \"kubernetes.io/projected/a542758c-316c-4692-8063-66fe40cfe3bf-kube-api-access-rtwhr\") pod \"a542758c-316c-4692-8063-66fe40cfe3bf\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") "
Sep 10 22:47:02.966536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.966419    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-maas-api-tls\") pod \"a542758c-316c-4692-8063-66fe40cfe3bf\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") "
Sep 10 22:47:02.966536 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.966468    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a542758c-316c-4692-8063-66fe40cfe3bf-openshift-service-ca\") pod \"a542758c-316c-4692-8063-66fe40cfe3bf\" (UID: \"a542758c-316c-4692-8063-66fe40cfe3bf\") "
Sep 10 22:47:02.967305 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.967086    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a542758c-316c-4692-8063-66fe40cfe3bf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a542758c-316c-4692-8063-66fe40cfe3bf" (UID: "a542758c-316c-4692-8063-66fe40cfe3bf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:02.970100 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.970076    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a542758c-316c-4692-8063-66fe40cfe3bf" (UID: "a542758c-316c-4692-8063-66fe40cfe3bf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:47:02.970495 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.970469    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a542758c-316c-4692-8063-66fe40cfe3bf-kube-api-access-rtwhr" (OuterVolumeSpecName: "kube-api-access-rtwhr") pod "a542758c-316c-4692-8063-66fe40cfe3bf" (UID: "a542758c-316c-4692-8063-66fe40cfe3bf"). InnerVolumeSpecName "kube-api-access-rtwhr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:02.970600 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:02.970493    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a542758c-316c-4692-8063-66fe40cfe3bf" (UID: "a542758c-316c-4692-8063-66fe40cfe3bf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:47:03.067867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.067773    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8www\" (UniqueName: \"kubernetes.io/projected/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-kube-api-access-m8www\") pod \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") "
Sep 10 22:47:03.067867 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.067849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-plugins-config-volume\") pod \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\" (UID: \"59ae1a9b-0aad-4055-a6d7-55f6db3fe679\") "
Sep 10 22:47:03.068119 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.067886    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f675a9-f57c-4520-84c8-95749de171f0-plugins-config-volume\") pod \"85f675a9-f57c-4520-84c8-95749de171f0\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") "
Sep 10 22:47:03.068119 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.067930    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5h6n\" (UniqueName: \"kubernetes.io/projected/85f675a9-f57c-4520-84c8-95749de171f0-kube-api-access-w5h6n\") pod \"85f675a9-f57c-4520-84c8-95749de171f0\" (UID: \"85f675a9-f57c-4520-84c8-95749de171f0\") "
Sep 10 22:47:03.068119 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.068112    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.068298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.068131    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a542758c-316c-4692-8063-66fe40cfe3bf-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.068298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.068147    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a542758c-316c-4692-8063-66fe40cfe3bf-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.068298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.068163    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtwhr\" (UniqueName: \"kubernetes.io/projected/a542758c-316c-4692-8063-66fe40cfe3bf-kube-api-access-rtwhr\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.068298 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.068282    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85f675a9-f57c-4520-84c8-95749de171f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "85f675a9-f57c-4520-84c8-95749de171f0" (UID: "85f675a9-f57c-4520-84c8-95749de171f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:03.068438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.068288    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "59ae1a9b-0aad-4055-a6d7-55f6db3fe679" (UID: "59ae1a9b-0aad-4055-a6d7-55f6db3fe679"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:03.070277 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.070248    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-kube-api-access-m8www" (OuterVolumeSpecName: "kube-api-access-m8www") pod "59ae1a9b-0aad-4055-a6d7-55f6db3fe679" (UID: "59ae1a9b-0aad-4055-a6d7-55f6db3fe679"). InnerVolumeSpecName "kube-api-access-m8www". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:03.070378 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.070271    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85f675a9-f57c-4520-84c8-95749de171f0-kube-api-access-w5h6n" (OuterVolumeSpecName: "kube-api-access-w5h6n") pod "85f675a9-f57c-4520-84c8-95749de171f0" (UID: "85f675a9-f57c-4520-84c8-95749de171f0"). InnerVolumeSpecName "kube-api-access-w5h6n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:03.169134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.169094    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5h6n\" (UniqueName: \"kubernetes.io/projected/85f675a9-f57c-4520-84c8-95749de171f0-kube-api-access-w5h6n\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.169134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.169126    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8www\" (UniqueName: \"kubernetes.io/projected/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-kube-api-access-m8www\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.169134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.169136    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/59ae1a9b-0aad-4055-a6d7-55f6db3fe679-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.169134 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.169147    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/85f675a9-f57c-4520-84c8-95749de171f0-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:03.810877 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.810838    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96" event={"ID":"a542758c-316c-4692-8063-66fe40cfe3bf","Type":"ContainerDied","Data":"84f8ebdea0d73662f37096daf740dc27c94bf3ebee4ffdb0030d3b3fc8bcd844"}
Sep 10 22:47:03.811340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.810856    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"
Sep 10 22:47:03.811340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.810947    2582 scope.go:117] "RemoveContainer" containerID="fa44116faeb5831126a47e8385fa5538a0ee50443cf605a1ca613cdda7bf6d8e"
Sep 10 22:47:03.812407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.812349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4" event={"ID":"59ae1a9b-0aad-4055-a6d7-55f6db3fe679","Type":"ContainerDied","Data":"8ec8364cb1eea252b85d0320705bbf7d79d9916e3359c6d95e446e928947ad40"}
Sep 10 22:47:03.812407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.812367    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"
Sep 10 22:47:03.813786 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.813767    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"
Sep 10 22:47:03.813786 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.813777    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr" event={"ID":"85f675a9-f57c-4520-84c8-95749de171f0","Type":"ContainerDied","Data":"d77e7c036d98b544e3dc19bf339074ab11092c3e51af5d602537beac614039ad"}
Sep 10 22:47:03.822081 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.822064    2582 scope.go:117] "RemoveContainer" containerID="85d268b79aa488bb02b4947d5ce12d3805fcf5c1b024e15ac0de83abee8011c8"
Sep 10 22:47:03.830340 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.830321    2582 scope.go:117] "RemoveContainer" containerID="36cb2280eb57eab85ab0e6f9f82499a2cc51dcf0b3337b25f8643fb6504af0de"
Sep 10 22:47:03.839093 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.839070    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"]
Sep 10 22:47:03.845583 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.845545    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-58cd39-7b9cf4c94c-j5m96"]
Sep 10 22:47:03.858940 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.858901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"]
Sep 10 22:47:03.863321 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.863284    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-58cd39-845c9fb758-dlxtr"]
Sep 10 22:47:03.872615 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.872586    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"]
Sep 10 22:47:03.876273 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:03.876249    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-58cd39-85d69cfb75-2lsh4"]
Sep 10 22:47:04.051522 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:04.051487    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59ae1a9b-0aad-4055-a6d7-55f6db3fe679" path="/var/lib/kubelet/pods/59ae1a9b-0aad-4055-a6d7-55f6db3fe679/volumes"
Sep 10 22:47:04.052044 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:04.052021    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85f675a9-f57c-4520-84c8-95749de171f0" path="/var/lib/kubelet/pods/85f675a9-f57c-4520-84c8-95749de171f0/volumes"
Sep 10 22:47:04.052425 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:04.052407    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a542758c-316c-4692-8063-66fe40cfe3bf" path="/var/lib/kubelet/pods/a542758c-316c-4692-8063-66fe40cfe3bf/volumes"
Sep 10 22:47:20.287363 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.287327    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"]
Sep 10 22:47:20.287884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.287581    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj" podUID="1b2e878a-3a8e-4356-b4e7-43577fc84aec" containerName="payload-processing" containerID="cri-o://815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c" gracePeriod=30
Sep 10 22:47:20.295303 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.295271    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"]
Sep 10 22:47:20.296507 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.296136    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g" podUID="39e111a3-efc4-4736-8b51-7d340daba8a7" containerName="payload-pre-processing" containerID="cri-o://3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb" gracePeriod=30
Sep 10 22:47:20.577206 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.577182    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:47:20.579135 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.579117    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:47:20.630117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.630081    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e111a3-efc4-4736-8b51-7d340daba8a7-plugins-config-volume\") pod \"39e111a3-efc4-4736-8b51-7d340daba8a7\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") "
Sep 10 22:47:20.630117 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.630131    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ftv5r\" (UniqueName: \"kubernetes.io/projected/39e111a3-efc4-4736-8b51-7d340daba8a7-kube-api-access-ftv5r\") pod \"39e111a3-efc4-4736-8b51-7d340daba8a7\" (UID: \"39e111a3-efc4-4736-8b51-7d340daba8a7\") "
Sep 10 22:47:20.630408 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.630160    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l97jn\" (UniqueName: \"kubernetes.io/projected/1b2e878a-3a8e-4356-b4e7-43577fc84aec-kube-api-access-l97jn\") pod \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") "
Sep 10 22:47:20.630408 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.630254    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2e878a-3a8e-4356-b4e7-43577fc84aec-plugins-config-volume\") pod \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\" (UID: \"1b2e878a-3a8e-4356-b4e7-43577fc84aec\") "
Sep 10 22:47:20.631018 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.630991    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2e878a-3a8e-4356-b4e7-43577fc84aec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b2e878a-3a8e-4356-b4e7-43577fc84aec" (UID: "1b2e878a-3a8e-4356-b4e7-43577fc84aec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:20.632324 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.632294    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/39e111a3-efc4-4736-8b51-7d340daba8a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "39e111a3-efc4-4736-8b51-7d340daba8a7" (UID: "39e111a3-efc4-4736-8b51-7d340daba8a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:20.633682 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.633653    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2e878a-3a8e-4356-b4e7-43577fc84aec-kube-api-access-l97jn" (OuterVolumeSpecName: "kube-api-access-l97jn") pod "1b2e878a-3a8e-4356-b4e7-43577fc84aec" (UID: "1b2e878a-3a8e-4356-b4e7-43577fc84aec"). InnerVolumeSpecName "kube-api-access-l97jn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:20.634468 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.634442    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/39e111a3-efc4-4736-8b51-7d340daba8a7-kube-api-access-ftv5r" (OuterVolumeSpecName: "kube-api-access-ftv5r") pod "39e111a3-efc4-4736-8b51-7d340daba8a7" (UID: "39e111a3-efc4-4736-8b51-7d340daba8a7"). InnerVolumeSpecName "kube-api-access-ftv5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:20.731092 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.731051    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/39e111a3-efc4-4736-8b51-7d340daba8a7-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:20.731092 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.731082    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ftv5r\" (UniqueName: \"kubernetes.io/projected/39e111a3-efc4-4736-8b51-7d340daba8a7-kube-api-access-ftv5r\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:20.731092 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.731091    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l97jn\" (UniqueName: \"kubernetes.io/projected/1b2e878a-3a8e-4356-b4e7-43577fc84aec-kube-api-access-l97jn\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:20.731092 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.731099    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2e878a-3a8e-4356-b4e7-43577fc84aec-plugins-config-volume\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:20.898464 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.898377    2582 generic.go:356] "Generic (PLEG): container finished" podID="1b2e878a-3a8e-4356-b4e7-43577fc84aec" containerID="815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c" exitCode=0
Sep 10 22:47:20.898464 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.898440    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"
Sep 10 22:47:20.898740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.898463    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj" event={"ID":"1b2e878a-3a8e-4356-b4e7-43577fc84aec","Type":"ContainerDied","Data":"815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c"}
Sep 10 22:47:20.898740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.898554    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj" event={"ID":"1b2e878a-3a8e-4356-b4e7-43577fc84aec","Type":"ContainerDied","Data":"723ef3940e8acb5acbc9a6bd1e80984186167799a04837f77529132afdac961f"}
Sep 10 22:47:20.898740 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.898585    2582 scope.go:117] "RemoveContainer" containerID="815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c"
Sep 10 22:47:20.899813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.899794    2582 generic.go:356] "Generic (PLEG): container finished" podID="39e111a3-efc4-4736-8b51-7d340daba8a7" containerID="3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb" exitCode=0
Sep 10 22:47:20.899904 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.899847    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g" event={"ID":"39e111a3-efc4-4736-8b51-7d340daba8a7","Type":"ContainerDied","Data":"3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb"}
Sep 10 22:47:20.899904 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.899875    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"
Sep 10 22:47:20.899904 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.899889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g" event={"ID":"39e111a3-efc4-4736-8b51-7d340daba8a7","Type":"ContainerDied","Data":"8f75e713f34237088d98dca3fdad55478ff0639c0d0b62d8eee9fe9dc695d65b"}
Sep 10 22:47:20.907654 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.907633    2582 scope.go:117] "RemoveContainer" containerID="815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c"
Sep 10 22:47:20.907962 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:47:20.907941    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c\": container with ID starting with 815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c not found: ID does not exist" containerID="815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c"
Sep 10 22:47:20.908058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.907969    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c"} err="failed to get container status \"815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c\": rpc error: code = NotFound desc = could not find container \"815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c\": container with ID starting with 815599afe82cb849b0e1416ca4ee5103bb39d5d6cc39143e880e4aec33f3901c not found: ID does not exist"
Sep 10 22:47:20.908058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.907987    2582 scope.go:117] "RemoveContainer" containerID="3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb"
Sep 10 22:47:20.916798 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.916784    2582 scope.go:117] "RemoveContainer" containerID="3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb"
Sep 10 22:47:20.917073 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:47:20.917052    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb\": container with ID starting with 3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb not found: ID does not exist" containerID="3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb"
Sep 10 22:47:20.917142 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.917080    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb"} err="failed to get container status \"3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb\": rpc error: code = NotFound desc = could not find container \"3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb\": container with ID starting with 3b88958e7eaad51bf9ae6065ecf8452f3673a41e03867a3e1a7841a49cacb7fb not found: ID does not exist"
Sep 10 22:47:20.924607 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.924582    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"]
Sep 10 22:47:20.928546 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.928526    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-33b4cf-6b86b8549f-gbpvj"]
Sep 10 22:47:20.938811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.938788    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"]
Sep 10 22:47:20.942613 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:20.942594    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-33b4cf-58679f4f8-rvx4g"]
Sep 10 22:47:22.051938 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:22.051903    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2e878a-3a8e-4356-b4e7-43577fc84aec" path="/var/lib/kubelet/pods/1b2e878a-3a8e-4356-b4e7-43577fc84aec/volumes"
Sep 10 22:47:22.052329 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:22.052238    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="39e111a3-efc4-4736-8b51-7d340daba8a7" path="/var/lib/kubelet/pods/39e111a3-efc4-4736-8b51-7d340daba8a7/volumes"
Sep 10 22:47:27.163366 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:27.163335    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"]
Sep 10 22:47:27.163960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:27.163536    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" containerID="cri-o://64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8" gracePeriod=30
Sep 10 22:47:27.616515 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:27.616478    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 10 22:47:27.616707 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:27.616544    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 10 22:47:29.610406 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.610370    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77786d6846-mppjx"]
Sep 10 22:47:29.610965 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.610567    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77786d6846-mppjx" podUID="04ab00f0-3d7a-4a4b-adff-53216ab00786" containerName="manager" containerID="cri-o://b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1" gracePeriod=30
Sep 10 22:47:29.862070 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.862007    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:47:29.913422 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.913385    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7mz8l\" (UniqueName: \"kubernetes.io/projected/04ab00f0-3d7a-4a4b-adff-53216ab00786-kube-api-access-7mz8l\") pod \"04ab00f0-3d7a-4a4b-adff-53216ab00786\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") "
Sep 10 22:47:29.913576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.913467    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-metrics-certs\") pod \"04ab00f0-3d7a-4a4b-adff-53216ab00786\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") "
Sep 10 22:47:29.913576 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.913519    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-webhook-cert\") pod \"04ab00f0-3d7a-4a4b-adff-53216ab00786\" (UID: \"04ab00f0-3d7a-4a4b-adff-53216ab00786\") "
Sep 10 22:47:29.915676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.915641    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "04ab00f0-3d7a-4a4b-adff-53216ab00786" (UID: "04ab00f0-3d7a-4a4b-adff-53216ab00786"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:47:29.915676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.915659    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/04ab00f0-3d7a-4a4b-adff-53216ab00786-kube-api-access-7mz8l" (OuterVolumeSpecName: "kube-api-access-7mz8l") pod "04ab00f0-3d7a-4a4b-adff-53216ab00786" (UID: "04ab00f0-3d7a-4a4b-adff-53216ab00786"). InnerVolumeSpecName "kube-api-access-7mz8l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:29.915829 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.915728    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "04ab00f0-3d7a-4a4b-adff-53216ab00786" (UID: "04ab00f0-3d7a-4a4b-adff-53216ab00786"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:47:29.947123 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.947093    2582 generic.go:356] "Generic (PLEG): container finished" podID="04ab00f0-3d7a-4a4b-adff-53216ab00786" containerID="b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1" exitCode=0
Sep 10 22:47:29.947271 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.947142    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-mppjx"
Sep 10 22:47:29.947271 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.947182    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-mppjx" event={"ID":"04ab00f0-3d7a-4a4b-adff-53216ab00786","Type":"ContainerDied","Data":"b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1"}
Sep 10 22:47:29.947271 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.947234    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-mppjx" event={"ID":"04ab00f0-3d7a-4a4b-adff-53216ab00786","Type":"ContainerDied","Data":"53f97be94d536e032a3b5cdba5873fa8809d014e92c5b5235dcfbfdee52f7dd1"}
Sep 10 22:47:29.947271 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.947258    2582 scope.go:117] "RemoveContainer" containerID="b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1"
Sep 10 22:47:29.962759 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.962741    2582 scope.go:117] "RemoveContainer" containerID="b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1"
Sep 10 22:47:29.963064 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:47:29.963042    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1\": container with ID starting with b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1 not found: ID does not exist" containerID="b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1"
Sep 10 22:47:29.963110 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.963074    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1"} err="failed to get container status \"b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1\": rpc error: code = NotFound desc = could not find container \"b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1\": container with ID starting with b1990b8f714f0bebf3fc49d8b4ded82c468d48d68a795320fd4d06140f0882d1 not found: ID does not exist"
Sep 10 22:47:29.973865 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.973843    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77786d6846-mppjx"]
Sep 10 22:47:29.978443 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:29.978422    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77786d6846-mppjx"]
Sep 10 22:47:30.014812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:30.014781    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:30.014812 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:30.014806    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/04ab00f0-3d7a-4a4b-adff-53216ab00786-webhook-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:30.014974 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:30.014820    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7mz8l\" (UniqueName: \"kubernetes.io/projected/04ab00f0-3d7a-4a4b-adff-53216ab00786-kube-api-access-7mz8l\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:30.051884 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:30.051856    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="04ab00f0-3d7a-4a4b-adff-53216ab00786" path="/var/lib/kubelet/pods/04ab00f0-3d7a-4a4b-adff-53216ab00786/volumes"
Sep 10 22:47:32.422743 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.422717    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:47:32.535608 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535571    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-podinfo\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.535813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535643    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-token\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.535813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-credential-socket\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.535813 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535763    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-envoy\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.536000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-certs\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.536000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535866    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97c080c-464b-43cf-83cc-eded16d6cbdb-istiod-ca-cert\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.536000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535901    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-socket\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.536000 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535951    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4267\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-kube-api-access-q4267\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.536207 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.535999    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-data\") pod \"a97c080c-464b-43cf-83cc-eded16d6cbdb\" (UID: \"a97c080c-464b-43cf-83cc-eded16d6cbdb\") "
Sep 10 22:47:32.536530 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.536254    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:47:32.536530 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.536463    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-data" (OuterVolumeSpecName: "istio-data") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:47:32.536839 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.536805    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a97c080c-464b-43cf-83cc-eded16d6cbdb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:47:32.537045 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.537023    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:47:32.537175 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.537091    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:47:32.539765 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.539725    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:47:32.539960 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.539932    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 10 22:47:32.540154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.540124    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-token" (OuterVolumeSpecName: "istio-token") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:32.540251 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.540165    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-kube-api-access-q4267" (OuterVolumeSpecName: "kube-api-access-q4267") pod "a97c080c-464b-43cf-83cc-eded16d6cbdb" (UID: "a97c080c-464b-43cf-83cc-eded16d6cbdb"). InnerVolumeSpecName "kube-api-access-q4267". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:47:32.637873 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637810    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-podinfo\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.637873 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637867    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-token\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.637873 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637884    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-credential-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.638229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637899    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-envoy\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.638229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637915    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.638229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637928    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a97c080c-464b-43cf-83cc-eded16d6cbdb-istiod-ca-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.638229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637940    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-workload-socket\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.638229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637954    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4267\" (UniqueName: \"kubernetes.io/projected/a97c080c-464b-43cf-83cc-eded16d6cbdb-kube-api-access-q4267\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.638229 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.637967    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a97c080c-464b-43cf-83cc-eded16d6cbdb-istio-data\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:47:32.963038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.962932    2582 generic.go:356] "Generic (PLEG): container finished" podID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerID="64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8" exitCode=0
Sep 10 22:47:32.963038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.962994    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"
Sep 10 22:47:32.963038 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.963012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" event={"ID":"a97c080c-464b-43cf-83cc-eded16d6cbdb","Type":"ContainerDied","Data":"64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8"}
Sep 10 22:47:32.963293 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.963072    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58" event={"ID":"a97c080c-464b-43cf-83cc-eded16d6cbdb","Type":"ContainerDied","Data":"eafa80470711ea2a87447b3f9b49436892f99c526d57389f33e4ace48abfaf0e"}
Sep 10 22:47:32.963293 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.963097    2582 scope.go:117] "RemoveContainer" containerID="64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8"
Sep 10 22:47:32.972814 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.972797    2582 scope.go:117] "RemoveContainer" containerID="25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"
Sep 10 22:47:32.980996 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.980980    2582 scope.go:117] "RemoveContainer" containerID="64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8"
Sep 10 22:47:32.981284 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:47:32.981261    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8\": container with ID starting with 64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8 not found: ID does not exist" containerID="64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8"
Sep 10 22:47:32.981379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.981292    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8"} err="failed to get container status \"64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8\": rpc error: code = NotFound desc = could not find container \"64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8\": container with ID starting with 64af7896d511446a1050495e62580a32d77a86823f34d294cbc12cd664213da8 not found: ID does not exist"
Sep 10 22:47:32.981379 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.981309    2582 scope.go:117] "RemoveContainer" containerID="25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"
Sep 10 22:47:32.981570 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:47:32.981553    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184\": container with ID starting with 25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184 not found: ID does not exist" containerID="25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"
Sep 10 22:47:32.981611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.981577    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184"} err="failed to get container status \"25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184\": rpc error: code = NotFound desc = could not find container \"25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184\": container with ID starting with 25a4f031c2b74dbf4262a9f9bd3415980222da9fad515f9a42567f28093fa184 not found: ID does not exist"
Sep 10 22:47:32.986121 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.986098    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"]
Sep 10 22:47:32.990409 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:32.990386    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w3-33b4cf-openshift-default-669686458d-n8s58"]
Sep 10 22:47:34.051810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:47:34.051770    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" path="/var/lib/kubelet/pods/a97c080c-464b-43cf-83cc-eded16d6cbdb/volumes"
Sep 10 22:48:30.797947 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.797912    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77786d6846-vkzlb"]
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798227    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad60e807-10b6-4328-9013-761d74de1b8a" containerName="maas-api"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798238    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad60e807-10b6-4328-9013-761d74de1b8a" containerName="maas-api"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798251    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2e878a-3a8e-4356-b4e7-43577fc84aec" containerName="payload-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798257    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2e878a-3a8e-4356-b4e7-43577fc84aec" containerName="payload-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798267    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798272    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798280    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e167894c-67b6-4413-a6a3-eaf1a4ff85bd" containerName="payload-pre-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798286    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e167894c-67b6-4413-a6a3-eaf1a4ff85bd" containerName="payload-pre-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798294    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb21edd3-3f12-43de-96ad-81ae0f8d81e2" containerName="maas-api"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798299    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb21edd3-3f12-43de-96ad-81ae0f8d81e2" containerName="maas-api"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798308    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a542758c-316c-4692-8063-66fe40cfe3bf" containerName="maas-api"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798313    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a542758c-316c-4692-8063-66fe40cfe3bf" containerName="maas-api"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798320    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798325    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798334    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="04ab00f0-3d7a-4a4b-adff-53216ab00786" containerName="manager"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798339    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="04ab00f0-3d7a-4a4b-adff-53216ab00786" containerName="manager"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798345    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85f675a9-f57c-4520-84c8-95749de171f0" containerName="payload-pre-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798350    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="85f675a9-f57c-4520-84c8-95749de171f0" containerName="payload-pre-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798357    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59ae1a9b-0aad-4055-a6d7-55f6db3fe679" containerName="payload-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798362    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="59ae1a9b-0aad-4055-a6d7-55f6db3fe679" containerName="payload-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798369    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="39e111a3-efc4-4736-8b51-7d340daba8a7" containerName="payload-pre-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798378    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="39e111a3-efc4-4736-8b51-7d340daba8a7" containerName="payload-pre-processing"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798384    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy"
Sep 10 22:48:30.798390 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798390    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798439    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="85f675a9-f57c-4520-84c8-95749de171f0" containerName="payload-pre-processing"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798447    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="39e111a3-efc4-4736-8b51-7d340daba8a7" containerName="payload-pre-processing"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798454    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="59ae1a9b-0aad-4055-a6d7-55f6db3fe679" containerName="payload-processing"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798459    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798465    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798471    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="e167894c-67b6-4413-a6a3-eaf1a4ff85bd" containerName="payload-pre-processing"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798477    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="04ab00f0-3d7a-4a4b-adff-53216ab00786" containerName="manager"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798482    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb21edd3-3f12-43de-96ad-81ae0f8d81e2" containerName="maas-api"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798486    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad60e807-10b6-4328-9013-761d74de1b8a" containerName="maas-api"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798491    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2e878a-3a8e-4356-b4e7-43577fc84aec" containerName="payload-processing"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798496    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy"
Sep 10 22:48:30.799154 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.798500    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a542758c-316c-4692-8063-66fe40cfe3bf" containerName="maas-api"
Sep 10 22:48:30.801409 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.801388    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.804522 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.804502    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cc2r4\""
Sep 10 22:48:30.805522 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.805506    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 22:48:30.805605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.805586    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 22:48:30.805739 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.805724    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 22:48:30.815726 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.815707    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77786d6846-vkzlb"]
Sep 10 22:48:30.821054 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.821032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr4lz\" (UniqueName: \"kubernetes.io/projected/abf2655c-f577-41ae-999c-3557108c9ba7-kube-api-access-cr4lz\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.821151 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.821065    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-metrics-certs\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.821232 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.821209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-webhook-cert\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.922678 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.922643    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-webhook-cert\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.922856 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.922701    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr4lz\" (UniqueName: \"kubernetes.io/projected/abf2655c-f577-41ae-999c-3557108c9ba7-kube-api-access-cr4lz\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.922856 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.922725    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-metrics-certs\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.925234 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.925212    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-metrics-certs\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.925333 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.925239    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-webhook-cert\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:30.931702 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:30.931680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr4lz\" (UniqueName: \"kubernetes.io/projected/abf2655c-f577-41ae-999c-3557108c9ba7-kube-api-access-cr4lz\") pod \"maas-controller-77786d6846-vkzlb\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") " pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:31.111880 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:31.111794    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:31.386150 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:31.385986    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77786d6846-vkzlb"]
Sep 10 22:48:31.388952 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:48:31.388920    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabf2655c_f577_41ae_999c_3557108c9ba7.slice/crio-377cdfeb1dfc306c54463ae178b92c42e1c60626e714960280fdf307d025be9a WatchSource:0}: Error finding container 377cdfeb1dfc306c54463ae178b92c42e1c60626e714960280fdf307d025be9a: Status 404 returned error can't find the container with id 377cdfeb1dfc306c54463ae178b92c42e1c60626e714960280fdf307d025be9a
Sep 10 22:48:31.390412 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:31.390394    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 10 22:48:32.252596 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:32.252557    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-vkzlb" event={"ID":"abf2655c-f577-41ae-999c-3557108c9ba7","Type":"ContainerStarted","Data":"a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad"}
Sep 10 22:48:32.252995 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:32.252644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-vkzlb" event={"ID":"abf2655c-f577-41ae-999c-3557108c9ba7","Type":"ContainerStarted","Data":"377cdfeb1dfc306c54463ae178b92c42e1c60626e714960280fdf307d025be9a"}
Sep 10 22:48:32.252995 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:32.252701    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:32.270868 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:32.270786    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77786d6846-vkzlb" podStartSLOduration=1.604374572 podStartE2EDuration="2.270766911s" totalImagesPullingTime="666.392339ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:48:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:48:32.270662049 +0000 UTC m=+1812.681786166" watchObservedRunningTime="2026-09-10 22:48:32.270766911 +0000 UTC m=+1812.681891019"
Sep 10 22:48:43.259318 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:43.259288    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:52.576069 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.576029    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77786d6846-vkzlb"]
Sep 10 22:48:52.576540 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.576401    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77786d6846-vkzlb" podUID="abf2655c-f577-41ae-999c-3557108c9ba7" containerName="manager" containerID="cri-o://a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad" gracePeriod=30
Sep 10 22:48:52.829188 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.829125    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:52.930675 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.930641    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cr4lz\" (UniqueName: \"kubernetes.io/projected/abf2655c-f577-41ae-999c-3557108c9ba7-kube-api-access-cr4lz\") pod \"abf2655c-f577-41ae-999c-3557108c9ba7\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") "
Sep 10 22:48:52.930860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.930713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-metrics-certs\") pod \"abf2655c-f577-41ae-999c-3557108c9ba7\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") "
Sep 10 22:48:52.930860 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.930786    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-webhook-cert\") pod \"abf2655c-f577-41ae-999c-3557108c9ba7\" (UID: \"abf2655c-f577-41ae-999c-3557108c9ba7\") "
Sep 10 22:48:52.932834 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.932801    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/abf2655c-f577-41ae-999c-3557108c9ba7-kube-api-access-cr4lz" (OuterVolumeSpecName: "kube-api-access-cr4lz") pod "abf2655c-f577-41ae-999c-3557108c9ba7" (UID: "abf2655c-f577-41ae-999c-3557108c9ba7"). InnerVolumeSpecName "kube-api-access-cr4lz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:48:52.932933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.932885    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "abf2655c-f577-41ae-999c-3557108c9ba7" (UID: "abf2655c-f577-41ae-999c-3557108c9ba7"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:48:52.932933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:52.932906    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "abf2655c-f577-41ae-999c-3557108c9ba7" (UID: "abf2655c-f577-41ae-999c-3557108c9ba7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:48:53.031497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.031461    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cr4lz\" (UniqueName: \"kubernetes.io/projected/abf2655c-f577-41ae-999c-3557108c9ba7-kube-api-access-cr4lz\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:48:53.031497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.031491    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:48:53.031497 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.031502    2582 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/abf2655c-f577-41ae-999c-3557108c9ba7-webhook-cert\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:48:53.350757 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.350724    2582 generic.go:356] "Generic (PLEG): container finished" podID="abf2655c-f577-41ae-999c-3557108c9ba7" containerID="a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad" exitCode=0
Sep 10 22:48:53.350985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.350780    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-vkzlb"
Sep 10 22:48:53.350985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.350795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-vkzlb" event={"ID":"abf2655c-f577-41ae-999c-3557108c9ba7","Type":"ContainerDied","Data":"a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad"}
Sep 10 22:48:53.350985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.350860    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-vkzlb" event={"ID":"abf2655c-f577-41ae-999c-3557108c9ba7","Type":"ContainerDied","Data":"377cdfeb1dfc306c54463ae178b92c42e1c60626e714960280fdf307d025be9a"}
Sep 10 22:48:53.350985 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.350880    2582 scope.go:117] "RemoveContainer" containerID="a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad"
Sep 10 22:48:53.361168 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.361141    2582 scope.go:117] "RemoveContainer" containerID="a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad"
Sep 10 22:48:53.361498 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:48:53.361472    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad\": container with ID starting with a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad not found: ID does not exist" containerID="a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad"
Sep 10 22:48:53.361556 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.361514    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad"} err="failed to get container status \"a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad\": rpc error: code = NotFound desc = could not find container \"a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad\": container with ID starting with a2947d9a80d9ce4086898279b5af8af1885010a210e284a163131cc88149c9ad not found: ID does not exist"
Sep 10 22:48:53.375169 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.375137    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77786d6846-vkzlb"]
Sep 10 22:48:53.378637 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:53.378595    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77786d6846-vkzlb"]
Sep 10 22:48:54.052638 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.052583    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="abf2655c-f577-41ae-999c-3557108c9ba7" path="/var/lib/kubelet/pods/abf2655c-f577-41ae-999c-3557108c9ba7/volumes"
Sep 10 22:48:54.162190 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162148    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77786d6846-96hdw"]
Sep 10 22:48:54.162493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162479    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy"
Sep 10 22:48:54.162493 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162493    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc76e72a-0692-4d67-acf3-15e962f04bcb" containerName="istio-proxy"
Sep 10 22:48:54.162655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162519    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="abf2655c-f577-41ae-999c-3557108c9ba7" containerName="manager"
Sep 10 22:48:54.162655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162525    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="abf2655c-f577-41ae-999c-3557108c9ba7" containerName="manager"
Sep 10 22:48:54.162655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162582    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="abf2655c-f577-41ae-999c-3557108c9ba7" containerName="manager"
Sep 10 22:48:54.162655 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.162589    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a97c080c-464b-43cf-83cc-eded16d6cbdb" containerName="istio-proxy"
Sep 10 22:48:54.166944 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.166919    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.170584 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.170561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-cc2r4\""
Sep 10 22:48:54.170735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.170561    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 10 22:48:54.170735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.170561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 10 22:48:54.170735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.170563    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 10 22:48:54.175611 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.175590    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77786d6846-96hdw"]
Sep 10 22:48:54.346286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.346188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2707f4e9-cff5-4bb6-b551-c004c7842144-webhook-cert\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.346286 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.346275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2707f4e9-cff5-4bb6-b551-c004c7842144-metrics-certs\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.346494 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.346343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2rn5\" (UniqueName: \"kubernetes.io/projected/2707f4e9-cff5-4bb6-b551-c004c7842144-kube-api-access-x2rn5\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.447246 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.447208    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2707f4e9-cff5-4bb6-b551-c004c7842144-metrics-certs\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.447440 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.447277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2rn5\" (UniqueName: \"kubernetes.io/projected/2707f4e9-cff5-4bb6-b551-c004c7842144-kube-api-access-x2rn5\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.447440 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.447309    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2707f4e9-cff5-4bb6-b551-c004c7842144-webhook-cert\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.450010 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.449973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2707f4e9-cff5-4bb6-b551-c004c7842144-metrics-certs\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.450133 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.450012    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2707f4e9-cff5-4bb6-b551-c004c7842144-webhook-cert\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.455595 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.455574    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2rn5\" (UniqueName: \"kubernetes.io/projected/2707f4e9-cff5-4bb6-b551-c004c7842144-kube-api-access-x2rn5\") pod \"maas-controller-77786d6846-96hdw\" (UID: \"2707f4e9-cff5-4bb6-b551-c004c7842144\") " pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.477605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.477572    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:54.750127 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:54.750092    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77786d6846-96hdw"]
Sep 10 22:48:54.753009 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:48:54.752980    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2707f4e9_cff5_4bb6_b551_c004c7842144.slice/crio-b5d134091c00d15f5a0ed710907a20ef59cffcdd13c5c658d9a89194492ed767 WatchSource:0}: Error finding container b5d134091c00d15f5a0ed710907a20ef59cffcdd13c5c658d9a89194492ed767: Status 404 returned error can't find the container with id b5d134091c00d15f5a0ed710907a20ef59cffcdd13c5c658d9a89194492ed767
Sep 10 22:48:55.362778 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:55.362747    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-96hdw" event={"ID":"2707f4e9-cff5-4bb6-b551-c004c7842144","Type":"ContainerStarted","Data":"80b55e4333f2d60e4a97291c0bdfde906d58d57ee46efaab1eaa28f701c513c3"}
Sep 10 22:48:55.363165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:55.362802    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:48:55.363165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:55.362820    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77786d6846-96hdw" event={"ID":"2707f4e9-cff5-4bb6-b551-c004c7842144","Type":"ContainerStarted","Data":"b5d134091c00d15f5a0ed710907a20ef59cffcdd13c5c658d9a89194492ed767"}
Sep 10 22:48:55.380475 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:48:55.380424    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77786d6846-96hdw" podStartSLOduration=0.965006836 podStartE2EDuration="1.380406401s" totalImagesPullingTime="415.399565ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:48:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:48:55.378341412 +0000 UTC m=+1835.789465509" watchObservedRunningTime="2026-09-10 22:48:55.380406401 +0000 UTC m=+1835.791530498"
Sep 10 22:49:06.370160 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:49:06.370125    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77786d6846-96hdw"
Sep 10 22:51:56.038058 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.038021    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"]
Sep 10 22:51:56.041318 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.041296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.043672 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.043647    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-e70c95ab-kserve-self-signed-certs\""
Sep 10 22:51:56.054113 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.054093    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"]
Sep 10 22:51:56.107253 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.107215    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-model-cache\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.107438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.107285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tls-certs\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.107438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.107363    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-home\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.107438 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.107425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-dshm\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.107684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.107461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcffw\" (UniqueName: \"kubernetes.io/projected/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-kube-api-access-wcffw\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.107684 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.107492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tmp-dir\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.208656 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.208602    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-dshm\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.208831 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.208667    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcffw\" (UniqueName: \"kubernetes.io/projected/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-kube-api-access-wcffw\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.208831 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.208698    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tmp-dir\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.208831 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.208758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-model-cache\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.208967 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.208941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tls-certs\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.209018 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.208997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-home\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.209194 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.209163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tmp-dir\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.209446 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.209205    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-model-cache\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.209446 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.209248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-home\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.211165 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.211138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-dshm\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.211525 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.211508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tls-certs\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.217301 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.217276    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcffw\" (UniqueName: \"kubernetes.io/projected/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-kube-api-access-wcffw\") pod \"e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") " pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.352941 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.352844    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:51:56.626674 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:56.626582    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"]
Sep 10 22:51:56.630127 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:51:56.630098    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcab90607_c6d1_4d0b_a987_1aa8bb7a1774.slice/crio-9e9d36cab7fbc8e79eb173c3d9db53b9a04514e2ccf90df6f916677a835b33c1 WatchSource:0}: Error finding container 9e9d36cab7fbc8e79eb173c3d9db53b9a04514e2ccf90df6f916677a835b33c1: Status 404 returned error can't find the container with id 9e9d36cab7fbc8e79eb173c3d9db53b9a04514e2ccf90df6f916677a835b33c1
Sep 10 22:51:57.174004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:57.173964    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4" event={"ID":"cab90607-c6d1-4d0b-a987-1aa8bb7a1774","Type":"ContainerStarted","Data":"e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d"}
Sep 10 22:51:57.174004 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:57.174008    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4" event={"ID":"cab90607-c6d1-4d0b-a987-1aa8bb7a1774","Type":"ContainerStarted","Data":"9e9d36cab7fbc8e79eb173c3d9db53b9a04514e2ccf90df6f916677a835b33c1"}
Sep 10 22:51:57.191270 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:51:57.191219    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4" podStartSLOduration=1.1912028590000001 podStartE2EDuration="1.191202859s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:51:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:51:57.189897742 +0000 UTC m=+2017.601021849" watchObservedRunningTime="2026-09-10 22:51:57.191202859 +0000 UTC m=+2017.602326957"
Sep 10 22:52:05.944386 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:05.944348    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"]
Sep 10 22:52:05.947911 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:05.947890    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:05.950403 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:05.950372    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-e70c95ab-kserve-self-signed-certs\""
Sep 10 22:52:05.960196 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:05.960172    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"]
Sep 10 22:52:06.000498 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.000468    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkfd9\" (UniqueName: \"kubernetes.io/projected/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-kube-api-access-gkfd9\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.000650 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.000519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-model-cache\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.000650 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.000603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tmp-dir\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.000741 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.000675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-dshm\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.000741 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.000718    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-home\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.000827 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.000789    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tls-certs\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.101734 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.101693    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-home\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.101933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.101747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tls-certs\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.101933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.101804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkfd9\" (UniqueName: \"kubernetes.io/projected/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-kube-api-access-gkfd9\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.101933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.101822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-model-cache\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.101933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.101846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tmp-dir\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.101933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.101877    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-dshm\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.102214 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.102122    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-home\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.102272 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.102230    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-model-cache\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.102272 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.102257    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tmp-dir\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.104375 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.104350    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-dshm\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.104532 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.104514    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tls-certs\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.110736 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.110709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkfd9\" (UniqueName: \"kubernetes.io/projected/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-kube-api-access-gkfd9\") pod \"e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") " pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.257096 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.257067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:06.353029 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.352999    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:52:06.353191 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.353052    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:52:06.365254 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.365233    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:52:06.530128 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:06.530100    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"]
Sep 10 22:52:06.531635 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:52:06.531591    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaf2dd338_27af_49be_94e7_5a9d2ee3e3e1.slice/crio-796bdf600c8e863f49fb704a6806262f1f8b87f053709318810dd22d432dbd7b WatchSource:0}: Error finding container 796bdf600c8e863f49fb704a6806262f1f8b87f053709318810dd22d432dbd7b: Status 404 returned error can't find the container with id 796bdf600c8e863f49fb704a6806262f1f8b87f053709318810dd22d432dbd7b
Sep 10 22:52:07.223993 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:07.223947    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw" event={"ID":"af2dd338-27af-49be-94e7-5a9d2ee3e3e1","Type":"ContainerStarted","Data":"4221a21ce1db3038a810326bb48f7ea8990dd583b576a70a5cdabef650011467"}
Sep 10 22:52:07.224435 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:07.223999    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw" event={"ID":"af2dd338-27af-49be-94e7-5a9d2ee3e3e1","Type":"ContainerStarted","Data":"796bdf600c8e863f49fb704a6806262f1f8b87f053709318810dd22d432dbd7b"}
Sep 10 22:52:07.235350 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:07.235327    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:52:07.243040 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:07.243003    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw" podStartSLOduration=2.242985478 podStartE2EDuration="2.242985478s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:52:07.240957456 +0000 UTC m=+2027.652081554" watchObservedRunningTime="2026-09-10 22:52:07.242985478 +0000 UTC m=+2027.654109576"
Sep 10 22:52:16.257304 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:16.257267    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:16.257753 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:16.257542    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:16.270170 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:16.270147    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:17.282846 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:17.282819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:23.482562 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:23.482520    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"]
Sep 10 22:52:25.133105 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:25.133064    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"]
Sep 10 22:52:38.502288 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.502242    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4" podUID="cab90607-c6d1-4d0b-a987-1aa8bb7a1774" containerName="main" containerID="cri-o://e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d" gracePeriod=45
Sep 10 22:52:38.751750 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.751723    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:52:38.794882 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.794787    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-home\") pod \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") "
Sep 10 22:52:38.795065 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.794883    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tmp-dir\") pod \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") "
Sep 10 22:52:38.795065 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.794920    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tls-certs\") pod \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") "
Sep 10 22:52:38.795065 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.794948    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcffw\" (UniqueName: \"kubernetes.io/projected/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-kube-api-access-wcffw\") pod \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") "
Sep 10 22:52:38.795065 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.794975    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-model-cache\") pod \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") "
Sep 10 22:52:38.795310 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.795069    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-dshm\") pod \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\" (UID: \"cab90607-c6d1-4d0b-a987-1aa8bb7a1774\") "
Sep 10 22:52:38.795310 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.795147    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-home" (OuterVolumeSpecName: "home") pod "cab90607-c6d1-4d0b-a987-1aa8bb7a1774" (UID: "cab90607-c6d1-4d0b-a987-1aa8bb7a1774"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:38.795310 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.795191    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "cab90607-c6d1-4d0b-a987-1aa8bb7a1774" (UID: "cab90607-c6d1-4d0b-a987-1aa8bb7a1774"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:38.795478 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.795328    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-model-cache" (OuterVolumeSpecName: "model-cache") pod "cab90607-c6d1-4d0b-a987-1aa8bb7a1774" (UID: "cab90607-c6d1-4d0b-a987-1aa8bb7a1774"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:38.795478 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.795367    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tmp-dir\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:38.795478 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.795382    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-home\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:38.797986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.797937    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-dshm" (OuterVolumeSpecName: "dshm") pod "cab90607-c6d1-4d0b-a987-1aa8bb7a1774" (UID: "cab90607-c6d1-4d0b-a987-1aa8bb7a1774"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:38.798158 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.798023    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "cab90607-c6d1-4d0b-a987-1aa8bb7a1774" (UID: "cab90607-c6d1-4d0b-a987-1aa8bb7a1774"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:52:38.798158 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.798051    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-kube-api-access-wcffw" (OuterVolumeSpecName: "kube-api-access-wcffw") pod "cab90607-c6d1-4d0b-a987-1aa8bb7a1774" (UID: "cab90607-c6d1-4d0b-a987-1aa8bb7a1774"). InnerVolumeSpecName "kube-api-access-wcffw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:52:38.895841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.895809    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-dshm\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:38.895841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.895836    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-tls-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:38.895841 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.895848    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcffw\" (UniqueName: \"kubernetes.io/projected/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-kube-api-access-wcffw\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:38.896069 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:38.895857    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/cab90607-c6d1-4d0b-a987-1aa8bb7a1774-model-cache\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:39.374401 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.374365    2582 generic.go:356] "Generic (PLEG): container finished" podID="cab90607-c6d1-4d0b-a987-1aa8bb7a1774" containerID="e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d" exitCode=0
Sep 10 22:52:39.374586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.374427    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"
Sep 10 22:52:39.374586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.374456    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4" event={"ID":"cab90607-c6d1-4d0b-a987-1aa8bb7a1774","Type":"ContainerDied","Data":"e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d"}
Sep 10 22:52:39.374586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.374502    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4" event={"ID":"cab90607-c6d1-4d0b-a987-1aa8bb7a1774","Type":"ContainerDied","Data":"9e9d36cab7fbc8e79eb173c3d9db53b9a04514e2ccf90df6f916677a835b33c1"}
Sep 10 22:52:39.374586 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.374518    2582 scope.go:117] "RemoveContainer" containerID="e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d"
Sep 10 22:52:39.383501 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.383485    2582 scope.go:117] "RemoveContainer" containerID="e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d"
Sep 10 22:52:39.383817 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:52:39.383800    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d\": container with ID starting with e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d not found: ID does not exist" containerID="e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d"
Sep 10 22:52:39.383864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.383827    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d"} err="failed to get container status \"e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d\": rpc error: code = NotFound desc = could not find container \"e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d\": container with ID starting with e3d9eeb17bba597450fcb1f3dd8d600a8baf738399ac543920108fa003406b1d not found: ID does not exist"
Sep 10 22:52:39.394927 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.394901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"]
Sep 10 22:52:39.398513 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:39.398492    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-e70c95ab-kserve-655d77c5d7-lk4z4"]
Sep 10 22:52:40.052115 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.052080    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cab90607-c6d1-4d0b-a987-1aa8bb7a1774" path="/var/lib/kubelet/pods/cab90607-c6d1-4d0b-a987-1aa8bb7a1774/volumes"
Sep 10 22:52:40.153260 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.153217    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw" podUID="af2dd338-27af-49be-94e7-5a9d2ee3e3e1" containerName="main" containerID="cri-o://4221a21ce1db3038a810326bb48f7ea8990dd583b576a70a5cdabef650011467" gracePeriod=45
Sep 10 22:52:40.381331 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.381298    2582 generic.go:356] "Generic (PLEG): container finished" podID="af2dd338-27af-49be-94e7-5a9d2ee3e3e1" containerID="4221a21ce1db3038a810326bb48f7ea8990dd583b576a70a5cdabef650011467" exitCode=0
Sep 10 22:52:40.381495 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.381374    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw" event={"ID":"af2dd338-27af-49be-94e7-5a9d2ee3e3e1","Type":"ContainerDied","Data":"4221a21ce1db3038a810326bb48f7ea8990dd583b576a70a5cdabef650011467"}
Sep 10 22:52:40.410083 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.410057    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:40.510035 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510004    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-home\") pod \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") "
Sep 10 22:52:40.510189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510058    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-model-cache\") pod \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") "
Sep 10 22:52:40.510189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-dshm\") pod \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") "
Sep 10 22:52:40.510189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510137    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tmp-dir\") pod \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") "
Sep 10 22:52:40.510189 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510155    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkfd9\" (UniqueName: \"kubernetes.io/projected/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-kube-api-access-gkfd9\") pod \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") "
Sep 10 22:52:40.510407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510216    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tls-certs\") pod \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\" (UID: \"af2dd338-27af-49be-94e7-5a9d2ee3e3e1\") "
Sep 10 22:52:40.510407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510241    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-home" (OuterVolumeSpecName: "home") pod "af2dd338-27af-49be-94e7-5a9d2ee3e3e1" (UID: "af2dd338-27af-49be-94e7-5a9d2ee3e3e1"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:40.510407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510373    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-model-cache" (OuterVolumeSpecName: "model-cache") pod "af2dd338-27af-49be-94e7-5a9d2ee3e3e1" (UID: "af2dd338-27af-49be-94e7-5a9d2ee3e3e1"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:40.510407 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510389    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "af2dd338-27af-49be-94e7-5a9d2ee3e3e1" (UID: "af2dd338-27af-49be-94e7-5a9d2ee3e3e1"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:40.510565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510505    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-home\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:40.510565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510522    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-model-cache\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:40.510565 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.510531    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tmp-dir\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:40.512339 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.512312    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-dshm" (OuterVolumeSpecName: "dshm") pod "af2dd338-27af-49be-94e7-5a9d2ee3e3e1" (UID: "af2dd338-27af-49be-94e7-5a9d2ee3e3e1"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 10 22:52:40.512448 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.512385    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "af2dd338-27af-49be-94e7-5a9d2ee3e3e1" (UID: "af2dd338-27af-49be-94e7-5a9d2ee3e3e1"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:52:40.512549 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.512532    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-kube-api-access-gkfd9" (OuterVolumeSpecName: "kube-api-access-gkfd9") pod "af2dd338-27af-49be-94e7-5a9d2ee3e3e1" (UID: "af2dd338-27af-49be-94e7-5a9d2ee3e3e1"). InnerVolumeSpecName "kube-api-access-gkfd9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:52:40.611789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.611708    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-tls-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:40.611789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.611734    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-dshm\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:40.611789 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:40.611744    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkfd9\" (UniqueName: \"kubernetes.io/projected/af2dd338-27af-49be-94e7-5a9d2ee3e3e1-kube-api-access-gkfd9\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:41.388410 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:41.388333    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw" event={"ID":"af2dd338-27af-49be-94e7-5a9d2ee3e3e1","Type":"ContainerDied","Data":"796bdf600c8e863f49fb704a6806262f1f8b87f053709318810dd22d432dbd7b"}
Sep 10 22:52:41.388410 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:41.388363    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"
Sep 10 22:52:41.388410 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:41.388380    2582 scope.go:117] "RemoveContainer" containerID="4221a21ce1db3038a810326bb48f7ea8990dd583b576a70a5cdabef650011467"
Sep 10 22:52:41.409606 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:41.409584    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"]
Sep 10 22:52:41.414078 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:41.414059    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-e70c95ab-kserve-59674c4c4c-lxgpw"]
Sep 10 22:52:42.057320 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:42.057286    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="af2dd338-27af-49be-94e7-5a9d2ee3e3e1" path="/var/lib/kubelet/pods/af2dd338-27af-49be-94e7-5a9d2ee3e3e1/volumes"
Sep 10 22:52:44.095966 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.095933    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"]
Sep 10 22:52:44.096329 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.096290    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="af2dd338-27af-49be-94e7-5a9d2ee3e3e1" containerName="main"
Sep 10 22:52:44.096329 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.096305    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="af2dd338-27af-49be-94e7-5a9d2ee3e3e1" containerName="main"
Sep 10 22:52:44.096329 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.096323    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cab90607-c6d1-4d0b-a987-1aa8bb7a1774" containerName="main"
Sep 10 22:52:44.096329 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.096329    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="cab90607-c6d1-4d0b-a987-1aa8bb7a1774" containerName="main"
Sep 10 22:52:44.096463 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.096391    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="cab90607-c6d1-4d0b-a987-1aa8bb7a1774" containerName="main"
Sep 10 22:52:44.096463 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.096404    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="af2dd338-27af-49be-94e7-5a9d2ee3e3e1" containerName="main"
Sep 10 22:52:44.100769 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.100749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.114810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.114788    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"]
Sep 10 22:52:44.142224 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.142201    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkq5k\" (UniqueName: \"kubernetes.io/projected/59d3528c-09f9-4e9c-85e8-b892e8096f6d-kube-api-access-fkq5k\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.142362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.142231    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d3528c-09f9-4e9c-85e8-b892e8096f6d-metrics-certs\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.142362 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.142251    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d3528c-09f9-4e9c-85e8-b892e8096f6d-openshift-service-ca\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.142444 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.142353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d3528c-09f9-4e9c-85e8-b892e8096f6d-maas-api-tls\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.243498 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.243455    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d3528c-09f9-4e9c-85e8-b892e8096f6d-maas-api-tls\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.243730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.243558    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkq5k\" (UniqueName: \"kubernetes.io/projected/59d3528c-09f9-4e9c-85e8-b892e8096f6d-kube-api-access-fkq5k\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.243730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.243598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d3528c-09f9-4e9c-85e8-b892e8096f6d-metrics-certs\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.243730 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.243649    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d3528c-09f9-4e9c-85e8-b892e8096f6d-openshift-service-ca\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.244418 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.244390    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59d3528c-09f9-4e9c-85e8-b892e8096f6d-openshift-service-ca\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.246370 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.246343    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59d3528c-09f9-4e9c-85e8-b892e8096f6d-maas-api-tls\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.246507 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.246377    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59d3528c-09f9-4e9c-85e8-b892e8096f6d-metrics-certs\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.252120 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.252098    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkq5k\" (UniqueName: \"kubernetes.io/projected/59d3528c-09f9-4e9c-85e8-b892e8096f6d-kube-api-access-fkq5k\") pod \"maas-api-867d7774cd-rlvjj\" (UID: \"59d3528c-09f9-4e9c-85e8-b892e8096f6d\") " pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.411977 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.411881    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:44.695141 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:44.695044    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"]
Sep 10 22:52:44.697324 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:52:44.697297    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d3528c_09f9_4e9c_85e8_b892e8096f6d.slice/crio-b37948b7622aad09d0799172bdb564752092cb08c31577e8d69eec90ec6d0351 WatchSource:0}: Error finding container b37948b7622aad09d0799172bdb564752092cb08c31577e8d69eec90ec6d0351: Status 404 returned error can't find the container with id b37948b7622aad09d0799172bdb564752092cb08c31577e8d69eec90ec6d0351
Sep 10 22:52:45.409381 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:45.409344    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj" event={"ID":"59d3528c-09f9-4e9c-85e8-b892e8096f6d","Type":"ContainerStarted","Data":"5cf8d80263a5f9463513384c703654bf6e6ecac20b99df2ad195c223bab956a2"}
Sep 10 22:52:45.409864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:45.409400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj" event={"ID":"59d3528c-09f9-4e9c-85e8-b892e8096f6d","Type":"ContainerStarted","Data":"b37948b7622aad09d0799172bdb564752092cb08c31577e8d69eec90ec6d0351"}
Sep 10 22:52:45.409864 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:45.409462    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:45.430263 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:45.430216    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj" podStartSLOduration=0.911290287 podStartE2EDuration="1.430199117s" totalImagesPullingTime="518.90883ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-10 22:52:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:52:45.427892122 +0000 UTC m=+2065.839016250" watchObservedRunningTime="2026-09-10 22:52:45.430199117 +0000 UTC m=+2065.841323213"
Sep 10 22:52:51.419415 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:51.419387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-867d7774cd-rlvjj"
Sep 10 22:52:51.474980 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:51.474935    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7745fd994b-869nk"]
Sep 10 22:52:51.475207 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:51.475180    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" podUID="a02473a9-da17-41dc-a857-851ac676ba36" containerName="maas-api" containerID="cri-o://99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab" gracePeriod=30
Sep 10 22:52:52.393333 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.393286    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" podUID="a02473a9-da17-41dc-a857-851ac676ba36" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.31:8443/health\": dial tcp 10.134.0.31:8443: connect: connection refused"
Sep 10 22:52:52.725254 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.725231    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:52:52.820909 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.820877    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02473a9-da17-41dc-a857-851ac676ba36-openshift-service-ca\") pod \"a02473a9-da17-41dc-a857-851ac676ba36\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") "
Sep 10 22:52:52.821082 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.820947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls\") pod \"a02473a9-da17-41dc-a857-851ac676ba36\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") "
Sep 10 22:52:52.821082 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.820977    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-metrics-certs\") pod \"a02473a9-da17-41dc-a857-851ac676ba36\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") "
Sep 10 22:52:52.821082 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.821030    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4qlcb\" (UniqueName: \"kubernetes.io/projected/a02473a9-da17-41dc-a857-851ac676ba36-kube-api-access-4qlcb\") pod \"a02473a9-da17-41dc-a857-851ac676ba36\" (UID: \"a02473a9-da17-41dc-a857-851ac676ba36\") "
Sep 10 22:52:52.821336 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.821306    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a02473a9-da17-41dc-a857-851ac676ba36-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a02473a9-da17-41dc-a857-851ac676ba36" (UID: "a02473a9-da17-41dc-a857-851ac676ba36"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 10 22:52:52.823242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.823211    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a02473a9-da17-41dc-a857-851ac676ba36" (UID: "a02473a9-da17-41dc-a857-851ac676ba36"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:52:52.823242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.823226    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a02473a9-da17-41dc-a857-851ac676ba36-kube-api-access-4qlcb" (OuterVolumeSpecName: "kube-api-access-4qlcb") pod "a02473a9-da17-41dc-a857-851ac676ba36" (UID: "a02473a9-da17-41dc-a857-851ac676ba36"). InnerVolumeSpecName "kube-api-access-4qlcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 10 22:52:52.823242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.823229    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a02473a9-da17-41dc-a857-851ac676ba36" (UID: "a02473a9-da17-41dc-a857-851ac676ba36"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 10 22:52:52.922605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.922535    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4qlcb\" (UniqueName: \"kubernetes.io/projected/a02473a9-da17-41dc-a857-851ac676ba36-kube-api-access-4qlcb\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:52.922605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.922560    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a02473a9-da17-41dc-a857-851ac676ba36-openshift-service-ca\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:52.922605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.922569    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-maas-api-tls\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:52.922605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:52.922579    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a02473a9-da17-41dc-a857-851ac676ba36-metrics-certs\") on node \"ip-10-0-132-115.ec2.internal\" DevicePath \"\""
Sep 10 22:52:53.450737 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.450708    2582 generic.go:356] "Generic (PLEG): container finished" podID="a02473a9-da17-41dc-a857-851ac676ba36" containerID="99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab" exitCode=0
Sep 10 22:52:53.450923 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.450752    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk"
Sep 10 22:52:53.450923 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.450759    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" event={"ID":"a02473a9-da17-41dc-a857-851ac676ba36","Type":"ContainerDied","Data":"99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab"}
Sep 10 22:52:53.450923 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.450803    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7745fd994b-869nk" event={"ID":"a02473a9-da17-41dc-a857-851ac676ba36","Type":"ContainerDied","Data":"4a9ad1e35e3018abecdcb9d99a2c81f92122d52033eb41b207f8412c74969c28"}
Sep 10 22:52:53.450923 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.450824    2582 scope.go:117] "RemoveContainer" containerID="99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab"
Sep 10 22:52:53.459819 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.459800    2582 scope.go:117] "RemoveContainer" containerID="99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab"
Sep 10 22:52:53.460084 ip-10-0-132-115 kubenswrapper[2582]: E0910 22:52:53.460067    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab\": container with ID starting with 99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab not found: ID does not exist" containerID="99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab"
Sep 10 22:52:53.460151 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.460090    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab"} err="failed to get container status \"99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab\": rpc error: code = NotFound desc = could not find container \"99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab\": container with ID starting with 99fdbbd52bb66f23c5a6362a2ef99351acd26b5aa989859d063f75690049a1ab not found: ID does not exist"
Sep 10 22:52:53.471353 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.471332    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7745fd994b-869nk"]
Sep 10 22:52:53.475283 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:53.475264    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7745fd994b-869nk"]
Sep 10 22:52:54.058810 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:52:54.058767    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a02473a9-da17-41dc-a857-851ac676ba36" path="/var/lib/kubelet/pods/a02473a9-da17-41dc-a857-851ac676ba36/volumes"
Sep 10 22:53:13.834966 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:13.834935    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574fcc4575-2pn4k_d59d37d8-68f4-44c0-a81b-81f561ba83d2/authorino/0.log"
Sep 10 22:53:18.983179 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:18.983144    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wj96s_712061dc-5999-445c-891a-3328e33599bc/manager/0.log"
Sep 10 22:53:19.229034 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:19.229001    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77786d6846-96hdw_2707f4e9-cff5-4bb6-b551-c004c7842144/manager/0.log"
Sep 10 22:53:19.340855 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:19.340776    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d5c4d_e4b79068-095d-4fb6-8180-8f3a632b7ad8/server/0.log"
Sep 10 22:53:19.460094 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:19.460050    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vrj9b_df2ae45b-0645-45cb-9698-32ebe6254fd2/manager/0.log"
Sep 10 22:53:19.570849 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:19.570822    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-fgkxh_3d279e9c-87be-4f58-b0b3-1aa80d811029/copy-manifests/0.log"
Sep 10 22:53:19.577349 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:19.577320    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-fgkxh_3d279e9c-87be-4f58-b0b3-1aa80d811029/manager/0.log"
Sep 10 22:53:20.255900 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:20.255859    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-867d7774cd-rlvjj_59d3528c-09f9-4e9c-85e8-b892e8096f6d/maas-api/0.log"
Sep 10 22:53:21.326122 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:21.326092    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574fcc4575-2pn4k_d59d37d8-68f4-44c0-a81b-81f561ba83d2/authorino/0.log"
Sep 10 22:53:21.439247 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:21.439204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-6f7gn_ccf0098c-48d8-4f05-8182-62f61f2a10dd/manager/0.log"
Sep 10 22:53:21.553986 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:21.553959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kfvxs_d233c055-1ead-4793-bb79-7064be272dfc/manager/0.log"
Sep 10 22:53:22.339607 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:22.339573    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2_4fc0868b-d794-40b5-99d1-39a2b9b8ad11/istio-proxy/0.log"
Sep 10 22:53:22.785877 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:22.785841    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/1.log"
Sep 10 22:53:23.471193 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:23.471152    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-xsgwv_22e12c27-a531-4c34-acc5-10da084b2660/main/0.log"
Sep 10 22:53:32.260017 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:32.259971    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mbgnw_f5cddcb1-7bef-4658-896f-0ab5438faf04/global-pull-secret-syncer/0.log"
Sep 10 22:53:32.357722 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:32.357692    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-pk8xd_8f80cdeb-4835-4ee5-81f0-916e465a2bf2/konnectivity-agent/0.log"
Sep 10 22:53:32.412230 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:32.411957    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-115.ec2.internal_82fcad01bd7bd54ee0f5340fe75828b3/haproxy/0.log"
Sep 10 22:53:37.034260 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:37.034226    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574fcc4575-2pn4k_d59d37d8-68f4-44c0-a81b-81f561ba83d2/authorino/0.log"
Sep 10 22:53:37.061711 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:37.061684    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-6f7gn_ccf0098c-48d8-4f05-8182-62f61f2a10dd/manager/0.log"
Sep 10 22:53:37.095345 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:37.095315    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-kfvxs_d233c055-1ead-4793-bb79-7064be272dfc/manager/0.log"
Sep 10 22:53:39.192039 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.192009    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nmdwj_09a67ff0-e2f1-49fa-a681-9437849d6d90/node-exporter/0.log"
Sep 10 22:53:39.235562 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.235538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nmdwj_09a67ff0-e2f1-49fa-a681-9437849d6d90/kube-rbac-proxy/0.log"
Sep 10 22:53:39.255457 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.255439    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nmdwj_09a67ff0-e2f1-49fa-a681-9437849d6d90/init-textfile/0.log"
Sep 10 22:53:39.397918 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.397843    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/prometheus/0.log"
Sep 10 22:53:39.423500 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.423471    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/config-reloader/0.log"
Sep 10 22:53:39.450712 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.450690    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/thanos-sidecar/0.log"
Sep 10 22:53:39.473026 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.473008    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/kube-rbac-proxy-web/0.log"
Sep 10 22:53:39.495975 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.495956    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/kube-rbac-proxy/0.log"
Sep 10 22:53:39.520088 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.520069    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/kube-rbac-proxy-thanos/0.log"
Sep 10 22:53:39.541451 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.541430    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_046a5f29-9fb1-47ee-852a-b5caafbe0f5e/init-config-reloader/0.log"
Sep 10 22:53:39.657239 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.657153    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c4f4d5954-6fn7j_57593d0d-eb49-48cd-a7fb-ffefd79bca0e/telemeter-client/0.log"
Sep 10 22:53:39.677984 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.677959    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c4f4d5954-6fn7j_57593d0d-eb49-48cd-a7fb-ffefd79bca0e/reload/0.log"
Sep 10 22:53:39.699914 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:39.699887    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c4f4d5954-6fn7j_57593d0d-eb49-48cd-a7fb-ffefd79bca0e/kube-rbac-proxy/0.log"
Sep 10 22:53:42.265210 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.265173    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"]
Sep 10 22:53:42.265593 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.265515    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a02473a9-da17-41dc-a857-851ac676ba36" containerName="maas-api"
Sep 10 22:53:42.265593 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.265526    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a02473a9-da17-41dc-a857-851ac676ba36" containerName="maas-api"
Sep 10 22:53:42.265593 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.265590    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a02473a9-da17-41dc-a857-851ac676ba36" containerName="maas-api"
Sep 10 22:53:42.268631 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.268605    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.271002 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.270979    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-n6fx2\"/\"default-dockercfg-bc8jm\""
Sep 10 22:53:42.271399 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.271379    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fx2\"/\"openshift-service-ca.crt\""
Sep 10 22:53:42.271822 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.271806    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-n6fx2\"/\"kube-root-ca.crt\""
Sep 10 22:53:42.282541 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.282523    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"]
Sep 10 22:53:42.356527 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.356488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvdfx\" (UniqueName: \"kubernetes.io/projected/dc64a007-c925-4968-b0a3-2c77261d191d-kube-api-access-wvdfx\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.356735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.356536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-podres\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.356735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.356603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-proc\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.356735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.356667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-sys\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.356735 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.356715    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-lib-modules\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.457639 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457580    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-proc\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.457832 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457657    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-sys\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.457832 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457712    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-proc\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.457832 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457715    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-lib-modules\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.457832 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-sys\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.457832 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvdfx\" (UniqueName: \"kubernetes.io/projected/dc64a007-c925-4968-b0a3-2c77261d191d-kube-api-access-wvdfx\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.458045 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-lib-modules\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.458045 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-podres\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.458045 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.457912    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dc64a007-c925-4968-b0a3-2c77261d191d-podres\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.466163 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.466142    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvdfx\" (UniqueName: \"kubernetes.io/projected/dc64a007-c925-4968-b0a3-2c77261d191d-kube-api-access-wvdfx\") pod \"perf-node-gather-daemonset-jxrfb\" (UID: \"dc64a007-c925-4968-b0a3-2c77261d191d\") " pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.578495 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.578421    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:42.863329 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:42.863306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"]
Sep 10 22:53:42.865558 ip-10-0-132-115 kubenswrapper[2582]: W0910 22:53:42.865529    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poddc64a007_c925_4968_b0a3_2c77261d191d.slice/crio-4a9470f40b35aebcad8721e36dedc9df5696e5f966a3f6778092767a85a60712 WatchSource:0}: Error finding container 4a9470f40b35aebcad8721e36dedc9df5696e5f966a3f6778092767a85a60712: Status 404 returned error can't find the container with id 4a9470f40b35aebcad8721e36dedc9df5696e5f966a3f6778092767a85a60712
Sep 10 22:53:43.680220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:43.680179    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb" event={"ID":"dc64a007-c925-4968-b0a3-2c77261d191d","Type":"ContainerStarted","Data":"ba87173a9030f613c76e916472f27a209504942650bfb453b4d70deb62166f9e"}
Sep 10 22:53:43.680605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:43.680242    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb" event={"ID":"dc64a007-c925-4968-b0a3-2c77261d191d","Type":"ContainerStarted","Data":"4a9470f40b35aebcad8721e36dedc9df5696e5f966a3f6778092767a85a60712"}
Sep 10 22:53:43.680605 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:43.680280    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:43.704676 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:43.704607    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb" podStartSLOduration=1.704589817 podStartE2EDuration="1.704589817s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-10 22:53:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-10 22:53:43.702811495 +0000 UTC m=+2124.113935611" watchObservedRunningTime="2026-09-10 22:53:43.704589817 +0000 UTC m=+2124.115713914"
Sep 10 22:53:44.635498 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:44.635466    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bn5nb_03779c95-773d-48f1-96c3-00d2e4807249/dns/0.log"
Sep 10 22:53:44.662242 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:44.662219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bn5nb_03779c95-773d-48f1-96c3-00d2e4807249/kube-rbac-proxy/0.log"
Sep 10 22:53:44.749420 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:44.749393    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6vhxd_ed634a41-32e8-43ad-b284-b5b4bb343000/dns-node-resolver/0.log"
Sep 10 22:53:45.416850 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:45.416821    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5n2rf_08d93491-1457-452a-9960-94f5e6368c19/node-ca/0.log"
Sep 10 22:53:46.458350 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:46.458322    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2_4fc0868b-d794-40b5-99d1-39a2b9b8ad11/istio-proxy/0.log"
Sep 10 22:53:46.750933 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:46.750902    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/0.log"
Sep 10 22:53:46.759566 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:46.759548    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/1.log"
Sep 10 22:53:47.719319 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:47.719291    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-hjfcn_0103b04b-e98c-4304-ad80-622fa351b2f5/serve-healthcheck-canary/0.log"
Sep 10 22:53:48.332481 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:48.332450    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lkwmm_3b340d25-776a-4978-a434-d25b18d4f326/kube-rbac-proxy/0.log"
Sep 10 22:53:48.354231 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:48.354209    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lkwmm_3b340d25-776a-4978-a434-d25b18d4f326/exporter/0.log"
Sep 10 22:53:48.374653 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:48.374616    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-lkwmm_3b340d25-776a-4978-a434-d25b18d4f326/extractor/0.log"
Sep 10 22:53:49.694914 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:49.694877    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-n6fx2/perf-node-gather-daemonset-jxrfb"
Sep 10 22:53:50.506267 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:50.506236    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-wj96s_712061dc-5999-445c-891a-3328e33599bc/manager/0.log"
Sep 10 22:53:50.720811 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:50.720785    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-77786d6846-96hdw_2707f4e9-cff5-4bb6-b551-c004c7842144/manager/0.log"
Sep 10 22:53:50.741014 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:50.740994    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-d5c4d_e4b79068-095d-4fb6-8180-8f3a632b7ad8/server/0.log"
Sep 10 22:53:50.828023 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:50.827999    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-vrj9b_df2ae45b-0645-45cb-9698-32ebe6254fd2/manager/0.log"
Sep 10 22:53:50.857968 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:50.857942    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-fgkxh_3d279e9c-87be-4f58-b0b3-1aa80d811029/manager/0.log"
Sep 10 22:53:50.876699 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:50.876674    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7c969df88c-fgkxh_3d279e9c-87be-4f58-b0b3-1aa80d811029/copy-manifests/0.log"
Sep 10 22:53:52.319066 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:52.319034    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2_4fc0868b-d794-40b5-99d1-39a2b9b8ad11/istio-proxy/0.log"
Sep 10 22:53:52.512825 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:52.512791    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5dbdc5d69b-rx4vd_48eea559-2368-4583-a141-83fa6404309c/manager/0.log"
Sep 10 22:53:52.582406 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:52.582328    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/0.log"
Sep 10 22:53:52.590795 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:52.590774    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/1.log"
Sep 10 22:53:54.061452 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:54.061366    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-7r4m2_4fc0868b-d794-40b5-99d1-39a2b9b8ad11/istio-proxy/0.log"
Sep 10 22:53:54.332365 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:54.332283    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/0.log"
Sep 10 22:53:54.339704 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:54.339683    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-vhj5h_0b942aee-ebe6-4815-83d1-16deda36e23b/istio-proxy/1.log"
Sep 10 22:53:57.354703 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:57.354670    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-rp9lg_363926c5-121f-4403-8437-fe358372e1c0/migrator/0.log"
Sep 10 22:53:57.377054 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:57.377017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-rp9lg_363926c5-121f-4403-8437-fe358372e1c0/graceful-termination/0.log"
Sep 10 22:53:59.046663 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.046606    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/kube-multus-additional-cni-plugins/0.log"
Sep 10 22:53:59.066522 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.066494    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/egress-router-binary-copy/0.log"
Sep 10 22:53:59.086840 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.086817    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/cni-plugins/0.log"
Sep 10 22:53:59.108110 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.108088    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/bond-cni-plugin/0.log"
Sep 10 22:53:59.128112 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.128093    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/routeoverride-cni/0.log"
Sep 10 22:53:59.149039 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.149016    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/whereabouts-cni-bincopy/0.log"
Sep 10 22:53:59.169220 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.169197    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdm9n_9d7b9f91-5cd3-431b-aa58-4988c9a4a316/whereabouts-cni/0.log"
Sep 10 22:53:59.247600 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.247574    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qxlr8_909fbf1f-b42a-4c59-91cf-c857341897ac/kube-multus/0.log"
Sep 10 22:53:59.368385 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.368301    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gksvb_bb2c383e-17d3-4fca-8318-263477372340/network-metrics-daemon/0.log"
Sep 10 22:53:59.388782 ip-10-0-132-115 kubenswrapper[2582]: I0910 22:53:59.388759    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gksvb_bb2c383e-17d3-4fca-8318-263477372340/kube-rbac-proxy/0.log"