Sep 08 10:01:27.575866 ip-10-0-134-238 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 10:01:27.964394 ip-10-0-134-238 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 10:01:27.964394 ip-10-0-134-238 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 10:01:27.964394 ip-10-0-134-238 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 10:01:27.964394 ip-10-0-134-238 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 10:01:27.964394 ip-10-0-134-238 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 10:01:27.966379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.966302    2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 10:01:27.971657 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971632    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 10:01:27.971657 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971656    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 10:01:27.971657 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971663    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971668    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971673    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971678    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971682    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971691    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971698    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971703    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971708    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971713    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971717    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971724    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971729    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971734    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971738    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971743    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971746    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971750    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971755    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 10:01:27.971806 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971759    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971763    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971767    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971771    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971775    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971781    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971785    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971790    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971794    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971798    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971802    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971807    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971812    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971815    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971818    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971820    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971823    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971826    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971828    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 10:01:27.972259 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971831    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971834    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971837    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971840    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971844    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971848    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971850    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971853    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971855    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971858    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971862    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971864    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971867    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971870    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971873    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971876    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971878    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971881    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971885    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971888    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 10:01:27.972734 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971893    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971896    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971899    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971902    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971904    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971907    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971910    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971912    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971915    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971920    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971922    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971925    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971928    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971930    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971933    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971935    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971938    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971941    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971943    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971946    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 10:01:27.973224 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971949    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971951    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971954    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971957    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971959    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971962    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971965    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971968    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971970    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971973    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971975    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971978    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971981    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971983    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971986    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971989    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971992    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971994    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.971997    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973480    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 10:01:27.973733 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973489    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973492    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973495    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973498    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973501    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973505    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973508    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973510    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973513    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973516    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973519    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973523    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973526    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973530    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973533    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973537    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973540    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973543    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973546    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 10:01:27.974234 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973549    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973553    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973556    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973558    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973561    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973563    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973580    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973583    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973586    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973588    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973591    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973594    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973597    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973599    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973602    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973604    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973607    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973609    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973612    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973614    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 10:01:27.974762 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973617    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973619    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973622    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973624    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973630    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973633    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973637    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973640    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973643    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973646    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973649    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973652    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973655    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973658    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973661    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973663    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973666    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973669    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973671    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973674    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 10:01:27.975254 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973676    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973679    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973682    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973684    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973687    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973689    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973691    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973694    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973696    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973699    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973701    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973704    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973707    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973710    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973713    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973715    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973718    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973720    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973723    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973725    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 10:01:27.975756 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973728    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973730    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973733    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973736    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973739    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973742    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973746    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973750    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973752    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973755    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973757    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973759    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973762    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973765    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973768    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973770    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973773    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973775    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.973778    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 10:01:27.976249 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974156    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974160    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974163    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974166    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974169    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974172    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974174    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974177    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974181    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974185    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974188    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974191    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974195    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974198    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974201    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974204    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974207    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974210    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974213    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 10:01:27.976712 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974216    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974218    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974221    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974224    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974227    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974229    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974232    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974235    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974237    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974240    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974243    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974245    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974248    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974250    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974253    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974256    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974259    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974261    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974264    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974266    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 10:01:27.977179 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974269    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974271    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974273    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974276    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974279    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974283    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974286    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974288    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974291    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974294    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974298    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974300    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974303    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974305    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974308    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974310    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974313    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974316    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974319    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974322    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 10:01:27.977680 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974324    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974327    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974329    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974332    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974335    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974337    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974340    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974342    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974345    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974347    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974350    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974352    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974355    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974357    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974360    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974364    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974367    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974370    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974373    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 10:01:27.978173 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974376    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974379    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974382    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974385    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974388    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974391    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974393    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974396    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974398    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974401    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974403    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974406    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974408    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974411    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974413    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974416    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974418    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974420    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974423    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974425    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 10:01:27.978643 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.974428    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974505    2582 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974551    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974558    2582 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974562    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974579    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974585    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974589    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974593    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974597    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974600    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974603    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974607    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974610    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974613    2582 flags.go:64] FLAG: --cgroup-root=""
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974616    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974619    2582 flags.go:64] FLAG: --client-ca-file=""
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974623    2582 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974626    2582 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974631    2582 flags.go:64] FLAG: --cluster-domain=""
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974633    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974637    2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974640    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974643    2582 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 10:01:27.979127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974647    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974650    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974652    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974656    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974659    2582 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974662    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974665    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974668    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974671    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974675    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974678    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974681    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974684    2582 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974686    2582 flags.go:64] FLAG: --enable-server="true"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974691    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974694    2582 flags.go:64] FLAG: --event-burst="100"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974697    2582 flags.go:64] FLAG: --event-qps="50"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974700    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974703    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974706    2582 flags.go:64] FLAG: --eviction-hard=""
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974710    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974713    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974716    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974719    2582 flags.go:64] FLAG: --eviction-soft=""
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974722    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 10:01:27.979755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974725    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974728    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974731    2582 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974734    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974737    2582 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974740    2582 flags.go:64] FLAG: --feature-gates=""
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974743    2582 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974746    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974749    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974752    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974755    2582 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974758    2582 flags.go:64] FLAG: --help="false"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974761    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-134-238.ec2.internal"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974764    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974767    2582 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974770    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974774    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974777    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974780    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974783    2582 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974786    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974790    2582 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974793    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974796    2582 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 10:01:27.980379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974799    2582 flags.go:64] FLAG: --kube-reserved=""
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974802    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974805    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974808    2582 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974811    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974815    2582 flags.go:64] FLAG: --lock-file=""
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974818    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974821    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974824    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974829    2582 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974832    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974835    2582 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974838    2582 flags.go:64] FLAG: --logging-format="text"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974841    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974844    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974847    2582 flags.go:64] FLAG: --manifest-url=""
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974849    2582 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974854    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974857    2582 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974861    2582 flags.go:64] FLAG: --max-pods="110"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974864    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974866    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974869    2582 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974872    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974875    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 10:01:27.981002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974878    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974881    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974888    2582 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974892    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974896    2582 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974899    2582 flags.go:64] FLAG: --pod-cidr=""
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974901    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974907    2582 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974910    2582 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974913    2582 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974916    2582 flags.go:64] FLAG: --port="10250"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974919    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974926    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ad5c914e9b0b6f4c"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974929    2582 flags.go:64] FLAG: --qos-reserved=""
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974932    2582 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974935    2582 flags.go:64] FLAG: --register-node="true"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974938    2582 flags.go:64] FLAG: --register-with-taints=""
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974942    2582 flags.go:64] FLAG: --registry-burst="10"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974945    2582 flags.go:64] FLAG: --registry-qps="5"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974948    2582 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974951    2582 flags.go:64] FLAG: --reserved-memory=""
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974955    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974958    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974961    2582 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974963    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 10:01:27.981625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974966    2582 flags.go:64] FLAG: --runonce="false"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974969    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974972    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974975    2582 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974978    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974981    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974984    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974987    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974990    2582 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974993    2582 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974996    2582 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.974999    2582 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975004    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975007    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975010    2582 flags.go:64] FLAG: --system-cgroups=""
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975013    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975018    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975021    2582 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975024    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975033    2582 flags.go:64] FLAG: --tls-min-version=""
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975035    2582 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975038    2582 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975041    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975044    2582 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975047    2582 flags.go:64] FLAG: --v="2"
Sep 08 10:01:27.982243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975051    2582 flags.go:64] FLAG: --version="false"
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975056    2582 flags.go:64] FLAG: --vmodule=""
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975059    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.975062    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975172    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975176    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975179    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975182    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975185    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975188    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975192    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975195    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975198    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975201    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975204    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975207    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975210    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975213    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975215    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975220    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 10:01:27.982901 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975223    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975226    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975229    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975231    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975234    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975237    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975241    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975244    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975246    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975249    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975252    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975254    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975257    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975260    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975263    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975266    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975269    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975271    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975274    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975276    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 10:01:27.983407 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975279    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975282    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975284    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975287    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975291    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975294    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975297    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975299    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975302    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975305    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975307    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975310    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975313    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975315    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975318    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975320    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975323    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975326    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975329    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975332    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 10:01:27.983913 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975334    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975337    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975340    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975342    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975344    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975347    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975349    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975353    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975356    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975358    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975361    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975363    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975366    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975368    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975371    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975374    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975376    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975379    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975382    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975385    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 10:01:27.984396 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975387    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975398    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975401    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975404    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975406    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975409    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975412    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975414    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975417    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975419    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975423    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975426    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975428    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975431    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975434    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975436    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975439    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975442    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975446    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 10:01:27.984985 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975449    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975452    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975455    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.975457    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.976062    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.983042    2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.983057    2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.983810    2582 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.983818    2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983881    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983886    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983889    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983892    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983895    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983898    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 10:01:27.985439 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983901    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983903    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983906    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983909    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983912    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983914    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983917    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983920    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983923    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983926    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983929    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983931    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983934    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983936    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983939    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983941    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983944    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983947    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983949    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983952    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 10:01:27.985824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983954    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983957    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983959    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983963    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983966    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983969    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983971    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983974    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983978    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983982    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983985    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983987    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983990    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983993    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983995    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.983998    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984000    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984002    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984005    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984008    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 10:01:27.986308 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984010    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984013    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984017    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984020    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984023    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984026    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984029    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984032    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984034    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984037    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984040    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984043    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984046    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984048    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984051    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984055    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984058    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984060    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984063    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 10:01:27.986842 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984066    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984069    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984071    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984074    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984076    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984079    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984081    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984084    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984086    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984089    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984091    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984094    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984097    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984099    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984102    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984104    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984107    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984109    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984112    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 10:01:27.987311 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984114    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984118    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984121    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984124    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984127    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984130    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984132    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984135    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984137    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984141    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984143    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984147    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984149    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984152    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 10:01:27.987784 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984154    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.984159    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984263    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984267    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984270    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984273    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984275    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984279    2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984283    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984287    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984291    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984294    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984297    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984300    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 10:01:27.988121 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984303    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984306    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984309    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984312    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984315    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984317    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984320    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984323    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984325    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984328    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984330    2582 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984333    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984336    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984338    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984341    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984344    2582 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984347    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984350    2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984352    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984355    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 10:01:27.988476 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984357    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984360    2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984362    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984365    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984367    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984369    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984372    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984375    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984378    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984380    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984383    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984385    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984388    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984391    2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984393    2582 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984396    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984398    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984402    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984406    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984409    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 10:01:27.988966 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984412    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984414    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984417    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984420    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984422    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984425    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984427    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984430    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984432    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984435    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984438    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984440    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984443    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984446    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984449    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984451    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984454    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984456    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984459    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984461    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 10:01:27.989451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984464    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984466    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984468    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984471    2582 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984473    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984476    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984478    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984481    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984483    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984486    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984488    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984491    2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984494    2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984496    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984499    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984501    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984504    2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984506    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984509    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 10:01:27.989943 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984512    2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984514    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984516    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984519    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984522    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984524    2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984527    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:27.984529    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.984534    2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.984642    2582 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.986492    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.987596    2582 server.go:1019] "Starting client certificate rotation"
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.987691    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 10:01:27.990412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.987719    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 10:01:27.990780 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.989883    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 10:01:27.991004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:27.990988    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 10:01:28.000265 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.000247    2582 log.go:25] "Validated CRI v1 runtime API"
Sep 08 10:01:28.004359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.004341    2582 log.go:25] "Validated CRI v1 image API"
Sep 08 10:01:28.006424 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.006412    2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 10:01:28.010443 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.010426    2582 fs.go:135] Filesystem UUIDs: map[3745c3ce-82d9-4486-b47e-315b57662ff9:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 ae51bf41-46ac-4681-8010-4d80aacaa350:/dev/nvme0n1p4]
Sep 08 10:01:28.010495 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.010442    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 10:01:28.015168 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.015151    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 10:01:28.015994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.015887    2582 manager.go:216] Machine: {Timestamp:2026-09-08 10:01:28.014425688 +0000 UTC m=+0.324954314 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3110368 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec287a41768e4268c1f56bdc80d3f798 SystemUUID:ec287a41-768e-4268-c1f5-6bdc80d3f798 BootID:dd293a49-c42b-47c1-95c2-56937c289831 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:de:aa:b9:f2:fd Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:de:aa:b9:f2:fd Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:15:09:f3:25:f9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 10:01:28.015994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.015993    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 10:01:28.016105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.016066    2582 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 10:01:28.018749 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.018729    2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 10:01:28.018881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.018751    2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-238.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 10:01:28.019936 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.019926    2582 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 10:01:28.019975 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.019939    2582 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 10:01:28.019975 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.019951    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 10:01:28.020503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.020493    2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 10:01:28.021762 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.021753    2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 10:01:28.025157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025147    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 10:01:28.025264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025255    2582 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 10:01:28.025306 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025282    2582 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 10:01:28.025306 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025291    2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 10:01:28.025306 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025301    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 10:01:28.025411 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025311    2582 kubelet.go:398] "Adding apiserver pod source"
Sep 08 10:01:28.025411 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025319    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 10:01:28.025637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025614    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 10:01:28.025637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.025640    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 10:01:28.027965 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.027949    2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 10:01:28.030031 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030018    2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 10:01:28.030081 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030047    2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 10:01:28.030202 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030191    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 10:01:28.030250 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030209    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 10:01:28.030250 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030215    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 10:01:28.030250 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030224    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 10:01:28.030250 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030235    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 10:01:28.030250 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030243    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 10:01:28.030821 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030811    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 10:01:28.030821 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030821    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 10:01:28.030886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030827    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 10:01:28.030886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030833    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 10:01:28.030886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030841    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 10:01:28.030886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.030848    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 10:01:28.031620 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.031608    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 10:01:28.031655 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.031621    2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 10:01:28.034691 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.034672    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vggvl"
Sep 08 10:01:28.034972 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.034951    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-238.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 10:01:28.035128 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.034954    2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 10:01:28.035274 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.034975    2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-238.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 10:01:28.035980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.035959    2582 server.go:1268] "Started kubelet"
Sep 08 10:01:28.036501 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.036459    2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 10:01:28.036602 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.036530    2582 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 10:01:28.036667 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.036515    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 10:01:28.037371 ip-10-0-134-238 systemd[1]: Started Kubernetes Kubelet.
Sep 08 10:01:28.038354 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.037882    2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 10:01:28.039947 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.039922    2582 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 10:01:28.041023 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.041003    2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 10:01:28.042742 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.042549    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 10:01:28.042831 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.042760    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-vggvl"
Sep 08 10:01:28.043443 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.043426    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 10:01:28.044127 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.044098    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.044238 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044178    2582 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 10:01:28.044238 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044194    2582 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 10:01:28.044340 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044254    2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 10:01:28.044340 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044307    2582 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 10:01:28.044340 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044314    2582 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 10:01:28.044656 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044558    2582 factory.go:55] Registering systemd factory
Sep 08 10:01:28.044656 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.044585    2582 factory.go:223] Registration of the systemd container factory successfully
Sep 08 10:01:28.045031 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.045012    2582 factory.go:153] Registering CRI-O factory
Sep 08 10:01:28.045031 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.045032    2582 factory.go:223] Registration of the crio container factory successfully
Sep 08 10:01:28.045157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.045077    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 10:01:28.045157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.045095    2582 factory.go:103] Registering Raw factory
Sep 08 10:01:28.045157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.045110    2582 manager.go:1196] Started watching for new ooms in manager
Sep 08 10:01:28.045550 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.045538    2582 manager.go:349] Starting recovery of all containers
Sep 08 10:01:28.046311 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.045127    2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-238.ec2.internal.18d3503a3bad9ca4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-238.ec2.internal,UID:ip-10-0-134-238.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-238.ec2.internal,},FirstTimestamp:2026-09-08 10:01:28.0357777 +0000 UTC m=+0.346306297,LastTimestamp:2026-09-08 10:01:28.0357777 +0000 UTC m=+0.346306297,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-238.ec2.internal,}"
Sep 08 10:01:28.054784 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.054767    2582 manager.go:354] Recovery completed
Sep 08 10:01:28.055422 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.055400    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 10:01:28.058075 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.058057    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-238.ec2.internal\" not found" node="ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.059910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.059897    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.061719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.061705    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.061800 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.061743    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.061800 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.061759    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.062350 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.062338    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 10:01:28.062350 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.062349    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.062477 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.062350    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 10:01:28.062477 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.062390    2582 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 10:01:28.063042 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.063028    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.063108 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.063055    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.063108 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.063068    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.064257 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.064245    2582 policy_none.go:49] "None policy: Start"
Sep 08 10:01:28.064320 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.064264    2582 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 10:01:28.064320 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.064277    2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 10:01:28.066195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.066178    2582 policy_none.go:47] "Start"
Sep 08 10:01:28.107150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107134    2582 manager.go:337] "Starting Device Plugin manager"
Sep 08 10:01:28.107248 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.107179    2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 10:01:28.107248 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107193    2582 server.go:87] "Starting device plugin registration server"
Sep 08 10:01:28.107463 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107451    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 10:01:28.107517 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107468    2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 10:01:28.107626 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107609    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 10:01:28.107720 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107694    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 10:01:28.107720 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.107707    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 10:01:28.108374 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.108355    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 10:01:28.108437 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.108407    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.168564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.168519    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 10:01:28.169746 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.169727    2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 10:01:28.169871 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.169777    2582 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 10:01:28.169871 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.169802    2582 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 10:01:28.169871 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.169845    2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 10:01:28.172127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.172105    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 10:01:28.208139 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.207987    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.209006 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.208991    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.209071 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.209021    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.209071 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.209032    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.209071 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.209059    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.215312 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.215247    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.215312 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.215267    2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-238.ec2.internal\": node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.228730 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.228711    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.270459 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.270436    2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"]
Sep 08 10:01:28.270519 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.270499    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.271347 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.271325    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.271428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.271362    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.271428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.271374    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.273665 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.273653    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.273766 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.273754    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.273796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.273781    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.276683 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.276663    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.276769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.276694    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.276769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.276708    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.276769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.276745    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.276769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.276767    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.276931 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.276780    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.278777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.278762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.278862 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.278786    2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 10:01:28.279469 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.279453    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 10:01:28.279538 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.279485    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 10:01:28.279538 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.279496    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeHasSufficientPID"
Sep 08 10:01:28.299180 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.299155    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-238.ec2.internal\" not found" node="ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.303486 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.303471    2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-238.ec2.internal\" not found" node="ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.328953 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.328933    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.345480 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.345457    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad3e834b17dfd8249f17c510706cb839-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal\" (UID: \"ad3e834b17dfd8249f17c510706cb839\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.345564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.345487    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/385c83f897bbb0f00e8342d23450ac7c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-238.ec2.internal\" (UID: \"385c83f897bbb0f00e8342d23450ac7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.345564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.345509    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad3e834b17dfd8249f17c510706cb839-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal\" (UID: \"ad3e834b17dfd8249f17c510706cb839\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.429524 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.429493    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.445782 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.445761    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/385c83f897bbb0f00e8342d23450ac7c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-238.ec2.internal\" (UID: \"385c83f897bbb0f00e8342d23450ac7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.445842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.445790    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/385c83f897bbb0f00e8342d23450ac7c-config\") pod \"kube-apiserver-proxy-ip-10-0-134-238.ec2.internal\" (UID: \"385c83f897bbb0f00e8342d23450ac7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.445842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.445834    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad3e834b17dfd8249f17c510706cb839-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal\" (UID: \"ad3e834b17dfd8249f17c510706cb839\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.445917 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.445851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad3e834b17dfd8249f17c510706cb839-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal\" (UID: \"ad3e834b17dfd8249f17c510706cb839\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.445917 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.445891    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad3e834b17dfd8249f17c510706cb839-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal\" (UID: \"ad3e834b17dfd8249f17c510706cb839\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.446031 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.445927    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad3e834b17dfd8249f17c510706cb839-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal\" (UID: \"ad3e834b17dfd8249f17c510706cb839\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.530186 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.530140    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.601550 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.601533    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.607131 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:28.607118    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:28.630541 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.630517    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.730995 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.730973    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.831445 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.831406    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:28.931990 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:28.931969    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:30.721066 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:30.721044    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 10:01:30.721417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:30.721172    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 10:01:30.721417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:30.721195    2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 10:01:30.766553 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:30.766533    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:30.781898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:30.781874    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 09:56:29 +0000 UTC" deadline="2028-03-08 17:45:16.676022226 +0000 UTC"
Sep 08 10:01:30.781946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:30.781897    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13135h43m45.894128427s"
Sep 08 10:01:30.867427 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:30.867372    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:30.967473 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:30.967450    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:31.013358 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.013338    2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 10:01:31.034024 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:31.033989    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod385c83f897bbb0f00e8342d23450ac7c.slice/crio-74d1fc0ca65680f9705c7c123f4f9f35193f34c73b427af77b7a09608fe74485 WatchSource:0}: Error finding container 74d1fc0ca65680f9705c7c123f4f9f35193f34c73b427af77b7a09608fe74485: Status 404 returned error can't find the container with id 74d1fc0ca65680f9705c7c123f4f9f35193f34c73b427af77b7a09608fe74485
Sep 08 10:01:31.038848 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.038835    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:01:31.067884 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.067865    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:31.168265 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.168251    2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-238.ec2.internal\" not found"
Sep 08 10:01:31.255958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.255938    2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 10:01:31.277993 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.277972    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:31.288398 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.288377    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 10:01:31.289509 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.289495    2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal"
Sep 08 10:01:31.296975 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.296962    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 10:01:31.745686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.745663    2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 10:01:31.759611 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.759589    2582 apiserver.go:52] "Watching apiserver"
Sep 08 10:01:31.766767 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.766749    2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 10:01:31.767703 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.767682    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-6rqzs","openshift-image-registry/node-ca-wqszc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal","openshift-multus/multus-kph8l","openshift-network-diagnostics/network-check-target-9khj9","kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt","openshift-multus/multus-additional-cni-plugins-x62rj","openshift-multus/network-metrics-daemon-g8fbd","openshift-network-operator/iptables-alerter-xcnvn","openshift-ovn-kubernetes/ovnkube-node-tj7h9","kube-system/global-pull-secret-syncer-h77q7","kube-system/konnectivity-agent-f4gj7","openshift-cluster-node-tuning-operator/tuned-pqtjp"]
Sep 08 10:01:31.771277 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.771263    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.773359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.773342    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.773615 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.773588    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.773703 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.773672    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-fxg4d\""
Sep 08 10:01:31.773752 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.773720    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.775479 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.775311    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.775479 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.775315    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 10:01:31.775479 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.775455    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.775682 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.775541    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.775944 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.775925    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5x2pn\""
Sep 08 10:01:31.777404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.777383    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 10:01:31.777823 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.777515    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2dftb\""
Sep 08 10:01:31.777823 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.777557    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.777823 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.777587    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.777823 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.777731    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.779517 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.779499    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-x28rs\""
Sep 08 10:01:31.779642 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.779627    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 10:01:31.779696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.779633    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 10:01:31.779751 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.779737    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:31.779822 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.779803    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:31.781965 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.781950    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:31.782041 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.782020    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:31.784151 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.784069    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.786570 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.786549    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-n9jht\""
Sep 08 10:01:31.786832 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.786813    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 10:01:31.786932 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.786872    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.787034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787015    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.787558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea6e303d-4271-4837-8d1e-4216c884e268-etc-tuned\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787571    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49eeed69-95e9-45e7-9075-98e36c95819f-agent-certs\") pod \"konnectivity-agent-f4gj7\" (UID: \"49eeed69-95e9-45e7-9075-98e36c95819f\") " pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.787637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787595    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysctl-d\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787711 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-var-lib-kubelet\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787711 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-host\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787711 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787705    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b836398d-00f0-4d38-9dc6-21c41faa914c-hosts-file\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.787815 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787720    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcg6d\" (UniqueName: \"kubernetes.io/projected/b836398d-00f0-4d38-9dc6-21c41faa914c-kube-api-access-hcg6d\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.787815 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787734    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/480b3071-c19a-4100-8b33-c1ea2c8f1345-host\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.787815 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787756    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-modprobe-d\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787815 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-run\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-lib-modules\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787842    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea6e303d-4271-4837-8d1e-4216c884e268-tmp\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.787958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787863    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:31.787958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787877    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b836398d-00f0-4d38-9dc6-21c41faa914c-tmp-dir\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.787958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787890    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/480b3071-c19a-4100-8b33-c1ea2c8f1345-serviceca\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.787958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-kubernetes\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-sys\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.787989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9bc2\" (UniqueName: \"kubernetes.io/projected/ea6e303d-4271-4837-8d1e-4216c884e268-kube-api-access-m9bc2\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.788011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49eeed69-95e9-45e7-9075-98e36c95819f-konnectivity-ca\") pod \"konnectivity-agent-f4gj7\" (UID: \"49eeed69-95e9-45e7-9075-98e36c95819f\") " pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.788032    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jtjj\" (UniqueName: \"kubernetes.io/projected/480b3071-c19a-4100-8b33-c1ea2c8f1345-kube-api-access-2jtjj\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.788053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysconfig\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.788096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysctl-conf\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.788128    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-systemd\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.788207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.788196    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.790580 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.790562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ng9q2\""
Sep 08 10:01:31.790638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.790613    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.790706 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.790690    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 10:01:31.790909 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.790892    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 10:01:31.790978 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.790964    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 10:01:31.791015 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.790986    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.791100 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.791085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.791351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.791337    2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 10:01:31.793304 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.793286    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.793396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.793320    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.793396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.793358    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 10:01:31.793571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.793555    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qs7sj\""
Sep 08 10:01:31.793626 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.793579    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.795617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.795594    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 10:01:31.795682 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.795672    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-vzkdv\""
Sep 08 10:01:31.795900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.795885    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.795971 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.795937    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:31.796851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.796833    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 10:01:31.796947 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.796860    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 10:01:31.796947 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.796932    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 10:01:31.797054 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.796950    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 10:01:31.797054 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.796962    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 10:01:31.798129 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.798113    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.800545 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.800530    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 10:01:31.801154 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.801141    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c2zdm\""
Sep 08 10:01:31.820328 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.820312    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8c9m2"
Sep 08 10:01:31.828195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.828180    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8c9m2"
Sep 08 10:01:31.879348 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.879330    2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 10:01:31.888264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-cnibin\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.888352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-cni-multus\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.888352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888287    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-hostroot\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.888352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888304    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b836398d-00f0-4d38-9dc6-21c41faa914c-tmp-dir\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.888352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.888352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888332    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-slash\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888369    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ddb8591-faf6-4515-8ba1-25561d0ae449-dbus\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.888571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888442    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-systemd-units\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888476    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-run-netns\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888502    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-node-log\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888527    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovn-node-metrics-cert\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888552    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovnkube-script-lib\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-cni-binary-copy\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-registration-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888637    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b836398d-00f0-4d38-9dc6-21c41faa914c-tmp-dir\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888637    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-env-overrides\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888708    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-kubelet\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888737    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9bc2\" (UniqueName: \"kubernetes.io/projected/ea6e303d-4271-4837-8d1e-4216c884e268-kube-api-access-m9bc2\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.888765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea6e303d-4271-4837-8d1e-4216c884e268-tmp\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-socket-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888785    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-kubernetes\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888851    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-sys\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888875    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ddb8591-faf6-4515-8ba1-25561d0ae449-kubelet-config\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888900    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888922    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovnkube-config\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49eeed69-95e9-45e7-9075-98e36c95819f-konnectivity-ca\") pod \"konnectivity-agent-f4gj7\" (UID: \"49eeed69-95e9-45e7-9075-98e36c95819f\") " pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888963    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-sys\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysctl-conf\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.888987    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-kubernetes\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-systemd\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889032    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea6e303d-4271-4837-8d1e-4216c884e268-etc-tuned\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnfjn\" (UniqueName: \"kubernetes.io/projected/002fb92f-e88e-4750-afd4-9b718c3bb935-kube-api-access-hnfjn\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889081    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889093    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-ovn\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-systemd\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-k8s-cni-cncf-io\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889136    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysctl-conf\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889163    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-var-lib-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889211    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-host\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889255    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-conf-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889285    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-etc-kubernetes\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889282    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-host\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889300    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcg6d\" (UniqueName: \"kubernetes.io/projected/b836398d-00f0-4d38-9dc6-21c41faa914c-kube-api-access-hcg6d\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-modprobe-d\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-run\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-modprobe-d\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-cni-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.889695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889488    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-run\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqm6l\" (UniqueName: \"kubernetes.io/projected/76973019-5f8b-42a5-81c3-721fe34b693e-kube-api-access-fqm6l\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpfn2\" (UniqueName: \"kubernetes.io/projected/23500b38-9c1e-4e76-86ba-01cbcd4498d7-kube-api-access-jpfn2\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889561    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-log-socket\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-netns\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2jtjj\" (UniqueName: \"kubernetes.io/projected/480b3071-c19a-4100-8b33-c1ea2c8f1345-kube-api-access-2jtjj\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889614    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23500b38-9c1e-4e76-86ba-01cbcd4498d7-iptables-alerter-script\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889628    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-cni-netd\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-daemon-config\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889662    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-multus-certs\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49eeed69-95e9-45e7-9075-98e36c95819f-agent-certs\") pod \"konnectivity-agent-f4gj7\" (UID: \"49eeed69-95e9-45e7-9075-98e36c95819f\") " pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889747    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-sys-fs\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-cni-bin\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889820    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-lib-modules\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-device-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.890453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889913    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmwgx\" (UniqueName: \"kubernetes.io/projected/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-kube-api-access-qmwgx\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-etc-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889985    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-lib-modules\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.889994    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/480b3071-c19a-4100-8b33-c1ea2c8f1345-serviceca\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890053    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-system-cni-dir\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/49eeed69-95e9-45e7-9075-98e36c95819f-konnectivity-ca\") pod \"konnectivity-agent-f4gj7\" (UID: \"49eeed69-95e9-45e7-9075-98e36c95819f\") " pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890100    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-km8tf\" (UniqueName: \"kubernetes.io/projected/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-kube-api-access-km8tf\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890129    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-cni-bin\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890156    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-socket-dir-parent\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890183    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysconfig\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890204    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23500b38-9c1e-4e76-86ba-01cbcd4498d7-host-slash\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890294    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-kubelet\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890305    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysconfig\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890317    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-cnibin\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.891198 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890341    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb27648-24f1-44be-94ce-c0de0d6ae96f-cni-binary-copy\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890372    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysctl-d\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890395    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-var-lib-kubelet\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-var-lib-kubelet\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890443    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-systemd\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890456    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/ea6e303d-4271-4837-8d1e-4216c884e268-etc-sysctl-d\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-system-cni-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890512    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcd7g\" (UniqueName: \"kubernetes.io/projected/bfb27648-24f1-44be-94ce-c0de0d6ae96f-kube-api-access-zcd7g\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b836398d-00f0-4d38-9dc6-21c41faa914c-hosts-file\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/480b3071-c19a-4100-8b33-c1ea2c8f1345-host\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890615    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b836398d-00f0-4d38-9dc6-21c41faa914c-hosts-file\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890668    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/480b3071-c19a-4100-8b33-c1ea2c8f1345-host\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.892012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.890928    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/480b3071-c19a-4100-8b33-c1ea2c8f1345-serviceca\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.892461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.892309    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/ea6e303d-4271-4837-8d1e-4216c884e268-etc-tuned\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.892461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.892379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ea6e303d-4271-4837-8d1e-4216c884e268-tmp\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.892607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.892590    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/49eeed69-95e9-45e7-9075-98e36c95819f-agent-certs\") pod \"konnectivity-agent-f4gj7\" (UID: \"49eeed69-95e9-45e7-9075-98e36c95819f\") " pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:31.894947 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.894926    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:01:31.895032 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.894956    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:01:31.895032 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.894970    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:31.895115 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.895047    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:32.395025723 +0000 UTC m=+2.971896157 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:31.896052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.896030    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jtjj\" (UniqueName: \"kubernetes.io/projected/480b3071-c19a-4100-8b33-c1ea2c8f1345-kube-api-access-2jtjj\") pod \"node-ca-wqszc\" (UID: \"480b3071-c19a-4100-8b33-c1ea2c8f1345\") " pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:31.896264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.896248    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9bc2\" (UniqueName: \"kubernetes.io/projected/ea6e303d-4271-4837-8d1e-4216c884e268-kube-api-access-m9bc2\") pod \"tuned-pqtjp\" (UID: \"ea6e303d-4271-4837-8d1e-4216c884e268\") " pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:31.897000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.896981    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcg6d\" (UniqueName: \"kubernetes.io/projected/b836398d-00f0-4d38-9dc6-21c41faa914c-kube-api-access-hcg6d\") pod \"node-resolver-6rqzs\" (UID: \"b836398d-00f0-4d38-9dc6-21c41faa914c\") " pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:31.908068 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.908032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal" event={"ID":"385c83f897bbb0f00e8342d23450ac7c","Type":"ContainerStarted","Data":"74d1fc0ca65680f9705c7c123f4f9f35193f34c73b427af77b7a09608fe74485"}
Sep 08 10:01:31.991032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-device-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.991097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991055    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmwgx\" (UniqueName: \"kubernetes.io/projected/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-kube-api-access-qmwgx\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991068    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-etc-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991105    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-run-ovn-kubernetes\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991134    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:31.991206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991134    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-device-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.991206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991153    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-system-cni-dir\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.991206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-etc-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991198    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-km8tf\" (UniqueName: \"kubernetes.io/projected/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-kube-api-access-km8tf\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991224    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-cni-bin\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.991244    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991262    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-socket-dir-parent\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991281    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23500b38-9c1e-4e76-86ba-01cbcd4498d7-host-slash\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/23500b38-9c1e-4e76-86ba-01cbcd4498d7-host-slash\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.991318    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:32.491284094 +0000 UTC m=+3.068154539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991243    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-system-cni-dir\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991307    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-cni-bin\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-socket-dir-parent\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991365    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-kubelet\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-kubelet\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991438    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-cnibin\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.991473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991472    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb27648-24f1-44be-94ce-c0de0d6ae96f-cni-binary-copy\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991487    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-etc-selinux\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-cnibin\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991495    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-systemd\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-system-cni-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991648    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-systemd\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcd7g\" (UniqueName: \"kubernetes.io/projected/bfb27648-24f1-44be-94ce-c0de0d6ae96f-kube-api-access-zcd7g\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991706    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-cnibin\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991705    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-system-cni-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-cni-multus\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991756    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/76973019-5f8b-42a5-81c3-721fe34b693e-cnibin\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991758    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-hostroot\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991789    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991792    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-cni-multus\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-hostroot\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-slash\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ddb8591-faf6-4515-8ba1-25561d0ae449-dbus\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991886    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-slash\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-systemd-units\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991953    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-run-netns\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991969    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/2ddb8591-faf6-4515-8ba1-25561d0ae449-dbus\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991974    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-node-log\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991976    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/bfb27648-24f1-44be-94ce-c0de0d6ae96f-cni-binary-copy\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991967    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-systemd-units\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.991995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-run-netns\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992017    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovn-node-metrics-cert\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992036    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovnkube-script-lib\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-cni-binary-copy\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992057    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-node-log\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992141    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-registration-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992168    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992190    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-env-overrides\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.992872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-kubelet\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-registration-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992257    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-socket-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992646    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-kubelet\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-env-overrides\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992827    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ddb8591-faf6-4515-8ba1-25561d0ae449-kubelet-config\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992251    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992941    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992955    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-socket-dir\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.992976    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovnkube-config\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnfjn\" (UniqueName: \"kubernetes.io/projected/002fb92f-e88e-4750-afd4-9b718c3bb935-kube-api-access-hnfjn\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993070    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-ovn\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-run-ovn\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993128    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-k8s-cni-cncf-io\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993207    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/2ddb8591-faf6-4515-8ba1-25561d0ae449-kubelet-config\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993277    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.993643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993323    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-k8s-cni-cncf-io\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993366    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-cni-binary-copy\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993413    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-var-lib-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovnkube-script-lib\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993469    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-var-lib-openvswitch\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993505    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovnkube-config\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993534    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.993593    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-conf-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:31.993675    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:32.493642867 +0000 UTC m=+3.070513300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993700    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-etc-kubernetes\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-conf-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993753    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-cni-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993796    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqm6l\" (UniqueName: \"kubernetes.io/projected/76973019-5f8b-42a5-81c3-721fe34b693e-kube-api-access-fqm6l\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993835    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-etc-kubernetes\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993879    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpfn2\" (UniqueName: \"kubernetes.io/projected/23500b38-9c1e-4e76-86ba-01cbcd4498d7-kube-api-access-jpfn2\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.994473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993915    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-cni-dir\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.993951    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-log-socket\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994006    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-netns\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23500b38-9c1e-4e76-86ba-01cbcd4498d7-iptables-alerter-script\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-cni-netd\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-daemon-config\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994151    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-multus-certs\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994244    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-sys-fs\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994322    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-cni-bin\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994869    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/23500b38-9c1e-4e76-86ba-01cbcd4498d7-iptables-alerter-script\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.994931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-var-lib-cni-bin\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-multus-certs\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995096    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-sys-fs\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995118    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/bfb27648-24f1-44be-94ce-c0de0d6ae96f-multus-daemon-config\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-log-socket\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995195    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-host-cni-netd\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:31.995281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995259    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/76973019-5f8b-42a5-81c3-721fe34b693e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:31.996044 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.995284    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/bfb27648-24f1-44be-94ce-c0de0d6ae96f-host-run-netns\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:31.996355 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.996336    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-ovn-node-metrics-cert\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:32.000003 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:31.999980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-km8tf\" (UniqueName: \"kubernetes.io/projected/d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e-kube-api-access-km8tf\") pod \"aws-ebs-csi-driver-node-ktxkt\" (UID: \"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:32.000116 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.000082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcd7g\" (UniqueName: \"kubernetes.io/projected/bfb27648-24f1-44be-94ce-c0de0d6ae96f-kube-api-access-zcd7g\") pod \"multus-kph8l\" (UID: \"bfb27648-24f1-44be-94ce-c0de0d6ae96f\") " pod="openshift-multus/multus-kph8l"
Sep 08 10:01:32.000297 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.000281    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmwgx\" (UniqueName: \"kubernetes.io/projected/4c5727f6-7ac5-49fc-8d81-0b76cbd8b449-kube-api-access-qmwgx\") pod \"ovnkube-node-tj7h9\" (UID: \"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449\") " pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:32.000986 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.000968    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnfjn\" (UniqueName: \"kubernetes.io/projected/002fb92f-e88e-4750-afd4-9b718c3bb935-kube-api-access-hnfjn\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:32.001963 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.001947    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpfn2\" (UniqueName: \"kubernetes.io/projected/23500b38-9c1e-4e76-86ba-01cbcd4498d7-kube-api-access-jpfn2\") pod \"iptables-alerter-xcnvn\" (UID: \"23500b38-9c1e-4e76-86ba-01cbcd4498d7\") " pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:32.002194 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.002178    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqm6l\" (UniqueName: \"kubernetes.io/projected/76973019-5f8b-42a5-81c3-721fe34b693e-kube-api-access-fqm6l\") pod \"multus-additional-cni-plugins-x62rj\" (UID: \"76973019-5f8b-42a5-81c3-721fe34b693e\") " pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:32.080466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.080449    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-6rqzs"
Sep 08 10:01:32.088683 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.088600    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wqszc"
Sep 08 10:01:32.090882 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.090861    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb836398d_00f0_4d38_9dc6_21c41faa914c.slice/crio-f1ae0be00af2ec1fafad5cb96f92ae23f30b268fc0306176a42c14ed8e6a4731 WatchSource:0}: Error finding container f1ae0be00af2ec1fafad5cb96f92ae23f30b268fc0306176a42c14ed8e6a4731: Status 404 returned error can't find the container with id f1ae0be00af2ec1fafad5cb96f92ae23f30b268fc0306176a42c14ed8e6a4731
Sep 08 10:01:32.095765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.095745    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pqtjp"
Sep 08 10:01:32.096451 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.096427    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod480b3071_c19a_4100_8b33_c1ea2c8f1345.slice/crio-fc6c26e43a17600c45f3bed840a6db9908cfeb85fb9bfdd6a7724b82cac78c01 WatchSource:0}: Error finding container fc6c26e43a17600c45f3bed840a6db9908cfeb85fb9bfdd6a7724b82cac78c01: Status 404 returned error can't find the container with id fc6c26e43a17600c45f3bed840a6db9908cfeb85fb9bfdd6a7724b82cac78c01
Sep 08 10:01:32.100077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.100059    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:32.104149 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.104128    2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 10:01:32.104340 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.104318    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea6e303d_4271_4837_8d1e_4216c884e268.slice/crio-607fe2c5d4b387c80d87fb405e5ef3af2ee23d723a2f4cfe0812997bdced32d7 WatchSource:0}: Error finding container 607fe2c5d4b387c80d87fb405e5ef3af2ee23d723a2f4cfe0812997bdced32d7: Status 404 returned error can't find the container with id 607fe2c5d4b387c80d87fb405e5ef3af2ee23d723a2f4cfe0812997bdced32d7
Sep 08 10:01:32.105782 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.105764    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt"
Sep 08 10:01:32.108268 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.108245    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49eeed69_95e9_45e7_9075_98e36c95819f.slice/crio-35f9526063afbaead38e9334f8a82495c1f83776544d0ff71ce2212c50897813 WatchSource:0}: Error finding container 35f9526063afbaead38e9334f8a82495c1f83776544d0ff71ce2212c50897813: Status 404 returned error can't find the container with id 35f9526063afbaead38e9334f8a82495c1f83776544d0ff71ce2212c50897813
Sep 08 10:01:32.111371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.111318    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-x62rj"
Sep 08 10:01:32.114385 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.114364    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd368cb39_b77f_4b9c_b4bb_9ff1bab9c16e.slice/crio-e4f6f6f082ba39396a06a2d858f63b91f86e31ccbfced8653f57280d79a98e54 WatchSource:0}: Error finding container e4f6f6f082ba39396a06a2d858f63b91f86e31ccbfced8653f57280d79a98e54: Status 404 returned error can't find the container with id e4f6f6f082ba39396a06a2d858f63b91f86e31ccbfced8653f57280d79a98e54
Sep 08 10:01:32.117466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.117444    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xcnvn"
Sep 08 10:01:32.118694 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.118677    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76973019_5f8b_42a5_81c3_721fe34b693e.slice/crio-16f753811df4aaca4fa7d834799eb2a72ebeb35197330cdb7eedcb3d98ba6565 WatchSource:0}: Error finding container 16f753811df4aaca4fa7d834799eb2a72ebeb35197330cdb7eedcb3d98ba6565: Status 404 returned error can't find the container with id 16f753811df4aaca4fa7d834799eb2a72ebeb35197330cdb7eedcb3d98ba6565
Sep 08 10:01:32.124068 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.124054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:32.125925 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.125907    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23500b38_9c1e_4e76_86ba_01cbcd4498d7.slice/crio-324c392da93bddb1eaf4c81d150b92fd3cfd7b0fc89ef2aed87b93fb25b7811c WatchSource:0}: Error finding container 324c392da93bddb1eaf4c81d150b92fd3cfd7b0fc89ef2aed87b93fb25b7811c: Status 404 returned error can't find the container with id 324c392da93bddb1eaf4c81d150b92fd3cfd7b0fc89ef2aed87b93fb25b7811c
Sep 08 10:01:32.127040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.126994    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-kph8l"
Sep 08 10:01:32.132950 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.132931    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c5727f6_7ac5_49fc_8d81_0b76cbd8b449.slice/crio-1cf4e9405d58961601b2e82df195c40b50e1de5b6e9ef651f3b76e32dcfa1568 WatchSource:0}: Error finding container 1cf4e9405d58961601b2e82df195c40b50e1de5b6e9ef651f3b76e32dcfa1568: Status 404 returned error can't find the container with id 1cf4e9405d58961601b2e82df195c40b50e1de5b6e9ef651f3b76e32dcfa1568
Sep 08 10:01:32.135468 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:32.135451    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfb27648_24f1_44be_94ce_c0de0d6ae96f.slice/crio-c851ddf3831fd747031eec520ad4ef8ae96c5e8916283c764c7e43ee85eff430 WatchSource:0}: Error finding container c851ddf3831fd747031eec520ad4ef8ae96c5e8916283c764c7e43ee85eff430: Status 404 returned error can't find the container with id c851ddf3831fd747031eec520ad4ef8ae96c5e8916283c764c7e43ee85eff430
Sep 08 10:01:32.396062 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.396012    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:32.396163 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.396150    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:01:32.396199 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.396167    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:01:32.396199 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.396176    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:32.396287 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.396214    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:33.396202781 +0000 UTC m=+3.973073204 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:32.496708 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.496684    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:32.496792 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.496723    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:32.496830 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.496797    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:32.496830 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.496802    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:32.496893 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.496841    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:33.496827285 +0000 UTC m=+4.073697705 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:32.496893 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:32.496854    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:33.496847754 +0000 UTC m=+4.073718173 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:32.831802 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.831754    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 09:56:31 +0000 UTC" deadline="2028-06-25 09:23:37.132375028 +0000 UTC"
Sep 08 10:01:32.831802 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.831793    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15743h22m4.300584544s"
Sep 08 10:01:32.917319 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.915370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcnvn" event={"ID":"23500b38-9c1e-4e76-86ba-01cbcd4498d7","Type":"ContainerStarted","Data":"324c392da93bddb1eaf4c81d150b92fd3cfd7b0fc89ef2aed87b93fb25b7811c"}
Sep 08 10:01:32.917642 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.917615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerStarted","Data":"16f753811df4aaca4fa7d834799eb2a72ebeb35197330cdb7eedcb3d98ba6565"}
Sep 08 10:01:32.919405 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.919369    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt" event={"ID":"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e","Type":"ContainerStarted","Data":"e4f6f6f082ba39396a06a2d858f63b91f86e31ccbfced8653f57280d79a98e54"}
Sep 08 10:01:32.920668 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.920644    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4gj7" event={"ID":"49eeed69-95e9-45e7-9075-98e36c95819f","Type":"ContainerStarted","Data":"35f9526063afbaead38e9334f8a82495c1f83776544d0ff71ce2212c50897813"}
Sep 08 10:01:32.922145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.922113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqtjp" event={"ID":"ea6e303d-4271-4837-8d1e-4216c884e268","Type":"ContainerStarted","Data":"607fe2c5d4b387c80d87fb405e5ef3af2ee23d723a2f4cfe0812997bdced32d7"}
Sep 08 10:01:32.923326 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.923303    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wqszc" event={"ID":"480b3071-c19a-4100-8b33-c1ea2c8f1345","Type":"ContainerStarted","Data":"fc6c26e43a17600c45f3bed840a6db9908cfeb85fb9bfdd6a7724b82cac78c01"}
Sep 08 10:01:32.924664 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.924640    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6rqzs" event={"ID":"b836398d-00f0-4d38-9dc6-21c41faa914c","Type":"ContainerStarted","Data":"f1ae0be00af2ec1fafad5cb96f92ae23f30b268fc0306176a42c14ed8e6a4731"}
Sep 08 10:01:32.925877 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.925851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kph8l" event={"ID":"bfb27648-24f1-44be-94ce-c0de0d6ae96f","Type":"ContainerStarted","Data":"c851ddf3831fd747031eec520ad4ef8ae96c5e8916283c764c7e43ee85eff430"}
Sep 08 10:01:32.927030 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:32.927012    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"1cf4e9405d58961601b2e82df195c40b50e1de5b6e9ef651f3b76e32dcfa1568"}
Sep 08 10:01:33.404062 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.404034    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:33.404279 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.404219    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:01:33.404279 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.404257    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:01:33.404279 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.404269    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:33.404451 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.404330    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:35.40431169 +0000 UTC m=+5.981182127 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:33.504875 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.504848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:33.505033 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.504905    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:33.505033 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.504995    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:33.505033 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.505014    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:33.505185 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.505067    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:35.505047528 +0000 UTC m=+6.081917969 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:33.505185 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.505087    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:35.505077204 +0000 UTC m=+6.081947627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:33.832240 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.832192    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 09:56:31 +0000 UTC" deadline="2028-05-12 17:24:35.939871587 +0000 UTC"
Sep 08 10:01:33.832240 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.832245    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14695h23m2.107654786s"
Sep 08 10:01:33.903712 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.903682    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:33.903856 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.903690    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:33.903856 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.903783    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:33.903938 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.903861    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:33.903938 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:33.903892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:33.904021 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:33.903960    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:33.952266 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:01:33.952204    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad3e834b17dfd8249f17c510706cb839.slice/crio-e116547c5ec3464c8686304ab08f3cf347f0f46143ee9d69ffaff99d06d2a823 WatchSource:0}: Error finding container e116547c5ec3464c8686304ab08f3cf347f0f46143ee9d69ffaff99d06d2a823: Status 404 returned error can't find the container with id e116547c5ec3464c8686304ab08f3cf347f0f46143ee9d69ffaff99d06d2a823
Sep 08 10:01:34.933954 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:34.933125    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wqszc" event={"ID":"480b3071-c19a-4100-8b33-c1ea2c8f1345","Type":"ContainerStarted","Data":"8c3d73ce0ec9ff21c7845e8f2736d6e4b6b998a457772d8d3f61c6b1e2c0a818"}
Sep 08 10:01:34.935137 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:34.935068    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal" event={"ID":"ad3e834b17dfd8249f17c510706cb839","Type":"ContainerStarted","Data":"e116547c5ec3464c8686304ab08f3cf347f0f46143ee9d69ffaff99d06d2a823"}
Sep 08 10:01:34.948224 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:34.948146    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wqszc" podStartSLOduration=4.117329478 podStartE2EDuration="5.948124261s" totalImagesPullingTime="1.830794783s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:34.947083639 +0000 UTC m=+5.523954078" watchObservedRunningTime="2026-09-08 10:01:34.948124261 +0000 UTC m=+5.524994702"
Sep 08 10:01:35.422331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:35.422286    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:35.422515 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.422500    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:01:35.422579 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.422524    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:01:35.422579 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.422538    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:35.422664 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.422595    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:39.422577013 +0000 UTC m=+9.999447451 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:35.523551 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.523519    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:35.523712 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.523613    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:39.523583457 +0000 UTC m=+10.100453905 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:35.524034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:35.524009    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:35.524118 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:35.524095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:35.524215 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.524201    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:35.524295 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.524268    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:39.524252581 +0000 UTC m=+10.101123015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:35.905399 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:35.905330    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:35.905542 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.905444    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:35.905841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:35.905821    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:35.905949 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.905928    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:35.907424 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:35.907404    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:35.907529 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:35.907495    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:37.903878 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:37.903842    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:37.904323 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:37.903970    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:37.904323 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:37.904290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:37.904445 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:37.903847    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:37.904445 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:37.904390    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:37.904541 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:37.904518    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:39.457370 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:39.457335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:39.457858 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.457541    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:01:39.457858 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.457568    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:01:39.457858 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.457581    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:39.457858 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.457646    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:47.45762478 +0000 UTC m=+18.034495222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:39.559163 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:39.558445    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:39.559163 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:39.558505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:39.559163 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.558625    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:39.559163 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.558683    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:47.558665268 +0000 UTC m=+18.135535703 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:39.559163 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.559076    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:39.559163 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.559129    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:01:47.559113203 +0000 UTC m=+18.135983640 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:39.910876 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:39.908277    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:39.910876 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.908432    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:39.910876 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:39.908863    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:39.910876 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.908985    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:39.913051 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:39.911253    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:39.913051 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:39.911403    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:41.903968 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:41.903937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:41.904360 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:41.903976    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:41.904360 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:41.903937    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:41.904360 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:41.904076    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:41.904360 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:41.904197    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:41.904360 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:41.904288    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:43.904329 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:43.904296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:43.904757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:43.904296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:43.904757 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:43.904422    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:43.904757 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:43.904525    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:43.904757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:43.904302    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:43.904757 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:43.904653    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:45.904540 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:45.904509    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:45.904981 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:45.904509    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:45.904981 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:45.904614    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:45.904981 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:45.904520    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:45.904981 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:45.904711    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:45.904981 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:45.904761    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:47.524419 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:47.524387    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:47.524904 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.524525    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:01:47.524904 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.524551    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:01:47.524904 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.524564    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:47.524904 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.524622    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:03.524609058 +0000 UTC m=+34.101479481 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:01:47.625639 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:47.625605    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:47.625799 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:47.625681    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:47.625799 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.625764    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:47.625799 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.625793    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:47.625945 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.625840    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:03.62582261 +0000 UTC m=+34.202693049 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:01:47.625945 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.625855    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:03.625849361 +0000 UTC m=+34.202719779 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:01:47.904796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:47.904717    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:47.904796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:47.904731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:47.905016 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.904840    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:47.905016 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.904889    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:47.905016 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:47.904923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:47.905173 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:47.905023    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:49.904244 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:49.904206    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:49.904651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:49.904326    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:49.904651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:49.904334    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:49.904651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:49.904394    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:49.904651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:49.904411    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:49.904651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:49.904464    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:51.904879 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.904523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:51.905569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.904523    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:51.905569 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:51.904898    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:51.905569 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:51.904978    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:51.905569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.904589    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:51.905569 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:51.905101    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:51.964643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.964615    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal" event={"ID":"385c83f897bbb0f00e8342d23450ac7c","Type":"ContainerStarted","Data":"2081e08a3a674795ffedb4791afba8394108e5513632367fc0c6791eaa27b12b"}
Sep 08 10:01:51.966017 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.965995    2582 generic.go:356] "Generic (PLEG): container finished" podID="76973019-5f8b-42a5-81c3-721fe34b693e" containerID="e29755b63a148258c85782aee88a2b333312fc336ad9489e6d8feae726f0c89c" exitCode=0
Sep 08 10:01:51.966132 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.966070    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerDied","Data":"e29755b63a148258c85782aee88a2b333312fc336ad9489e6d8feae726f0c89c"}
Sep 08 10:01:51.967644 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.967622    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt" event={"ID":"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e","Type":"ContainerStarted","Data":"30e16ce59a36554d1a796303afa418288143c3be46be188bd19c8037c076c006"}
Sep 08 10:01:51.969156 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.969137    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f4gj7" event={"ID":"49eeed69-95e9-45e7-9075-98e36c95819f","Type":"ContainerStarted","Data":"4bac9ba0310f58293d86da48cd41432f7653b67c90ab1ec2df9b2f89dd13264e"}
Sep 08 10:01:51.970563 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.970533    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pqtjp" event={"ID":"ea6e303d-4271-4837-8d1e-4216c884e268","Type":"ContainerStarted","Data":"bf0bf5cf28a31bc58e9d7fdbcfedb5c10f5aa2a5b3fa70f1c3a9ffed05034cdc"}
Sep 08 10:01:51.972103 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.972083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-6rqzs" event={"ID":"b836398d-00f0-4d38-9dc6-21c41faa914c","Type":"ContainerStarted","Data":"cc7063f7022d602397274c5a03edf29f5a51ba1a67b51360e92263ccb7daf2de"}
Sep 08 10:01:51.973361 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.973340    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-kph8l" event={"ID":"bfb27648-24f1-44be-94ce-c0de0d6ae96f","Type":"ContainerStarted","Data":"bc7fd49ed8d63ce50aada70112422fff61fc9926d26762fa248c66eb78a7661c"}
Sep 08 10:01:51.976122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.976105    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"24240aa4b4e06adf773ce4d2efd8274eb32ec0e4ec70330e067eda41922652b5"}
Sep 08 10:01:51.976201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.976158    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"be47de172a36ab47793e4a6869676a136553a92912593d4a87db231aca6011f7"}
Sep 08 10:01:51.976260 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.976206    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"da21690c0689850d9ada79c0d1c6ed137c378b1f2ed18900e1253cb16fe1c3f0"}
Sep 08 10:01:51.976301 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.976271    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"8b3d72d27a09851e5cbf9775321ae30e429846293088969a45c67ada5f65e3f9"}
Sep 08 10:01:51.976331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.976320    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"ae8055822c394fd5aae7fb8b628822a0dc16e39199109fc81d90b6d989c179fc"}
Sep 08 10:01:51.976372 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.976360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"9ff059e2fca28624edf2c62766f05ea8773e13b1e5c86744564a86a69eb3f6b6"}
Sep 08 10:01:51.977485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.977463    2582 generic.go:356] "Generic (PLEG): container finished" podID="ad3e834b17dfd8249f17c510706cb839" containerID="fdc228a39410434e6e0ddc0a18560a82a8921cdef34c0ca9cfc494ed9917e762" exitCode=0
Sep 08 10:01:51.977553 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.977495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal" event={"ID":"ad3e834b17dfd8249f17c510706cb839","Type":"ContainerDied","Data":"fdc228a39410434e6e0ddc0a18560a82a8921cdef34c0ca9cfc494ed9917e762"}
Sep 08 10:01:51.980416 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:51.980325    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-238.ec2.internal" podStartSLOduration=20.980313017 podStartE2EDuration="20.980313017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:51.979549481 +0000 UTC m=+22.556419923" watchObservedRunningTime="2026-09-08 10:01:51.980313017 +0000 UTC m=+22.557183457"
Sep 08 10:01:52.004722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.004675    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-6rqzs" podStartSLOduration=4.027549341 podStartE2EDuration="23.004663127s" totalImagesPullingTime="18.977113786s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:52.00460584 +0000 UTC m=+22.581476281" watchObservedRunningTime="2026-09-08 10:01:52.004663127 +0000 UTC m=+22.581533567"
Sep 08 10:01:52.019508 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.019475    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pqtjp" podStartSLOduration=4.060534406 podStartE2EDuration="23.019464427s" totalImagesPullingTime="18.958930021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:52.019338827 +0000 UTC m=+22.596209268" watchObservedRunningTime="2026-09-08 10:01:52.019464427 +0000 UTC m=+22.596334867"
Sep 08 10:01:52.053299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.053266    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-kph8l" podStartSLOduration=3.08008902 podStartE2EDuration="22.053255424s" totalImagesPullingTime="18.973166404s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:52.053154103 +0000 UTC m=+22.630024547" watchObservedRunningTime="2026-09-08 10:01:52.053255424 +0000 UTC m=+22.630125864"
Sep 08 10:01:52.069021 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.068981    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f4gj7" podStartSLOduration=8.661742246 podStartE2EDuration="23.068965811s" totalImagesPullingTime="14.407223565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:52.068168023 +0000 UTC m=+22.645038464" watchObservedRunningTime="2026-09-08 10:01:52.068965811 +0000 UTC m=+22.645836254"
Sep 08 10:01:52.980807 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.980774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal" event={"ID":"ad3e834b17dfd8249f17c510706cb839","Type":"ContainerStarted","Data":"beac9409127536da1180e4b0203a78be90c42571783d44ce15f6b923ec7fb02a"}
Sep 08 10:01:52.982273 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.982247    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xcnvn" event={"ID":"23500b38-9c1e-4e76-86ba-01cbcd4498d7","Type":"ContainerStarted","Data":"0ba428a488289bd6e86440c5672b5f46646355ae09ff9e798961ce0073346a99"}
Sep 08 10:01:52.994804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:52.994762    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-238.ec2.internal" podStartSLOduration=21.994750828 podStartE2EDuration="21.994750828s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:52.994581395 +0000 UTC m=+23.571451837" watchObservedRunningTime="2026-09-08 10:01:52.994750828 +0000 UTC m=+23.571621269"
Sep 08 10:01:53.012877 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.012841    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xcnvn" podStartSLOduration=4.097674375 podStartE2EDuration="23.012833482s" totalImagesPullingTime="18.915159107s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:53.012828697 +0000 UTC m=+23.589699138" watchObservedRunningTime="2026-09-08 10:01:53.012833482 +0000 UTC m=+23.589703923"
Sep 08 10:01:53.617111 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.617089    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 10:01:53.854503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.854423    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T10:01:53.617107283Z","UUID":"88f053a0-c43e-4ec0-80c5-d78a89f2d330","Handler":null,"Name":"","Endpoint":""}
Sep 08 10:01:53.855729 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.855707    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 10:01:53.855822 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.855735    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 10:01:53.904115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.904060    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:53.904253 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.904215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:53.904358 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:53.904221    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:53.904402 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:53.904343    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:53.904442 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.904399    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:53.904516 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:53.904494    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:53.986895 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.986871    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"308ca7213b00fd0e9b2bd8c49ef25fbddbd2796fcf8d7610405a6633efaf1dea"}
Sep 08 10:01:53.988486 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:53.988466    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt" event={"ID":"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e","Type":"ContainerStarted","Data":"0fe937292fe51a79d09e70620c0f0d77b9bad64dba5452635502469287c986b8"}
Sep 08 10:01:54.481909 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:54.481880    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:54.482449 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:54.482430    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:54.993342 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:54.993061    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt" event={"ID":"d368cb39-b77f-4b9c-b4bb-9ff1bab9c16e","Type":"ContainerStarted","Data":"93115703c8a33372d0121a2dd1aac79a9eace362e9f2d5eff5fe17b4b5410478"}
Sep 08 10:01:54.993342 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:54.993338    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:54.993849 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:54.993825    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f4gj7"
Sep 08 10:01:55.014773 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:55.014731    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ktxkt" podStartSLOduration=2.927036722 podStartE2EDuration="25.014718052s" totalImagesPullingTime="22.08768133s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:55.013988381 +0000 UTC m=+25.590858834" watchObservedRunningTime="2026-09-08 10:01:55.014718052 +0000 UTC m=+25.591588492"
Sep 08 10:01:55.904435 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:55.904327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:55.904435 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:55.904341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:55.904435 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:55.904341    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:55.904659 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:55.904447    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:55.904659 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:55.904518    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:55.904659 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:55.904573    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:57.001783 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.001741    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" event={"ID":"4c5727f6-7ac5-49fc-8d81-0b76cbd8b449","Type":"ContainerStarted","Data":"79ce053d30a4e43792ebbe6505ac4fb48d09c346c5ee0ab0d99e6a17efe2ce20"}
Sep 08 10:01:57.029985 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.029937    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" podStartSLOduration=8.099413973 podStartE2EDuration="27.029922311s" totalImagesPullingTime="18.930508338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:01:57.029563447 +0000 UTC m=+27.606433890" watchObservedRunningTime="2026-09-08 10:01:57.029922311 +0000 UTC m=+27.606792752"
Sep 08 10:01:57.417959 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.417920    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:57.888243 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.887989    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h77q7"]
Sep 08 10:01:57.888400 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.888292    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:57.888461 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:57.888391    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:01:57.892000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.891770    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9khj9"]
Sep 08 10:01:57.892000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.891884    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:57.892000 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:57.891968    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:57.892754 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.892730    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8fbd"]
Sep 08 10:01:57.892854 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:57.892841    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:57.892965 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:57.892941    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:58.004516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:58.004489    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:58.004937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:58.004569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:58.021136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:58.021110    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:58.022157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:58.022135    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:01:59.905666 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:59.905640    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:01:59.905950 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:59.905684    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:01:59.905950 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:01:59.905762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:01:59.905950 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:59.905763    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:01:59.905950 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:59.905833    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:01:59.905950 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:01:59.905913    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:02:00.010856 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:00.010822    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerStarted","Data":"f36a0c3b3c8806e21b901f54ef9759e74599e46eebbd3150055e86e4e483aefa"}
Sep 08 10:02:00.021609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:00.021570    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9" podUID="4c5727f6-7ac5-49fc-8d81-0b76cbd8b449" containerName="ovnkube-controller" probeResult="failure" output=""
Sep 08 10:02:01.014106 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:01.014077    2582 generic.go:356] "Generic (PLEG): container finished" podID="76973019-5f8b-42a5-81c3-721fe34b693e" containerID="f36a0c3b3c8806e21b901f54ef9759e74599e46eebbd3150055e86e4e483aefa" exitCode=0
Sep 08 10:02:01.014551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:01.014135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerDied","Data":"f36a0c3b3c8806e21b901f54ef9759e74599e46eebbd3150055e86e4e483aefa"}
Sep 08 10:02:01.904076 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:01.903912    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:01.904204 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:01.903929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:02:01.904204 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:01.904143    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9khj9" podUID="a02d75cd-159d-4ddc-bc81-398407a15586"
Sep 08 10:02:01.904297 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:01.904244    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g8fbd" podUID="002fb92f-e88e-4750-afd4-9b718c3bb935"
Sep 08 10:02:01.904297 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:01.903931    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:02:01.904354 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:01.904322    2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h77q7" podUID="2ddb8591-faf6-4515-8ba1-25561d0ae449"
Sep 08 10:02:03.540621 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.540586    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:03.541048 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.540729    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 10:02:03.541048 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.540749    2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 10:02:03.541048 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.540757    2582 projected.go:196] Error preparing data for projected volume kube-api-access-zwlh7 for pod openshift-network-diagnostics/network-check-target-9khj9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:02:03.541048 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.540803    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7 podName:a02d75cd-159d-4ddc-bc81-398407a15586 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:35.540790223 +0000 UTC m=+66.117660642 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zwlh7" (UniqueName: "kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7") pod "network-check-target-9khj9" (UID: "a02d75cd-159d-4ddc-bc81-398407a15586") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 10:02:03.641596 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.641570    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:02:03.641696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.641618    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:02:03.641748 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.641700    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 10:02:03.641748 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.641702    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:02:03.641748 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.641745    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret podName:2ddb8591-faf6-4515-8ba1-25561d0ae449 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:35.641731617 +0000 UTC m=+66.218602037 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret") pod "global-pull-secret-syncer-h77q7" (UID: "2ddb8591-faf6-4515-8ba1-25561d0ae449") : object "kube-system"/"original-pull-secret" not registered
Sep 08 10:02:03.641854 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.641759    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs podName:002fb92f-e88e-4750-afd4-9b718c3bb935 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:35.641751946 +0000 UTC m=+66.218622365 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs") pod "network-metrics-daemon-g8fbd" (UID: "002fb92f-e88e-4750-afd4-9b718c3bb935") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 10:02:03.676797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.676778    2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-238.ec2.internal" event="NodeReady"
Sep 08 10:02:03.676882 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.676853    2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 10:02:03.709601 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.709579    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7764b48b4f-46cnl"]
Sep 08 10:02:03.711310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.711295    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.713573 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.713558    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 10:02:03.713675 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.713582    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 10:02:03.713675 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.713595    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 10:02:03.713903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.713889    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9wz2f\""
Sep 08 10:02:03.719310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.719288    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vxh22"]
Sep 08 10:02:03.719886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.719866    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 10:02:03.721240 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.721211    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.723553 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.723532    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 10:02:03.723700 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.723564    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 10:02:03.723700 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.723576    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pd9dz\""
Sep 08 10:02:03.724864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.724848    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xkf7f"]
Sep 08 10:02:03.728241 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.728206    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7764b48b4f-46cnl"]
Sep 08 10:02:03.728319 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.728299    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:03.730590 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.730561    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 10:02:03.730786 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.730767    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-94npr\""
Sep 08 10:02:03.730866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.730781    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 10:02:03.730866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.730781    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 10:02:03.731053 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.731035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vxh22"]
Sep 08 10:02:03.737425 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.737402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkf7f"]
Sep 08 10:02:03.843831 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-registry-certificates\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.843831 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843827    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-image-registry-private-configuration\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.843946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6njz\" (UniqueName: \"kubernetes.io/projected/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-kube-api-access-l6njz\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.843946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843878    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4rjl\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-kube-api-access-w4rjl\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.843946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843893    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsq5x\" (UniqueName: \"kubernetes.io/projected/3cb472e7-9c97-4699-9d3e-a06d5e863f84-kube-api-access-vsq5x\") pod \"ingress-canary-xkf7f\" (UID: \"3cb472e7-9c97-4699-9d3e-a06d5e863f84\") " pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:03.843946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4431ec4a-1ac5-418a-8781-997c519714ed-ca-trust-extracted\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.843946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cb472e7-9c97-4699-9d3e-a06d5e863f84-cert\") pod \"ingress-canary-xkf7f\" (UID: \"3cb472e7-9c97-4699-9d3e-a06d5e863f84\") " pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:03.844122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843978    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-tmp-dir\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.844122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.843994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-installation-pull-secrets\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.844122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.844018    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-bound-sa-token\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.844122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.844033    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.844122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.844080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-config-volume\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.844122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.844108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.844332 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.844137    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-trusted-ca\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.904311 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.904290    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:02:03.904311 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.904307    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:03.904445 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.904364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:02:03.907252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.907218    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 10:02:03.907345 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.907310    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 10:02:03.907426 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.907407    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 10:02:03.907619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.907594    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 10:02:03.907685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.907599    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9j5d\""
Sep 08 10:02:03.907725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.907685    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nq8l\""
Sep 08 10:02:03.944617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944595    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.944707 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944626    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-config-volume\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.944707 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944647    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.944707 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-trusted-ca\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.944857 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944717    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-registry-certificates\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.944857 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.944735    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 10:02:03.944857 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944770    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-image-registry-private-configuration\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.944857 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.944777    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:03.944857 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.944793    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7764b48b4f-46cnl: secret "image-registry-tls" not found
Sep 08 10:02:03.944857 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.944795    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls podName:b014ffaf-631e-4b5a-b7f6-f8972f5b0350 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:04.444776278 +0000 UTC m=+35.021646697 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls") pod "dns-default-vxh22" (UID: "b014ffaf-631e-4b5a-b7f6-f8972f5b0350") : secret "dns-default-metrics-tls" not found
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:03.944865    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls podName:4431ec4a-1ac5-418a-8781-997c519714ed nodeName:}" failed. No retries permitted until 2026-09-08 10:02:04.444848147 +0000 UTC m=+35.021718568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls") pod "image-registry-7764b48b4f-46cnl" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed") : secret "image-registry-tls" not found
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944908    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6njz\" (UniqueName: \"kubernetes.io/projected/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-kube-api-access-l6njz\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4rjl\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-kube-api-access-w4rjl\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vsq5x\" (UniqueName: \"kubernetes.io/projected/3cb472e7-9c97-4699-9d3e-a06d5e863f84-kube-api-access-vsq5x\") pod \"ingress-canary-xkf7f\" (UID: \"3cb472e7-9c97-4699-9d3e-a06d5e863f84\") " pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.944995    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4431ec4a-1ac5-418a-8781-997c519714ed-ca-trust-extracted\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cb472e7-9c97-4699-9d3e-a06d5e863f84-cert\") pod \"ingress-canary-xkf7f\" (UID: \"3cb472e7-9c97-4699-9d3e-a06d5e863f84\") " pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945053    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-tmp-dir\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-installation-pull-secrets\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.945121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945117    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-bound-sa-token\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.945541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945192    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-config-volume\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.945541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-registry-certificates\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.945541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4431ec4a-1ac5-418a-8781-997c519714ed-ca-trust-extracted\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.945541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-tmp-dir\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.945698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.945617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-trusted-ca\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.948626 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.948607    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-installation-pull-secrets\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.948740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.948645    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3cb472e7-9c97-4699-9d3e-a06d5e863f84-cert\") pod \"ingress-canary-xkf7f\" (UID: \"3cb472e7-9c97-4699-9d3e-a06d5e863f84\") " pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:03.948740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.948704    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-image-registry-private-configuration\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.952629 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.952603    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6njz\" (UniqueName: \"kubernetes.io/projected/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-kube-api-access-l6njz\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:03.953093 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.953073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4rjl\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-kube-api-access-w4rjl\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.953222 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.953201    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-bound-sa-token\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:03.954042 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:03.954017    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsq5x\" (UniqueName: \"kubernetes.io/projected/3cb472e7-9c97-4699-9d3e-a06d5e863f84-kube-api-access-vsq5x\") pod \"ingress-canary-xkf7f\" (UID: \"3cb472e7-9c97-4699-9d3e-a06d5e863f84\") " pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:04.039870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.039851    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xkf7f"
Sep 08 10:02:04.261595 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.261564    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-r4grg"]
Sep 08 10:02:04.263939 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.263923    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.266180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.266159    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 10:02:04.266437 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.266411    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 10:02:04.266550 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.266531    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hrpwv\""
Sep 08 10:02:04.266604 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.266533    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 10:02:04.266651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.266624    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 10:02:04.275768 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.275748    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r4grg"]
Sep 08 10:02:04.315473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.315349    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xkf7f"]
Sep 08 10:02:04.318203 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:04.318182    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cb472e7_9c97_4699_9d3e_a06d5e863f84.slice/crio-9bda61528b7851aeb73de6536f8655ab33931808c1b503fae6fbb2c3954aedcc WatchSource:0}: Error finding container 9bda61528b7851aeb73de6536f8655ab33931808c1b503fae6fbb2c3954aedcc: Status 404 returned error can't find the container with id 9bda61528b7851aeb73de6536f8655ab33931808c1b503fae6fbb2c3954aedcc
Sep 08 10:02:04.348854 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.348805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18ac5029-1b88-48ad-b4dc-078e9b169ca9-crio-socket\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.348854 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.348838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18ac5029-1b88-48ad-b4dc-078e9b169ca9-data-volume\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.348970 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.348858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l74vk\" (UniqueName: \"kubernetes.io/projected/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-api-access-l74vk\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.348970 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.348952    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.349042 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.348982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.449953 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.449934    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.450034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.449964    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.450034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.449996    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:04.450034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.450011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18ac5029-1b88-48ad-b4dc-078e9b169ca9-crio-socket\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.450034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.450030    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.450048    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18ac5029-1b88-48ad-b4dc-078e9b169ca9-data-volume\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.450069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l74vk\" (UniqueName: \"kubernetes.io/projected/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-api-access-l74vk\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450078    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450095    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450112    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450120    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450134    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:04.950115447 +0000 UTC m=+35.526985885 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450136    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7764b48b4f-46cnl: secret "image-registry-tls" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450162    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls podName:b014ffaf-631e-4b5a-b7f6-f8972f5b0350 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:05.450144987 +0000 UTC m=+36.027015427 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls") pod "dns-default-vxh22" (UID: "b014ffaf-631e-4b5a-b7f6-f8972f5b0350") : secret "dns-default-metrics-tls" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450188    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:04.950171107 +0000 UTC m=+35.527041560 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : configmap "kube-rbac-proxy" not found
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.450197    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/18ac5029-1b88-48ad-b4dc-078e9b169ca9-crio-socket\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.450252 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.450208    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls podName:4431ec4a-1ac5-418a-8781-997c519714ed nodeName:}" failed. No retries permitted until 2026-09-08 10:02:05.450197968 +0000 UTC m=+36.027068393 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls") pod "image-registry-7764b48b4f-46cnl" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed") : secret "image-registry-tls" not found
Sep 08 10:02:04.450635 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.450361    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/18ac5029-1b88-48ad-b4dc-078e9b169ca9-data-volume\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.460418 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.460395    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l74vk\" (UniqueName: \"kubernetes.io/projected/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-api-access-l74vk\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.955111 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.954955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.955701 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.955120    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:04.955701 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.955165    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 10:02:04.955701 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:04.955124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:04.955701 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.955192    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:05.955171378 +0000 UTC m=+36.532041800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:04.955701 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:04.955274    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:05.955253231 +0000 UTC m=+36.532123650 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : configmap "kube-rbac-proxy" not found
Sep 08 10:02:05.022770 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.022746    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkf7f" event={"ID":"3cb472e7-9c97-4699-9d3e-a06d5e863f84","Type":"ContainerStarted","Data":"9bda61528b7851aeb73de6536f8655ab33931808c1b503fae6fbb2c3954aedcc"}
Sep 08 10:02:05.024831 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.024809    2582 generic.go:356] "Generic (PLEG): container finished" podID="76973019-5f8b-42a5-81c3-721fe34b693e" containerID="47d71ae05eacc639eec0a853127703d6b6524f1f365a925750ff766509c31623" exitCode=0
Sep 08 10:02:05.024918 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.024862    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerDied","Data":"47d71ae05eacc639eec0a853127703d6b6524f1f365a925750ff766509c31623"}
Sep 08 10:02:05.459369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.459331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:05.459543 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.459382    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:05.459543 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.459504    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:05.459543 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.459519    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7764b48b4f-46cnl: secret "image-registry-tls" not found
Sep 08 10:02:05.459703 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.459589    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls podName:4431ec4a-1ac5-418a-8781-997c519714ed nodeName:}" failed. No retries permitted until 2026-09-08 10:02:07.459558135 +0000 UTC m=+38.036428555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls") pod "image-registry-7764b48b4f-46cnl" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed") : secret "image-registry-tls" not found
Sep 08 10:02:05.460254 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.460002    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 10:02:05.460254 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.460061    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls podName:b014ffaf-631e-4b5a-b7f6-f8972f5b0350 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:07.460044374 +0000 UTC m=+38.036914810 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls") pod "dns-default-vxh22" (UID: "b014ffaf-631e-4b5a-b7f6-f8972f5b0350") : secret "dns-default-metrics-tls" not found
Sep 08 10:02:05.964857 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.964757    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:05.964857 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:05.964808    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:05.965340 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.964942    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 10:02:05.965340 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.964963    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:05.965340 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.965025    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:07.965003001 +0000 UTC m=+38.541873438 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : configmap "kube-rbac-proxy" not found
Sep 08 10:02:05.965340 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:05.965063    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:07.965050718 +0000 UTC m=+38.541921159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:06.029724 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:06.029695    2582 generic.go:356] "Generic (PLEG): container finished" podID="76973019-5f8b-42a5-81c3-721fe34b693e" containerID="e4b3b4c08ac8fffb2f1af149cbe120083d6cb8161e3675ed37af231921e46cf4" exitCode=0
Sep 08 10:02:06.029879 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:06.029761    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerDied","Data":"e4b3b4c08ac8fffb2f1af149cbe120083d6cb8161e3675ed37af231921e46cf4"}
Sep 08 10:02:06.634063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:06.634036    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6rqzs_b836398d-00f0-4d38-9dc6-21c41faa914c/dns-node-resolver/0.log"
Sep 08 10:02:07.476258 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:07.476213    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:07.476651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:07.476269    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:07.476651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.476385    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 10:02:07.476651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.476428    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:07.476651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.476445    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7764b48b4f-46cnl: secret "image-registry-tls" not found
Sep 08 10:02:07.476651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.476452    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls podName:b014ffaf-631e-4b5a-b7f6-f8972f5b0350 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:11.476436446 +0000 UTC m=+42.053306865 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls") pod "dns-default-vxh22" (UID: "b014ffaf-631e-4b5a-b7f6-f8972f5b0350") : secret "dns-default-metrics-tls" not found
Sep 08 10:02:07.476651 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.476494    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls podName:4431ec4a-1ac5-418a-8781-997c519714ed nodeName:}" failed. No retries permitted until 2026-09-08 10:02:11.476478228 +0000 UTC m=+42.053348665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls") pod "image-registry-7764b48b4f-46cnl" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed") : secret "image-registry-tls" not found
Sep 08 10:02:07.634148 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:07.634118    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wqszc_480b3071-c19a-4100-8b33-c1ea2c8f1345/node-ca/0.log"
Sep 08 10:02:07.980575 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:07.980542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:07.980750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:07.980584    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:07.980750 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.980673    2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 10:02:07.980750 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.980703    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:07.980750 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.980719    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:11.980705883 +0000 UTC m=+42.557576316 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : configmap "kube-rbac-proxy" not found
Sep 08 10:02:07.980950 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:07.980759    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:11.98074073 +0000 UTC m=+42.557611169 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:08.036819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:08.036794    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xkf7f" event={"ID":"3cb472e7-9c97-4699-9d3e-a06d5e863f84","Type":"ContainerStarted","Data":"e275edc5aac225b4a317f27999d6eef835b6ea4729b1b861b1d79775feb5c58d"}
Sep 08 10:02:08.051657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:08.051596    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xkf7f" podStartSLOduration=2.275826394 podStartE2EDuration="5.051570385s" totalImagesPullingTime="2.775743991s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:08.051064902 +0000 UTC m=+38.627935344" watchObservedRunningTime="2026-09-08 10:02:08.051570385 +0000 UTC m=+38.628440827"
Sep 08 10:02:08.432734 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:08.432705    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xkf7f_3cb472e7-9c97-4699-9d3e-a06d5e863f84/serve-healthcheck-canary/0.log"
Sep 08 10:02:11.509010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:11.508981    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:11.509325 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:11.509016    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:11.509325 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:11.509119    2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 10:02:11.509325 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:11.509122    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 10:02:11.509325 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:11.509133    2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7764b48b4f-46cnl: secret "image-registry-tls" not found
Sep 08 10:02:11.509325 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:11.509185    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls podName:4431ec4a-1ac5-418a-8781-997c519714ed nodeName:}" failed. No retries permitted until 2026-09-08 10:02:19.509171728 +0000 UTC m=+50.086042147 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls") pod "image-registry-7764b48b4f-46cnl" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed") : secret "image-registry-tls" not found
Sep 08 10:02:11.509325 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:11.509198    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls podName:b014ffaf-631e-4b5a-b7f6-f8972f5b0350 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:19.509192391 +0000 UTC m=+50.086062810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls") pod "dns-default-vxh22" (UID: "b014ffaf-631e-4b5a-b7f6-f8972f5b0350") : secret "dns-default-metrics-tls" not found
Sep 08 10:02:12.012986 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:12.012960    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:12.013087 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:12.012989    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:12.013123 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:12.013094    2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:12.013167 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:12.013156    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls podName:18ac5029-1b88-48ad-b4dc-078e9b169ca9 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:20.013138227 +0000 UTC m=+50.590008647 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls") pod "insights-runtime-extractor-r4grg" (UID: "18ac5029-1b88-48ad-b4dc-078e9b169ca9") : secret "insights-runtime-extractor-tls" not found
Sep 08 10:02:12.013442 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:12.013427    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/18ac5029-1b88-48ad-b4dc-078e9b169ca9-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:12.048011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:12.047986    2582 generic.go:356] "Generic (PLEG): container finished" podID="76973019-5f8b-42a5-81c3-721fe34b693e" containerID="87acf10c72cfab86543429f3e3032778ecb8a3ed06e2f328fb641eae14a4a025" exitCode=0
Sep 08 10:02:12.048087 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:12.048038    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerDied","Data":"87acf10c72cfab86543429f3e3032778ecb8a3ed06e2f328fb641eae14a4a025"}
Sep 08 10:02:13.053212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:13.053180    2582 generic.go:356] "Generic (PLEG): container finished" podID="76973019-5f8b-42a5-81c3-721fe34b693e" containerID="b1e5c0b5768fafc4678fb1ac31a140300a54cbd3f6cabc1f0c630b0861d96b09" exitCode=0
Sep 08 10:02:13.053212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:13.053212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerDied","Data":"b1e5c0b5768fafc4678fb1ac31a140300a54cbd3f6cabc1f0c630b0861d96b09"}
Sep 08 10:02:14.058645 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:14.058612    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-x62rj" event={"ID":"76973019-5f8b-42a5-81c3-721fe34b693e","Type":"ContainerStarted","Data":"d2f5cfde8006cf0b7eb4464acf0ca6be231121a1ac418d13a82b681480f2fd45"}
Sep 08 10:02:14.082040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:14.082000    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-x62rj" podStartSLOduration=7.894792193 podStartE2EDuration="44.081987238s" totalImagesPullingTime="36.187195045s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:14.080191375 +0000 UTC m=+44.657061818" watchObservedRunningTime="2026-09-08 10:02:14.081987238 +0000 UTC m=+44.658857678"
Sep 08 10:02:19.570540 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.570505    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:19.571096 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.570548    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:19.573736 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.573714    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b014ffaf-631e-4b5a-b7f6-f8972f5b0350-metrics-tls\") pod \"dns-default-vxh22\" (UID: \"b014ffaf-631e-4b5a-b7f6-f8972f5b0350\") " pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:19.573819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.573750    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"image-registry-7764b48b4f-46cnl\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") " pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:19.621636 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.621608    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:19.629788 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.629763    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:19.931200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.931171    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7764b48b4f-46cnl"]
Sep 08 10:02:19.934711 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:19.934684    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4431ec4a_1ac5_418a_8781_997c519714ed.slice/crio-09d1d2f3aa3db3f896ad4f3d62ba90bd76017b3424c74f27acdd0e584cb5dc40 WatchSource:0}: Error finding container 09d1d2f3aa3db3f896ad4f3d62ba90bd76017b3424c74f27acdd0e584cb5dc40: Status 404 returned error can't find the container with id 09d1d2f3aa3db3f896ad4f3d62ba90bd76017b3424c74f27acdd0e584cb5dc40
Sep 08 10:02:19.946023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:19.945999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vxh22"]
Sep 08 10:02:19.948462 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:19.948440    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb014ffaf_631e_4b5a_b7f6_f8972f5b0350.slice/crio-d04245f102beea7e09165cba88630b2e1e4ce55f5e76c313af9855d58cfb88d6 WatchSource:0}: Error finding container d04245f102beea7e09165cba88630b2e1e4ce55f5e76c313af9855d58cfb88d6: Status 404 returned error can't find the container with id d04245f102beea7e09165cba88630b2e1e4ce55f5e76c313af9855d58cfb88d6
Sep 08 10:02:20.073988 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.073956    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vxh22" event={"ID":"b014ffaf-631e-4b5a-b7f6-f8972f5b0350","Type":"ContainerStarted","Data":"d04245f102beea7e09165cba88630b2e1e4ce55f5e76c313af9855d58cfb88d6"}
Sep 08 10:02:20.074117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.074094    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:20.075609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.075580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" event={"ID":"4431ec4a-1ac5-418a-8781-997c519714ed","Type":"ContainerStarted","Data":"0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57"}
Sep 08 10:02:20.075725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.075624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" event={"ID":"4431ec4a-1ac5-418a-8781-997c519714ed","Type":"ContainerStarted","Data":"09d1d2f3aa3db3f896ad4f3d62ba90bd76017b3424c74f27acdd0e584cb5dc40"}
Sep 08 10:02:20.075725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.075701    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:20.076414 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.076396    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/18ac5029-1b88-48ad-b4dc-078e9b169ca9-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-r4grg\" (UID: \"18ac5029-1b88-48ad-b4dc-078e9b169ca9\") " pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:20.095526 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.095484    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" podStartSLOduration=47.09547265 podStartE2EDuration="47.09547265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:01:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:20.094329384 +0000 UTC m=+50.671199842" watchObservedRunningTime="2026-09-08 10:02:20.09547265 +0000 UTC m=+50.672343090"
Sep 08 10:02:20.172962 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.172929    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-r4grg"
Sep 08 10:02:20.453756 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:20.453673    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-r4grg"]
Sep 08 10:02:20.475029 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:20.474997    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ac5029_1b88_48ad_b4dc_078e9b169ca9.slice/crio-6782e7fc36120ac4162860b6fee9aa738ffc242a6f8e924f0e07a9c6ce47122a WatchSource:0}: Error finding container 6782e7fc36120ac4162860b6fee9aa738ffc242a6f8e924f0e07a9c6ce47122a: Status 404 returned error can't find the container with id 6782e7fc36120ac4162860b6fee9aa738ffc242a6f8e924f0e07a9c6ce47122a
Sep 08 10:02:21.079339 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:21.079302    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4grg" event={"ID":"18ac5029-1b88-48ad-b4dc-078e9b169ca9","Type":"ContainerStarted","Data":"5e181969054f4e740fa65d4aba9b6b850613a895a062704203eb89f2bb2e318a"}
Sep 08 10:02:21.079701 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:21.079370    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4grg" event={"ID":"18ac5029-1b88-48ad-b4dc-078e9b169ca9","Type":"ContainerStarted","Data":"6782e7fc36120ac4162860b6fee9aa738ffc242a6f8e924f0e07a9c6ce47122a"}
Sep 08 10:02:24.088476 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:24.088446    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vxh22" event={"ID":"b014ffaf-631e-4b5a-b7f6-f8972f5b0350","Type":"ContainerStarted","Data":"68bc89514c5f860d790c89b2775942dcc8f555728469b44a1ef2bd64dc50248d"}
Sep 08 10:02:25.092440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:25.092400    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vxh22" event={"ID":"b014ffaf-631e-4b5a-b7f6-f8972f5b0350","Type":"ContainerStarted","Data":"984e6f53855423b664c6d3e5a4b80bd8e5a7cc0406997586a62647b492be0308"}
Sep 08 10:02:25.092811 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:25.092537    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:25.110721 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:25.110672    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vxh22" podStartSLOduration=18.227422102 podStartE2EDuration="22.110660048s" totalImagesPullingTime="3.883237946s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:25.109966037 +0000 UTC m=+55.686836478" watchObservedRunningTime="2026-09-08 10:02:25.110660048 +0000 UTC m=+55.687530489"
Sep 08 10:02:28.102161 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:28.102124    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4grg" event={"ID":"18ac5029-1b88-48ad-b4dc-078e9b169ca9","Type":"ContainerStarted","Data":"c50d6fea81b4e0b982d5fd52fe8628ac17bd1c9c33061670290a4079cbede39d"}
Sep 08 10:02:29.107363 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.107324    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-r4grg" event={"ID":"18ac5029-1b88-48ad-b4dc-078e9b169ca9","Type":"ContainerStarted","Data":"5596b7c524d1175b9731a613950703f16dbdc2c5201164acc91a0a016e92fd77"}
Sep 08 10:02:29.295641 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.295583    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-r4grg" podStartSLOduration=17.266597396 podStartE2EDuration="25.295566458s" totalImagesPullingTime="8.028969062s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:02:04 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:29.130179433 +0000 UTC m=+59.707049877" watchObservedRunningTime="2026-09-08 10:02:29.295566458 +0000 UTC m=+59.872436899"
Sep 08 10:02:29.296209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.296188    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"]
Sep 08 10:02:29.298181 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.298160    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.302029 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.302011    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 08 10:02:29.302286 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.302271    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 10:02:29.303003 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.302984    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 08 10:02:29.303643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.303620    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 08 10:02:29.304252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.304217    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 10:02:29.304858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.304843    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 08 10:02:29.307384 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.307369    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 10:02:29.316329 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.316310    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"]
Sep 08 10:02:29.321839 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.321818    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7764b48b4f-46cnl"]
Sep 08 10:02:29.337733 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.337710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-947q2\" (UniqueName: \"kubernetes.io/projected/b4390daa-9a17-4183-8498-75123d3119a5-kube-api-access-947q2\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.337827 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.337735    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-ca\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.337827 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.337755    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.337827 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.337790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-hub\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.337827 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.337808    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4390daa-9a17-4183-8498-75123d3119a5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.337959 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.337833    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.438567 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.438542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-hub\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.438674 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.438571    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4390daa-9a17-4183-8498-75123d3119a5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.438674 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.438590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.438804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.438786    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-947q2\" (UniqueName: \"kubernetes.io/projected/b4390daa-9a17-4183-8498-75123d3119a5-kube-api-access-947q2\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.438867 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.438822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-ca\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.438867 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.438853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.439348 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.439325    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b4390daa-9a17-4183-8498-75123d3119a5-additional-service-ca\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.441109 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.441091    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.441200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.441127    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-hub\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.441527 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.441506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-ca\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.441527 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.441518    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b4390daa-9a17-4183-8498-75123d3119a5-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.454814 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.454791    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-947q2\" (UniqueName: \"kubernetes.io/projected/b4390daa-9a17-4183-8498-75123d3119a5-kube-api-access-947q2\") pod \"cluster-proxy-proxy-agent-6bdf5f68c5-xrgns\" (UID: \"b4390daa-9a17-4183-8498-75123d3119a5\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.616522 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.616501    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"
Sep 08 10:02:29.883332 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:29.883271    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns"]
Sep 08 10:02:29.885874 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:29.885846    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb4390daa_9a17_4183_8498_75123d3119a5.slice/crio-f67bd7f48a7b7e9b6260c017bc86004c3cda397065133c3f49b4a386ac262671 WatchSource:0}: Error finding container f67bd7f48a7b7e9b6260c017bc86004c3cda397065133c3f49b4a386ac262671: Status 404 returned error can't find the container with id f67bd7f48a7b7e9b6260c017bc86004c3cda397065133c3f49b4a386ac262671
Sep 08 10:02:30.020502 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:30.020480    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tj7h9"
Sep 08 10:02:30.111074 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:30.111044    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns" event={"ID":"b4390daa-9a17-4183-8498-75123d3119a5","Type":"ContainerStarted","Data":"f67bd7f48a7b7e9b6260c017bc86004c3cda397065133c3f49b4a386ac262671"}
Sep 08 10:02:31.604742 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.604714    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"]
Sep 08 10:02:31.608502 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.608487    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:31.610622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.610596    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Sep 08 10:02:31.610745 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.610690    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-k8wtg\""
Sep 08 10:02:31.615571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.615548    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"]
Sep 08 10:02:31.652719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.652694    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cdee483-6036-4baf-a83c-2f0ced2eece6-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5c6mq\" (UID: \"8cdee483-6036-4baf-a83c-2f0ced2eece6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:31.753189 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:31.753166    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cdee483-6036-4baf-a83c-2f0ced2eece6-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5c6mq\" (UID: \"8cdee483-6036-4baf-a83c-2f0ced2eece6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:31.753289 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:31.753276    2582 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 10:02:31.753335 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:31.753327    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8cdee483-6036-4baf-a83c-2f0ced2eece6-tls-certificates podName:8cdee483-6036-4baf-a83c-2f0ced2eece6 nodeName:}" failed. No retries permitted until 2026-09-08 10:02:32.253313508 +0000 UTC m=+62.830183927 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/8cdee483-6036-4baf-a83c-2f0ced2eece6-tls-certificates") pod "prometheus-operator-admission-webhook-78f599db79-5c6mq" (UID: "8cdee483-6036-4baf-a83c-2f0ced2eece6") : secret "prometheus-operator-admission-webhook-tls" not found
Sep 08 10:02:32.256531 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:32.256506    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cdee483-6036-4baf-a83c-2f0ced2eece6-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5c6mq\" (UID: \"8cdee483-6036-4baf-a83c-2f0ced2eece6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:32.258767 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:32.258741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/8cdee483-6036-4baf-a83c-2f0ced2eece6-tls-certificates\") pod \"prometheus-operator-admission-webhook-78f599db79-5c6mq\" (UID: \"8cdee483-6036-4baf-a83c-2f0ced2eece6\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:32.521367 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:32.521317    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:32.786489 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:32.786420    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"]
Sep 08 10:02:32.789781 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:32.789758    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cdee483_6036_4baf_a83c_2f0ced2eece6.slice/crio-00f7cbc34f0c413fe9ecde06184048afc5bbe7cfd7d189239363c7518ab3c065 WatchSource:0}: Error finding container 00f7cbc34f0c413fe9ecde06184048afc5bbe7cfd7d189239363c7518ab3c065: Status 404 returned error can't find the container with id 00f7cbc34f0c413fe9ecde06184048afc5bbe7cfd7d189239363c7518ab3c065
Sep 08 10:02:33.121879 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:33.121800    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq" event={"ID":"8cdee483-6036-4baf-a83c-2f0ced2eece6","Type":"ContainerStarted","Data":"00f7cbc34f0c413fe9ecde06184048afc5bbe7cfd7d189239363c7518ab3c065"}
Sep 08 10:02:35.096985 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.096952    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vxh22"
Sep 08 10:02:35.585244 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.585194    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:35.587872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.587849    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 10:02:35.598279 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.598260    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 10:02:35.608571 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.608550    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwlh7\" (UniqueName: \"kubernetes.io/projected/a02d75cd-159d-4ddc-bc81-398407a15586-kube-api-access-zwlh7\") pod \"network-check-target-9khj9\" (UID: \"a02d75cd-159d-4ddc-bc81-398407a15586\") " pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:35.685633 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.685608    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:02:35.685740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.685668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:02:35.688882 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.688852    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 10:02:35.690002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.689986    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 10:02:35.698458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.698426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/2ddb8591-faf6-4515-8ba1-25561d0ae449-original-pull-secret\") pod \"global-pull-secret-syncer-h77q7\" (UID: \"2ddb8591-faf6-4515-8ba1-25561d0ae449\") " pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:02:35.698560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.698493    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002fb92f-e88e-4750-afd4-9b718c3bb935-metrics-certs\") pod \"network-metrics-daemon-g8fbd\" (UID: \"002fb92f-e88e-4750-afd4-9b718c3bb935\") " pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:02:35.713463 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.713442    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h77q7"
Sep 08 10:02:35.720873 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.720852    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v9j5d\""
Sep 08 10:02:35.725105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.725088    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8nq8l\""
Sep 08 10:02:35.729081 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.729065    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:35.733668 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:35.733654    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g8fbd"
Sep 08 10:02:36.101278 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.101204    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h77q7"]
Sep 08 10:02:36.104991 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:36.104963    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddb8591_faf6_4515_8ba1_25561d0ae449.slice/crio-fc165e98c8b8ace713e3ee32876f411e13e2395016d876797e3cfbc4dc3d3c88 WatchSource:0}: Error finding container fc165e98c8b8ace713e3ee32876f411e13e2395016d876797e3cfbc4dc3d3c88: Status 404 returned error can't find the container with id fc165e98c8b8ace713e3ee32876f411e13e2395016d876797e3cfbc4dc3d3c88
Sep 08 10:02:36.105115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.105017    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g8fbd"]
Sep 08 10:02:36.106059 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.105975    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9khj9"]
Sep 08 10:02:36.107835 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:36.107815    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002fb92f_e88e_4750_afd4_9b718c3bb935.slice/crio-ec9f4648da8d62288729e0cf2612a7f8eba2bdda0a4081d804eee861b06e0347 WatchSource:0}: Error finding container ec9f4648da8d62288729e0cf2612a7f8eba2bdda0a4081d804eee861b06e0347: Status 404 returned error can't find the container with id ec9f4648da8d62288729e0cf2612a7f8eba2bdda0a4081d804eee861b06e0347
Sep 08 10:02:36.108513 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:36.108495    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda02d75cd_159d_4ddc_bc81_398407a15586.slice/crio-0a45374d5aa734ab93572d6df00e4fe05cd70be2119d9ae259e92874dbe21114 WatchSource:0}: Error finding container 0a45374d5aa734ab93572d6df00e4fe05cd70be2119d9ae259e92874dbe21114: Status 404 returned error can't find the container with id 0a45374d5aa734ab93572d6df00e4fe05cd70be2119d9ae259e92874dbe21114
Sep 08 10:02:36.132652 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.132623    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns" event={"ID":"b4390daa-9a17-4183-8498-75123d3119a5","Type":"ContainerStarted","Data":"7eefa63e8e08b87f81dddc45606a2b72384c626d39b156324abd8a927405aefb"}
Sep 08 10:02:36.132734 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.132661    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns" event={"ID":"b4390daa-9a17-4183-8498-75123d3119a5","Type":"ContainerStarted","Data":"2170184a53dbc430de42dfef95995cb3e95547374fde24881fa6a152e2a5e738"}
Sep 08 10:02:36.132734 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.132678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns" event={"ID":"b4390daa-9a17-4183-8498-75123d3119a5","Type":"ContainerStarted","Data":"8d28fbac0fa90cf9dafa25cb55ec59e2b28293d17141988815ff0f0d30c27dc2"}
Sep 08 10:02:36.134101 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.134080    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq" event={"ID":"8cdee483-6036-4baf-a83c-2f0ced2eece6","Type":"ContainerStarted","Data":"0aee45724106eed8f604d6bde595443fb5563279582803959b405b57e48bbe70"}
Sep 08 10:02:36.134164 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.134129    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:36.135369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.135349    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8fbd" event={"ID":"002fb92f-e88e-4750-afd4-9b718c3bb935","Type":"ContainerStarted","Data":"ec9f4648da8d62288729e0cf2612a7f8eba2bdda0a4081d804eee861b06e0347"}
Sep 08 10:02:36.136754 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.136704    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9khj9" event={"ID":"a02d75cd-159d-4ddc-bc81-398407a15586","Type":"ContainerStarted","Data":"0a45374d5aa734ab93572d6df00e4fe05cd70be2119d9ae259e92874dbe21114"}
Sep 08 10:02:36.137808 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.137789    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h77q7" event={"ID":"2ddb8591-faf6-4515-8ba1-25561d0ae449","Type":"ContainerStarted","Data":"fc165e98c8b8ace713e3ee32876f411e13e2395016d876797e3cfbc4dc3d3c88"}
Sep 08 10:02:36.138890 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.138874    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq"
Sep 08 10:02:36.153728 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.153688    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-6bdf5f68c5-xrgns" podStartSLOduration=1.209641551 podStartE2EDuration="7.153676059s" totalImagesPullingTime="5.944034508s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:36.152165036 +0000 UTC m=+66.729035477" watchObservedRunningTime="2026-09-08 10:02:36.153676059 +0000 UTC m=+66.730546501"
Sep 08 10:02:36.167139 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:36.167099    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-78f599db79-5c6mq" podStartSLOduration=2.1356414519999998 podStartE2EDuration="5.167086625s" totalImagesPullingTime="3.031445173s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:36.166637587 +0000 UTC m=+66.743508028" watchObservedRunningTime="2026-09-08 10:02:36.167086625 +0000 UTC m=+66.743957060"
Sep 08 10:02:38.402591 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.402561    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-b69fc5bdf-tc9nz"]
Sep 08 10:02:38.405903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.405877    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.409560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.409355    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-brk64\""
Sep 08 10:02:38.409560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.409436    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 10:02:38.409560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.409484    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 10:02:38.409560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.409517    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 10:02:38.409560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.409486    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 10:02:38.409840 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.409585    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 10:02:38.410192 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.410174    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 10:02:38.410605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.410581    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 10:02:38.414966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.414943    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 10:02:38.416582 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.416563    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b69fc5bdf-tc9nz"]
Sep 08 10:02:38.505816 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.505771    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqxk\" (UniqueName: \"kubernetes.io/projected/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-kube-api-access-vvqxk\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.505975 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.505837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-serving-cert\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.505975 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.505910    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-config\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.506113 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.505987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-oauth-serving-cert\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.506113 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.506021    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-trusted-ca-bundle\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.506113 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.506045    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-service-ca\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.506113 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.506080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-oauth-config\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.606686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.606642    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-trusted-ca-bundle\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.606894 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.606695    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-service-ca\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.606894 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.606848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-oauth-config\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.606922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqxk\" (UniqueName: \"kubernetes.io/projected/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-kube-api-access-vvqxk\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.606978    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-serving-cert\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607108 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.607011    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-config\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607108 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.607040    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-oauth-serving-cert\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607592 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.607553    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-service-ca\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607724 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.607682    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-oauth-serving-cert\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.607801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.607769    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-trusted-ca-bundle\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.608015 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.607995    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-config\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.609891 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.609849    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-oauth-config\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.610854 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.610829    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-serving-cert\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.615485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.615465    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqxk\" (UniqueName: \"kubernetes.io/projected/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-kube-api-access-vvqxk\") pod \"console-b69fc5bdf-tc9nz\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") " pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:38.718263 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:38.718210    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:39.328902 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:39.328868    2582 patch_prober.go:28] interesting pod/image-registry-7764b48b4f-46cnl container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 10:02:39.329002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:39.328924    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" podUID="4431ec4a-1ac5-418a-8781-997c519714ed" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 10:02:39.477600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:39.477522    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-b69fc5bdf-tc9nz"]
Sep 08 10:02:39.480904 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:39.480877    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfdbcf7e1_f4c0_4650_8ff3_de6dd604e144.slice/crio-8e5190fa8d91d00c3c86f39c1b69d7794ce062f44df18b80d7bb119fd5eb5993 WatchSource:0}: Error finding container 8e5190fa8d91d00c3c86f39c1b69d7794ce062f44df18b80d7bb119fd5eb5993: Status 404 returned error can't find the container with id 8e5190fa8d91d00c3c86f39c1b69d7794ce062f44df18b80d7bb119fd5eb5993
Sep 08 10:02:40.154255 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:40.154204    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b69fc5bdf-tc9nz" event={"ID":"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144","Type":"ContainerStarted","Data":"8e5190fa8d91d00c3c86f39c1b69d7794ce062f44df18b80d7bb119fd5eb5993"}
Sep 08 10:02:40.155933 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:40.155902    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9khj9" event={"ID":"a02d75cd-159d-4ddc-bc81-398407a15586","Type":"ContainerStarted","Data":"b78d7a88bc591b0b8d8a403764d1a4a1e4c80cad0f1b0f05b53dc90ebb48d5ce"}
Sep 08 10:02:40.156071 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:40.156033    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:02:40.172448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:40.172397    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9khj9" podStartSLOduration=68.035226489 podStartE2EDuration="1m11.172379912s" totalImagesPullingTime="3.137153423s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:40.170673793 +0000 UTC m=+70.747544236" watchObservedRunningTime="2026-09-08 10:02:40.172379912 +0000 UTC m=+70.749250354"
Sep 08 10:02:42.165127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:42.165096    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8fbd" event={"ID":"002fb92f-e88e-4750-afd4-9b718c3bb935","Type":"ContainerStarted","Data":"73a0bad7f64171aeeb0f65d670074404b58f7f978398192a36a9d5b98f67a53c"}
Sep 08 10:02:42.165537 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:42.165153    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g8fbd" event={"ID":"002fb92f-e88e-4750-afd4-9b718c3bb935","Type":"ContainerStarted","Data":"e52d4f6a99247fcd7f956c5fa3e0dee7666d084cc1706cf526faac330d7f1f17"}
Sep 08 10:02:42.166503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:42.166480    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h77q7" event={"ID":"2ddb8591-faf6-4515-8ba1-25561d0ae449","Type":"ContainerStarted","Data":"273003080b7c8265f0ce55e1fc70546bedbdc4fface4b61f678801888c7288c3"}
Sep 08 10:02:42.181006 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:42.180966    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g8fbd" podStartSLOduration=68.199874958 podStartE2EDuration="1m13.180951918s" totalImagesPullingTime="4.98107696s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:01:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:42.17937842 +0000 UTC m=+72.756248887" watchObservedRunningTime="2026-09-08 10:02:42.180951918 +0000 UTC m=+72.757822359"
Sep 08 10:02:42.192514 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:42.192474    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h77q7" podStartSLOduration=67.199253906 podStartE2EDuration="1m12.192462576s" totalImagesPullingTime="4.99320867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:01:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:42.192440327 +0000 UTC m=+72.769310778" watchObservedRunningTime="2026-09-08 10:02:42.192462576 +0000 UTC m=+72.769333017"
Sep 08 10:02:43.047785 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.047749    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"]
Sep 08 10:02:43.069442 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.069418    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"]
Sep 08 10:02:43.069586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.069542    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.072325 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.072303    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-zpqvd\""
Sep 08 10:02:43.072444 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.072413    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Sep 08 10:02:43.072444 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.072336    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 10:02:43.072564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.072341    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Sep 08 10:02:43.073206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.073191    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 10:02:43.073296 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.073241    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 10:02:43.092509 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.092484    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4jf7r"]
Sep 08 10:02:43.109826 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.109799    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.112842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.112762    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 10:02:43.112945 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.112931    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-f9gjt\""
Sep 08 10:02:43.113007 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.112936    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 10:02:43.113085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.113025    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 10:02:43.142294 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.142266    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.142428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.142308    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4jw7\" (UniqueName: \"kubernetes.io/projected/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-kube-api-access-m4jw7\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.142428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.142344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.142428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.142418    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.243446 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4jw7\" (UniqueName: \"kubernetes.io/projected/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-kube-api-access-m4jw7\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-wtmp\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243559    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-textfile\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-sys\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-tls\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243654    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243711    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243747    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jddx8\" (UniqueName: \"kubernetes.io/projected/e5399135-2eb2-493c-9b83-1370f654b6bd-kube-api-access-jddx8\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.243889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243882    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.244374 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:43.243895    2582 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Sep 08 10:02:43.244374 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.243934    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-root\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.244374 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:43.243956    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-tls podName:c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd nodeName:}" failed. No retries permitted until 2026-09-08 10:02:43.743937357 +0000 UTC m=+74.320807793 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-29bdq" (UID: "c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd") : secret "openshift-state-metrics-tls" not found
Sep 08 10:02:43.244374 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.244038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5399135-2eb2-493c-9b83-1370f654b6bd-metrics-client-ca\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.244374 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.244287    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.246206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.246185    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.255453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.255434    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4jw7\" (UniqueName: \"kubernetes.io/projected/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-kube-api-access-m4jw7\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.344838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.344777    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-textfile\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.344838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.344813    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-sys\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.344838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.344837    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-tls\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345099 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.344911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-sys\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345099 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:43.344923    2582 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 10:02:43.345099 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.344957    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345099 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:43.345003    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-tls podName:e5399135-2eb2-493c-9b83-1370f654b6bd nodeName:}" failed. No retries permitted until 2026-09-08 10:02:43.84498072 +0000 UTC m=+74.421851153 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-tls") pod "node-exporter-4jf7r" (UID: "e5399135-2eb2-493c-9b83-1370f654b6bd") : secret "node-exporter-tls" not found
Sep 08 10:02:43.345099 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345099 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345086    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jddx8\" (UniqueName: \"kubernetes.io/projected/e5399135-2eb2-493c-9b83-1370f654b6bd-kube-api-access-jddx8\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345117    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-textfile\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345241    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-root\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345294    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-root\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345324    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5399135-2eb2-493c-9b83-1370f654b6bd-metrics-client-ca\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345363    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-wtmp\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345519    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-wtmp\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345604    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-accelerators-collector-config\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.345862 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.345807    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e5399135-2eb2-493c-9b83-1370f654b6bd-metrics-client-ca\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.347433 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.347411    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.353654 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.353632    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jddx8\" (UniqueName: \"kubernetes.io/projected/e5399135-2eb2-493c-9b83-1370f654b6bd-kube-api-access-jddx8\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.749126 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.749091    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.751577 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.751549    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-29bdq\" (UID: \"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:43.850287 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.850259    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-tls\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.852545 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.852525    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e5399135-2eb2-493c-9b83-1370f654b6bd-node-exporter-tls\") pod \"node-exporter-4jf7r\" (UID: \"e5399135-2eb2-493c-9b83-1370f654b6bd\") " pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:43.978220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:43.978191    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"
Sep 08 10:02:44.017331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:44.017308    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4jf7r"
Sep 08 10:02:44.047777 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:44.047742    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5399135_2eb2_493c_9b83_1370f654b6bd.slice/crio-51e3087c68d71170f871711f4cff109b4a7572ffec656f731e822fa13b6bfaf4 WatchSource:0}: Error finding container 51e3087c68d71170f871711f4cff109b4a7572ffec656f731e822fa13b6bfaf4: Status 404 returned error can't find the container with id 51e3087c68d71170f871711f4cff109b4a7572ffec656f731e822fa13b6bfaf4
Sep 08 10:02:44.176047 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:44.176009    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jf7r" event={"ID":"e5399135-2eb2-493c-9b83-1370f654b6bd","Type":"ContainerStarted","Data":"51e3087c68d71170f871711f4cff109b4a7572ffec656f731e822fa13b6bfaf4"}
Sep 08 10:02:44.287652 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:44.287621    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq"]
Sep 08 10:02:45.051680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.051645    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"]
Sep 08 10:02:45.059861 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.059824    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.062303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.062278    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Sep 08 10:02:45.062476 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.062383    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Sep 08 10:02:45.062554 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.062383    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Sep 08 10:02:45.062605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.062408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Sep 08 10:02:45.063428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.063406    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-498smmaoqgjkh\""
Sep 08 10:02:45.063561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.063412    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Sep 08 10:02:45.063561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.063441    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-55hjg\""
Sep 08 10:02:45.068910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.068888    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"]
Sep 08 10:02:45.160966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.160938    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-metrics-client-ca\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.160970    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.160995    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.161089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-grpc-tls\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.161145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.161176    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sstwv\" (UniqueName: \"kubernetes.io/projected/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-kube-api-access-sstwv\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.161211    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.161418 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.161326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-tls\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.249637 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:45.249609    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f2f2f4_4c91_4ce8_9109_e8d8ab4d15dd.slice/crio-ce847448ee16c272e24e7ba373f549414870846bb1e4013e9bff53160b4a093d WatchSource:0}: Error finding container ce847448ee16c272e24e7ba373f549414870846bb1e4013e9bff53160b4a093d: Status 404 returned error can't find the container with id ce847448ee16c272e24e7ba373f549414870846bb1e4013e9bff53160b4a093d
Sep 08 10:02:45.261702 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261680    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-metrics-client-ca\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.261812 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261711    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.261812 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261729    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.261812 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261759    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-grpc-tls\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.261812 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261801    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.262060 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261828    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sstwv\" (UniqueName: \"kubernetes.io/projected/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-kube-api-access-sstwv\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.262060 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.261950    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.262060 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.262015    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-tls\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.262534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.262468    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-metrics-client-ca\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.264479 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.264449    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-grpc-tls\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.264587 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.264568    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.264650 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.264605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.264804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.264782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.264863 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.264793    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-tls\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.264863 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.264822    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.269153 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.269132    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sstwv\" (UniqueName: \"kubernetes.io/projected/3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b-kube-api-access-sstwv\") pod \"thanos-querier-86bdb4b65d-hd7ln\" (UID: \"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b\") " pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.371845 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.371772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:45.657568 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:45.657285    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"]
Sep 08 10:02:45.769824 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:45.769794    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3cc946_cd3c_4cb1_b29e_07ec9e7bb11b.slice/crio-758e3fbef74be87f6dadb7af7e2b4267e3e7e4be13a4210507c3a8f9c52cad3d WatchSource:0}: Error finding container 758e3fbef74be87f6dadb7af7e2b4267e3e7e4be13a4210507c3a8f9c52cad3d: Status 404 returned error can't find the container with id 758e3fbef74be87f6dadb7af7e2b4267e3e7e4be13a4210507c3a8f9c52cad3d
Sep 08 10:02:46.184888 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.184851    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b69fc5bdf-tc9nz" event={"ID":"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144","Type":"ContainerStarted","Data":"023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810"}
Sep 08 10:02:46.186144 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.186113    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"758e3fbef74be87f6dadb7af7e2b4267e3e7e4be13a4210507c3a8f9c52cad3d"}
Sep 08 10:02:46.187718 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.187686    2582 generic.go:356] "Generic (PLEG): container finished" podID="e5399135-2eb2-493c-9b83-1370f654b6bd" containerID="69c56b94566c0888bbc041d4e2b59f7bf81160c13a64d5dc923010919089b7fa" exitCode=0
Sep 08 10:02:46.187838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.187765    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jf7r" event={"ID":"e5399135-2eb2-493c-9b83-1370f654b6bd","Type":"ContainerDied","Data":"69c56b94566c0888bbc041d4e2b59f7bf81160c13a64d5dc923010919089b7fa"}
Sep 08 10:02:46.189561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.189542    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq" event={"ID":"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd","Type":"ContainerStarted","Data":"e899cec26b89fcf5059bfbc2fad47511dda89ee1022d47ec21e9b6eb56f7fb69"}
Sep 08 10:02:46.189661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.189580    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq" event={"ID":"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd","Type":"ContainerStarted","Data":"8dcb355a5d86927eb43acf8ecbe07d7a942cd3cea8fd6be062d9b8a562789cc3"}
Sep 08 10:02:46.189661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.189602    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq" event={"ID":"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd","Type":"ContainerStarted","Data":"ce847448ee16c272e24e7ba373f549414870846bb1e4013e9bff53160b4a093d"}
Sep 08 10:02:46.224478 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:46.224440    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-b69fc5bdf-tc9nz" podStartSLOduration=2.42618469 podStartE2EDuration="8.22442804s" totalImagesPullingTime="5.79824335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:46.223340793 +0000 UTC m=+76.800211235" watchObservedRunningTime="2026-09-08 10:02:46.22442804 +0000 UTC m=+76.801298481"
Sep 08 10:02:47.198097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.197996    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jf7r" event={"ID":"e5399135-2eb2-493c-9b83-1370f654b6bd","Type":"ContainerStarted","Data":"4188fe43dbbba15128d101aeec1e0c3bcad6e10b4e2aab9d76f9432fe229cc30"}
Sep 08 10:02:47.198583 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.198155    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4jf7r" event={"ID":"e5399135-2eb2-493c-9b83-1370f654b6bd","Type":"ContainerStarted","Data":"d4799bb9f255768edfe0af822d20cd513c2eedadba1b3bd87815dd15340b8ffa"}
Sep 08 10:02:47.222153 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.222105    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4jf7r" podStartSLOduration=2.419911703 podStartE2EDuration="4.222092319s" totalImagesPullingTime="1.742763313s" totalInitContainerRuntime="59.417303ms" isStatefulPod=true podCreationTimestamp="2026-09-08 10:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:47.221544639 +0000 UTC m=+77.798415090" watchObservedRunningTime="2026-09-08 10:02:47.222092319 +0000 UTC m=+77.798962759"
Sep 08 10:02:47.378739 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.378703    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-54759f49b9-kb7kh"]
Sep 08 10:02:47.381355 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.381327    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.384121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.383931    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Sep 08 10:02:47.384121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.383951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-btqqmfl4cgtnn\""
Sep 08 10:02:47.384121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.383985    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Sep 08 10:02:47.384121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.384041    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Sep 08 10:02:47.384121 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.383951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-ktsqf\""
Sep 08 10:02:47.384427 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.384331    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Sep 08 10:02:47.391074 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.391056    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54759f49b9-kb7kh"]
Sep 08 10:02:47.478795 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478713    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70bbb607-dfe6-4c44-9260-0b735dca4a36-metrics-server-audit-profiles\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.478795 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478763    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70bbb607-dfe6-4c44-9260-0b735dca4a36-audit-log\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.479004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478795    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-client-ca-bundle\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.479004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70bbb607-dfe6-4c44-9260-0b735dca4a36-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.479004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-secret-metrics-server-client-certs\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.479004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478963    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-secret-metrics-server-tls\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.479004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.478983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs97n\" (UniqueName: \"kubernetes.io/projected/70bbb607-dfe6-4c44-9260-0b735dca4a36-kube-api-access-bs97n\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580017 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.579985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-secret-metrics-server-client-certs\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580024    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-secret-metrics-server-tls\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580044    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bs97n\" (UniqueName: \"kubernetes.io/projected/70bbb607-dfe6-4c44-9260-0b735dca4a36-kube-api-access-bs97n\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580075    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70bbb607-dfe6-4c44-9260-0b735dca4a36-metrics-server-audit-profiles\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70bbb607-dfe6-4c44-9260-0b735dca4a36-audit-log\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580116    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-client-ca-bundle\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580133    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70bbb607-dfe6-4c44-9260-0b735dca4a36-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580598 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580575    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/70bbb607-dfe6-4c44-9260-0b735dca4a36-audit-log\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.580979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.580957    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/70bbb607-dfe6-4c44-9260-0b735dca4a36-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.581208 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.581187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/70bbb607-dfe6-4c44-9260-0b735dca4a36-metrics-server-audit-profiles\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.582521 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.582496    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-secret-metrics-server-tls\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.582619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.582566    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-secret-metrics-server-client-certs\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.582715 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.582698    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/70bbb607-dfe6-4c44-9260-0b735dca4a36-client-ca-bundle\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.588141 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.588112    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs97n\" (UniqueName: \"kubernetes.io/projected/70bbb607-dfe6-4c44-9260-0b735dca4a36-kube-api-access-bs97n\") pod \"metrics-server-54759f49b9-kb7kh\" (UID: \"70bbb607-dfe6-4c44-9260-0b735dca4a36\") " pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.693790 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.693762    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:02:47.966034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:47.965977    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-54759f49b9-kb7kh"]
Sep 08 10:02:47.968585 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:47.968547    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bbb607_dfe6_4c44_9260_0b735dca4a36.slice/crio-9c25559c55b89224092738b0bebda8b782c72ffb8116319aeec70380f152e0b6 WatchSource:0}: Error finding container 9c25559c55b89224092738b0bebda8b782c72ffb8116319aeec70380f152e0b6: Status 404 returned error can't find the container with id 9c25559c55b89224092738b0bebda8b782c72ffb8116319aeec70380f152e0b6
Sep 08 10:02:48.202533 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.202495    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh" event={"ID":"70bbb607-dfe6-4c44-9260-0b735dca4a36","Type":"ContainerStarted","Data":"9c25559c55b89224092738b0bebda8b782c72ffb8116319aeec70380f152e0b6"}
Sep 08 10:02:48.204640 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.204617    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"f06a346be8e5ef05327edcf5f22f7dd44e34ccf271c1b50c1ef9c56b7ec5009a"}
Sep 08 10:02:48.204749 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.204674    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"2e0d965d1ae9b52884af74a6ddbf3f57ae2afc8e4bb54eb43c0d8d3ab464cea4"}
Sep 08 10:02:48.204749 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.204702    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"dc63f65698b44bc86248625bb81e49f594c27999418a6f4e23137c2925d7bcfd"}
Sep 08 10:02:48.718864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.718840    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:48.719004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.718887    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:48.723620 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:48.723501    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:49.214370 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.213864    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"2b367758b8c169d7cf10c5d16ac4d01466e32a8c74bbc8121014455b56e1a103"}
Sep 08 10:02:49.214370 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.213983    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"3a8c111787a681bf5a787df9f6c7eac3eb81e562b2f53fef86732e7b36475582"}
Sep 08 10:02:49.214370 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.214032    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" event={"ID":"3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b","Type":"ContainerStarted","Data":"0da0ff03dacdd1b6617e7dffdc15e35275bf619338bb25cf0eaf8bae5fa83a58"}
Sep 08 10:02:49.215714 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.214833    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:49.218252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.217317    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b69fc5bdf-tc9nz"]
Sep 08 10:02:49.221054 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.220525    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:02:49.253056 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.252974    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln" podStartSLOduration=1.224028314 podStartE2EDuration="4.252956224s" totalImagesPullingTime="3.02892791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:49.251630001 +0000 UTC m=+79.828500441" watchObservedRunningTime="2026-09-08 10:02:49.252956224 +0000 UTC m=+79.829826668"
Sep 08 10:02:49.254937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.254918    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57df6dcb7f-7bm8f"]
Sep 08 10:02:49.257465 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.257450    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.267475 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.267437    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57df6dcb7f-7bm8f"]
Sep 08 10:02:49.326464 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.326439    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:49.393633 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393603    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-service-ca\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.393633 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393634    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-trusted-ca-bundle\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.393829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-config\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.393829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393712    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhbw5\" (UniqueName: \"kubernetes.io/projected/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-kube-api-access-zhbw5\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.393903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393828    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-oauth-config\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.393903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-oauth-serving-cert\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.393966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.393908    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-serving-cert\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.494816 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494794    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-service-ca\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.494899 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494822    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-trusted-ca-bundle\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.494899 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-config\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.494899 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhbw5\" (UniqueName: \"kubernetes.io/projected/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-kube-api-access-zhbw5\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494903    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-oauth-config\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494939    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-oauth-serving-cert\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.494986    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-serving-cert\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495542 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.495521    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-service-ca\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495694 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.495667    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-config\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495793 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.495767    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-oauth-serving-cert\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.495864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.495774    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-trusted-ca-bundle\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.497289 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.497269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-serving-cert\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.497378 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.497341    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-oauth-config\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.502302 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.502283    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhbw5\" (UniqueName: \"kubernetes.io/projected/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-kube-api-access-zhbw5\") pod \"console-57df6dcb7f-7bm8f\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") " pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.568267 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.568219    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:02:49.837128 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:49.837055    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57df6dcb7f-7bm8f"]
Sep 08 10:02:49.839059 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:49.839025    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f9eea4e_4f56_4a7c_bf64_aa8e9f484aba.slice/crio-21bc963c411b41322ad0df44177210b360289fcb23cac37e07acb3ce060ef13c WatchSource:0}: Error finding container 21bc963c411b41322ad0df44177210b360289fcb23cac37e07acb3ce060ef13c: Status 404 returned error can't find the container with id 21bc963c411b41322ad0df44177210b360289fcb23cac37e07acb3ce060ef13c
Sep 08 10:02:50.219639 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:50.219599    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq" event={"ID":"c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd","Type":"ContainerStarted","Data":"2b007bae88a01727013d4deec9e44f09899f8626b60b4225d3b17a7bf3dc8506"}
Sep 08 10:02:50.221200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:50.221176    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df6dcb7f-7bm8f" event={"ID":"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba","Type":"ContainerStarted","Data":"a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07"}
Sep 08 10:02:50.221312 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:50.221221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df6dcb7f-7bm8f" event={"ID":"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba","Type":"ContainerStarted","Data":"21bc963c411b41322ad0df44177210b360289fcb23cac37e07acb3ce060ef13c"}
Sep 08 10:02:50.252045 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:50.251994    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-29bdq" podStartSLOduration=3.176943133 podStartE2EDuration="7.251979782s" totalImagesPullingTime="4.075036649s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:50.236195868 +0000 UTC m=+80.813066311" watchObservedRunningTime="2026-09-08 10:02:50.251979782 +0000 UTC m=+80.828850223"
Sep 08 10:02:50.270785 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:50.268822    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57df6dcb7f-7bm8f" podStartSLOduration=1.268804784 podStartE2EDuration="1.268804784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:50.266524433 +0000 UTC m=+80.843394911" watchObservedRunningTime="2026-09-08 10:02:50.268804784 +0000 UTC m=+80.845675226"
Sep 08 10:02:52.200048 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.200018    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57df6dcb7f-7bm8f"]
Sep 08 10:02:52.228067 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.228046    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77c6f56875-rsfb6"]
Sep 08 10:02:52.230283 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.230261    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.231043 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.231019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh" event={"ID":"70bbb607-dfe6-4c44-9260-0b735dca4a36","Type":"ContainerStarted","Data":"871522d5ae03465d40fc3aeafeb8f7b4080487a01e42eaab9068042034264e5c"}
Sep 08 10:02:52.243843 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.243820    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c6f56875-rsfb6"]
Sep 08 10:02:52.272097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.272054    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh" podStartSLOduration=1.810632212 podStartE2EDuration="5.272039668s" totalImagesPullingTime="3.461407456s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:52.270994267 +0000 UTC m=+82.847864707" watchObservedRunningTime="2026-09-08 10:02:52.272039668 +0000 UTC m=+82.848910109"
Sep 08 10:02:52.315174 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-service-ca\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.315364 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-oauth-config\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.315433 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-console-config\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.315491 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315434    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-oauth-serving-cert\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.315491 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-serving-cert\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.315599 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-trusted-ca-bundle\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.315599 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.315574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk5fg\" (UniqueName: \"kubernetes.io/projected/b97837f0-d1be-4c4f-b865-8a82331644b6-kube-api-access-gk5fg\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416043 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416022    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-oauth-config\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416047    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-console-config\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416067    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-oauth-serving-cert\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416084    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-serving-cert\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416142    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-trusted-ca-bundle\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416181    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gk5fg\" (UniqueName: \"kubernetes.io/projected/b97837f0-d1be-4c4f-b865-8a82331644b6-kube-api-access-gk5fg\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416214    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-service-ca\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416865 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416838    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-console-config\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416965 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416868    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-oauth-serving-cert\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416965 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-service-ca\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.416965 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.416962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-trusted-ca-bundle\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.418440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.418415    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-oauth-config\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.418556 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.418541    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-serving-cert\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.423551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.423533    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk5fg\" (UniqueName: \"kubernetes.io/projected/b97837f0-d1be-4c4f-b865-8a82331644b6-kube-api-access-gk5fg\") pod \"console-77c6f56875-rsfb6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") " pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.538651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.538539    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:02:52.804953 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:52.804881    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77c6f56875-rsfb6"]
Sep 08 10:02:52.810674 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:02:52.810635    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb97837f0_d1be_4c4f_b865_8a82331644b6.slice/crio-bb2c02b0f42b4ca089391945e4714a68841d534d918408af62553fc139d4733d WatchSource:0}: Error finding container bb2c02b0f42b4ca089391945e4714a68841d534d918408af62553fc139d4733d: Status 404 returned error can't find the container with id bb2c02b0f42b4ca089391945e4714a68841d534d918408af62553fc139d4733d
Sep 08 10:02:53.236803 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:53.236770    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c6f56875-rsfb6" event={"ID":"b97837f0-d1be-4c4f-b865-8a82331644b6","Type":"ContainerStarted","Data":"2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12"}
Sep 08 10:02:53.237148 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:53.236819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c6f56875-rsfb6" event={"ID":"b97837f0-d1be-4c4f-b865-8a82331644b6","Type":"ContainerStarted","Data":"bb2c02b0f42b4ca089391945e4714a68841d534d918408af62553fc139d4733d"}
Sep 08 10:02:53.254603 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:53.254558    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77c6f56875-rsfb6" podStartSLOduration=1.25454366 podStartE2EDuration="1.25454366s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:02:53.253575782 +0000 UTC m=+83.830446223" watchObservedRunningTime="2026-09-08 10:02:53.25454366 +0000 UTC m=+83.831414101"
Sep 08 10:02:54.340241 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.340160    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" podUID="4431ec4a-1ac5-418a-8781-997c519714ed" containerName="registry" containerID="cri-o://0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57" gracePeriod=30
Sep 08 10:02:54.577111 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.577086    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:54.734024 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.733996    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4rjl\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-kube-api-access-w4rjl\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734154 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734041    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-image-registry-private-configuration\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734154 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734063    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-registry-certificates\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734286 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734187    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-trusted-ca\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734342 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734286    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734399 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734336    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4431ec4a-1ac5-418a-8781-997c519714ed-ca-trust-extracted\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734399 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734372    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-installation-pull-secrets\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734491 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734398    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-bound-sa-token\") pod \"4431ec4a-1ac5-418a-8781-997c519714ed\" (UID: \"4431ec4a-1ac5-418a-8781-997c519714ed\") "
Sep 08 10:02:54.734538 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734504    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:02:54.734597 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734579    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:02:54.734705 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734683    2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-registry-certificates\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.734705 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.734707    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/4431ec4a-1ac5-418a-8781-997c519714ed-trusted-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.736622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.736594    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:02:54.736723 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.736667    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-kube-api-access-w4rjl" (OuterVolumeSpecName: "kube-api-access-w4rjl") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "kube-api-access-w4rjl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:02:54.736792 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.736749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:02:54.736834 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.736791    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:02:54.736989 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.736968    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:02:54.743239 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.743208    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4431ec4a-1ac5-418a-8781-997c519714ed-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "4431ec4a-1ac5-418a-8781-997c519714ed" (UID: "4431ec4a-1ac5-418a-8781-997c519714ed"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:02:54.835000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.834979    2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-registry-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.835000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.834999    2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/4431ec4a-1ac5-418a-8781-997c519714ed-ca-trust-extracted\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.835105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.835007    2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-installation-pull-secrets\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.835105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.835016    2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-bound-sa-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.835105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.835025    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4rjl\" (UniqueName: \"kubernetes.io/projected/4431ec4a-1ac5-418a-8781-997c519714ed-kube-api-access-w4rjl\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:54.835105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:54.835034    2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/4431ec4a-1ac5-418a-8781-997c519714ed-image-registry-private-configuration\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:02:55.227287 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.227263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-86bdb4b65d-hd7ln"
Sep 08 10:02:55.245946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.245918    2582 generic.go:356] "Generic (PLEG): container finished" podID="4431ec4a-1ac5-418a-8781-997c519714ed" containerID="0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57" exitCode=0
Sep 08 10:02:55.246041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.245954    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl"
Sep 08 10:02:55.246041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.246004    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" event={"ID":"4431ec4a-1ac5-418a-8781-997c519714ed","Type":"ContainerDied","Data":"0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57"}
Sep 08 10:02:55.246168 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.246042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7764b48b4f-46cnl" event={"ID":"4431ec4a-1ac5-418a-8781-997c519714ed","Type":"ContainerDied","Data":"09d1d2f3aa3db3f896ad4f3d62ba90bd76017b3424c74f27acdd0e584cb5dc40"}
Sep 08 10:02:55.246168 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.246063    2582 scope.go:117] "RemoveContainer" containerID="0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57"
Sep 08 10:02:55.255698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.255675    2582 scope.go:117] "RemoveContainer" containerID="0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57"
Sep 08 10:02:55.256009 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:02:55.255985    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57\": container with ID starting with 0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57 not found: ID does not exist" containerID="0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57"
Sep 08 10:02:55.256097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.256017    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57"} err="failed to get container status \"0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57\": rpc error: code = NotFound desc = could not find container \"0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57\": container with ID starting with 0561cc770461987dd535c366fdff0a43d39f576898b9cd76bebcd4ce1b032d57 not found: ID does not exist"
Sep 08 10:02:55.267468 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.267443    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7764b48b4f-46cnl"]
Sep 08 10:02:55.274447 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.274426    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7764b48b4f-46cnl"]
Sep 08 10:02:55.910930 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:55.910885    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4431ec4a-1ac5-418a-8781-997c519714ed" path="/var/lib/kubelet/pods/4431ec4a-1ac5-418a-8781-997c519714ed/volumes"
Sep 08 10:02:59.569350 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:02:59.569317    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:03:02.539171 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:02.539130    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:03:02.539595 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:02.539188    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:03:02.544522 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:02.544487    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:03:03.280343 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:03.280312    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:03:07.694516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:07.694445    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:03:07.695004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:07.694528    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:03:11.161576 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:11.161547    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9khj9"
Sep 08 10:03:15.239910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.239851    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-b69fc5bdf-tc9nz" podUID="fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" containerName="console" containerID="cri-o://023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810" gracePeriod=15
Sep 08 10:03:15.483436 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.483414    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:03:15.573028 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.572972    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vvqxk\" (UniqueName: \"kubernetes.io/projected/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-kube-api-access-vvqxk\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573028 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573000    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-serving-cert\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573028 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573016    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-oauth-config\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573054    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-trusted-ca-bundle\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573135    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-service-ca\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573181    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-oauth-serving-cert\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573214    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-config\") pod \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\" (UID: \"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144\") "
Sep 08 10:03:15.573487 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573466    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:15.573583 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573553    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-service-ca" (OuterVolumeSpecName: "service-ca") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:15.573647 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573577    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:15.573813 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.573792    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-config" (OuterVolumeSpecName: "console-config") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:15.575295 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.575267    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:03:15.575385 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.575300    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-kube-api-access-vvqxk" (OuterVolumeSpecName: "kube-api-access-vvqxk") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "kube-api-access-vvqxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:03:15.575385 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.575322    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" (UID: "fdbcf7e1-f4c0-4650-8ff3-de6dd604e144"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:03:15.674768 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674747    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-trusted-ca-bundle\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:15.674768 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674765    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:15.674881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674775    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-oauth-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:15.674881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674783    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:15.674881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674791    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vvqxk\" (UniqueName: \"kubernetes.io/projected/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-kube-api-access-vvqxk\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:15.674881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674800    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:15.674881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:15.674809    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144-console-oauth-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:16.324447 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.324393    2582 generic.go:356] "Generic (PLEG): container finished" podID="fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" containerID="023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810" exitCode=0
Sep 08 10:03:16.324447 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.324433    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-b69fc5bdf-tc9nz"
Sep 08 10:03:16.324761 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.324475    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b69fc5bdf-tc9nz" event={"ID":"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144","Type":"ContainerDied","Data":"023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810"}
Sep 08 10:03:16.324761 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.324519    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-b69fc5bdf-tc9nz" event={"ID":"fdbcf7e1-f4c0-4650-8ff3-de6dd604e144","Type":"ContainerDied","Data":"8e5190fa8d91d00c3c86f39c1b69d7794ce062f44df18b80d7bb119fd5eb5993"}
Sep 08 10:03:16.324761 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.324542    2582 scope.go:117] "RemoveContainer" containerID="023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810"
Sep 08 10:03:16.332148 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.332131    2582 scope.go:117] "RemoveContainer" containerID="023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810"
Sep 08 10:03:16.332424 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:03:16.332408    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810\": container with ID starting with 023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810 not found: ID does not exist" containerID="023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810"
Sep 08 10:03:16.332485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.332433    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810"} err="failed to get container status \"023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810\": rpc error: code = NotFound desc = could not find container \"023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810\": container with ID starting with 023cb2de4c04b6b66ffc51539810716e2750d90636508e813e1edd9254709810 not found: ID does not exist"
Sep 08 10:03:16.343303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.343281    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-b69fc5bdf-tc9nz"]
Sep 08 10:03:16.346678 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:16.346659    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-b69fc5bdf-tc9nz"]
Sep 08 10:03:17.251020 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.250979    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57df6dcb7f-7bm8f" podUID="5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" containerName="console" containerID="cri-o://a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07" gracePeriod=15
Sep 08 10:03:17.483737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.483714    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:03:17.587497 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587433    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zhbw5\" (UniqueName: \"kubernetes.io/projected/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-kube-api-access-zhbw5\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.587497 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587473    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-oauth-config\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.587497 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587490    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-serving-cert\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.587689 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587625    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-service-ca\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.587737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-config\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.587796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587743    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-trusted-ca-bundle\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.587849 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.587805    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-oauth-serving-cert\") pod \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\" (UID: \"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba\") "
Sep 08 10:03:17.588080 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.588052    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-service-ca" (OuterVolumeSpecName: "service-ca") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:17.588080 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.588060    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-config" (OuterVolumeSpecName: "console-config") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:17.588207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.588126    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:17.588207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.588169    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:03:17.589615 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.589591    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-kube-api-access-zhbw5" (OuterVolumeSpecName: "kube-api-access-zhbw5") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "kube-api-access-zhbw5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:03:17.589714 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.589626    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:03:17.589714 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.589661    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" (UID: "5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:03:17.689200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689175    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.689200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689198    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.689200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689207    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-trusted-ca-bundle\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.689404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689217    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-oauth-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.689404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689244    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zhbw5\" (UniqueName: \"kubernetes.io/projected/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-kube-api-access-zhbw5\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.689404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689255    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-oauth-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.689404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.689263    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba-console-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:03:17.908781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:17.908691    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" path="/var/lib/kubelet/pods/fdbcf7e1-f4c0-4650-8ff3-de6dd604e144/volumes"
Sep 08 10:03:18.333819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.333786    2582 generic.go:356] "Generic (PLEG): container finished" podID="5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" containerID="a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07" exitCode=0
Sep 08 10:03:18.333980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.333830    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57df6dcb7f-7bm8f"
Sep 08 10:03:18.333980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.333859    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df6dcb7f-7bm8f" event={"ID":"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba","Type":"ContainerDied","Data":"a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07"}
Sep 08 10:03:18.333980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.333904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57df6dcb7f-7bm8f" event={"ID":"5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba","Type":"ContainerDied","Data":"21bc963c411b41322ad0df44177210b360289fcb23cac37e07acb3ce060ef13c"}
Sep 08 10:03:18.333980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.333931    2582 scope.go:117] "RemoveContainer" containerID="a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07"
Sep 08 10:03:18.343136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.343114    2582 scope.go:117] "RemoveContainer" containerID="a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07"
Sep 08 10:03:18.343433 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:03:18.343415    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07\": container with ID starting with a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07 not found: ID does not exist" containerID="a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07"
Sep 08 10:03:18.343502 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.343442    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07"} err="failed to get container status \"a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07\": rpc error: code = NotFound desc = could not find container \"a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07\": container with ID starting with a79120825fc4c6b15540278d0fe67c7b263fb3a5917d30235a61c77de0bdad07 not found: ID does not exist"
Sep 08 10:03:18.351529 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.351508    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57df6dcb7f-7bm8f"]
Sep 08 10:03:18.354966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:18.354944    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57df6dcb7f-7bm8f"]
Sep 08 10:03:19.908563 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:19.908531    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" path="/var/lib/kubelet/pods/5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba/volumes"
Sep 08 10:03:27.699062 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:27.699035    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:03:27.702909 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:03:27.702889    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-54759f49b9-kb7kh"
Sep 08 10:04:03.005294 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005261    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78fdd88879-x5ndn"]
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005500    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4431ec4a-1ac5-418a-8781-997c519714ed" containerName="registry"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005511    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4431ec4a-1ac5-418a-8781-997c519714ed" containerName="registry"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005521    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" containerName="console"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005527    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" containerName="console"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005534    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" containerName="console"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005540    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" containerName="console"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005583    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f9eea4e-4f56-4a7c-bf64-aa8e9f484aba" containerName="console"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005592    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fdbcf7e1-f4c0-4650-8ff3-de6dd604e144" containerName="console"
Sep 08 10:04:03.005731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.005598    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4431ec4a-1ac5-418a-8781-997c519714ed" containerName="registry"
Sep 08 10:04:03.007311 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.007296    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.025833 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.025809    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fdd88879-x5ndn"]
Sep 08 10:04:03.088949 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.088924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-oauth-serving-cert\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.089059 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.088953    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-trusted-ca-bundle\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.089059 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.088971    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-config\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.089059 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.089019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swnfl\" (UniqueName: \"kubernetes.io/projected/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-kube-api-access-swnfl\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.089059 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.089050    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-serving-cert\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.089271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.089108    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-oauth-config\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.089271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.089127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-service-ca\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.189800 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189776    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swnfl\" (UniqueName: \"kubernetes.io/projected/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-kube-api-access-swnfl\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.189910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189804    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-serving-cert\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.189910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189830    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-oauth-config\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.189910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189853    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-service-ca\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.189910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-oauth-serving-cert\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.190134 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189919    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-trusted-ca-bundle\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.190134 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.189948    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-config\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.190632 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.190609    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-service-ca\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.190719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.190617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-config\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.190779 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.190749    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-oauth-serving-cert\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.190935 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.190911    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-trusted-ca-bundle\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.192389 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.192362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-serving-cert\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.192389 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.192379    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-oauth-config\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.198355 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.198337    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swnfl\" (UniqueName: \"kubernetes.io/projected/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-kube-api-access-swnfl\") pod \"console-78fdd88879-x5ndn\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") " pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.316338 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.316286    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:03.583732 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:03.583677    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78fdd88879-x5ndn"]
Sep 08 10:04:03.586320 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:04:03.586295    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3792bf9_5d78_4eb8_bd8a_5eaa2a730cef.slice/crio-c311595364584ed0a7d3372bb210218877fd6acd4fdbbd5b444bc0ec3a8159bb WatchSource:0}: Error finding container c311595364584ed0a7d3372bb210218877fd6acd4fdbbd5b444bc0ec3a8159bb: Status 404 returned error can't find the container with id c311595364584ed0a7d3372bb210218877fd6acd4fdbbd5b444bc0ec3a8159bb
Sep 08 10:04:04.497600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:04.497569    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fdd88879-x5ndn" event={"ID":"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef","Type":"ContainerStarted","Data":"d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c"}
Sep 08 10:04:04.497941 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:04.497613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fdd88879-x5ndn" event={"ID":"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef","Type":"ContainerStarted","Data":"c311595364584ed0a7d3372bb210218877fd6acd4fdbbd5b444bc0ec3a8159bb"}
Sep 08 10:04:04.525860 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:04.525812    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78fdd88879-x5ndn" podStartSLOduration=2.525795865 podStartE2EDuration="2.525795865s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:04:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:04:04.525041872 +0000 UTC m=+155.101912317" watchObservedRunningTime="2026-09-08 10:04:04.525795865 +0000 UTC m=+155.102666306"
Sep 08 10:04:13.316568 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:13.316533    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:13.316995 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:13.316580    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:13.321158 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:13.321136    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:13.536212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:13.536184    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:04:13.581661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:13.581596    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c6f56875-rsfb6"]
Sep 08 10:04:38.602220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.602097    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-77c6f56875-rsfb6" podUID="b97837f0-d1be-4c4f-b865-8a82331644b6" containerName="console" containerID="cri-o://2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12" gracePeriod=15
Sep 08 10:04:38.834404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.834381    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:04:38.939689 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939665    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-trusted-ca-bundle\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.939841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939715    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gk5fg\" (UniqueName: \"kubernetes.io/projected/b97837f0-d1be-4c4f-b865-8a82331644b6-kube-api-access-gk5fg\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.939841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939758    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-console-config\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.939841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939779    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-oauth-serving-cert\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.939841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-oauth-config\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.939841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939820    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-serving-cert\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.940094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939886    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-service-ca\") pod \"b97837f0-d1be-4c4f-b865-8a82331644b6\" (UID: \"b97837f0-d1be-4c4f-b865-8a82331644b6\") "
Sep 08 10:04:38.940094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.939967    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:04:38.940094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.940077    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-trusted-ca-bundle\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:38.940278 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.940189    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-console-config" (OuterVolumeSpecName: "console-config") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:04:38.940278 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.940186    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:04:38.940416 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.940395    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-service-ca" (OuterVolumeSpecName: "service-ca") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:04:38.941950 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.941914    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:04:38.942053 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.941948    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:04:38.942053 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:38.941954    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b97837f0-d1be-4c4f-b865-8a82331644b6-kube-api-access-gk5fg" (OuterVolumeSpecName: "kube-api-access-gk5fg") pod "b97837f0-d1be-4c4f-b865-8a82331644b6" (UID: "b97837f0-d1be-4c4f-b865-8a82331644b6"). InnerVolumeSpecName "kube-api-access-gk5fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:04:39.041022 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.040996    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gk5fg\" (UniqueName: \"kubernetes.io/projected/b97837f0-d1be-4c4f-b865-8a82331644b6-kube-api-access-gk5fg\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:39.041022 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.041018    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-console-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:39.041145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.041028    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-oauth-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:39.041145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.041036    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-oauth-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:39.041145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.041044    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b97837f0-d1be-4c4f-b865-8a82331644b6-console-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:39.041145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.041052    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b97837f0-d1be-4c4f-b865-8a82331644b6-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:04:39.622177 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.622143    2582 generic.go:356] "Generic (PLEG): container finished" podID="b97837f0-d1be-4c4f-b865-8a82331644b6" containerID="2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12" exitCode=0
Sep 08 10:04:39.622586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.622187    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77c6f56875-rsfb6"
Sep 08 10:04:39.622586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.622218    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c6f56875-rsfb6" event={"ID":"b97837f0-d1be-4c4f-b865-8a82331644b6","Type":"ContainerDied","Data":"2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12"}
Sep 08 10:04:39.622586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.622284    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77c6f56875-rsfb6" event={"ID":"b97837f0-d1be-4c4f-b865-8a82331644b6","Type":"ContainerDied","Data":"bb2c02b0f42b4ca089391945e4714a68841d534d918408af62553fc139d4733d"}
Sep 08 10:04:39.622586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.622305    2582 scope.go:117] "RemoveContainer" containerID="2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12"
Sep 08 10:04:39.631171 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.631153    2582 scope.go:117] "RemoveContainer" containerID="2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12"
Sep 08 10:04:39.631507 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:04:39.631482    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12\": container with ID starting with 2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12 not found: ID does not exist" containerID="2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12"
Sep 08 10:04:39.631611 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.631517    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12"} err="failed to get container status \"2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12\": rpc error: code = NotFound desc = could not find container \"2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12\": container with ID starting with 2e2097a111d1263b6f5be5de5b4570b038b316e82aa2c93a82e359ed7f388c12 not found: ID does not exist"
Sep 08 10:04:39.649773 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.649744    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-77c6f56875-rsfb6"]
Sep 08 10:04:39.650903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.650880    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-77c6f56875-rsfb6"]
Sep 08 10:04:39.908318 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:04:39.908222    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b97837f0-d1be-4c4f-b865-8a82331644b6" path="/var/lib/kubelet/pods/b97837f0-d1be-4c4f-b865-8a82331644b6/volumes"
Sep 08 10:06:02.327645 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.327573    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"]
Sep 08 10:06:02.328063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.327818    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b97837f0-d1be-4c4f-b865-8a82331644b6" containerName="console"
Sep 08 10:06:02.328063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.327829    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b97837f0-d1be-4c4f-b865-8a82331644b6" containerName="console"
Sep 08 10:06:02.328063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.327873    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b97837f0-d1be-4c4f-b865-8a82331644b6" containerName="console"
Sep 08 10:06:02.329748 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.329733    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.332079 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.332055    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:06:02.332201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.332055    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jkj79\""
Sep 08 10:06:02.332201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.332118    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 10:06:02.342565 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.342546    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"]
Sep 08 10:06:02.507007 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.506981    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b02fdebc-e5d4-44e9-b3bc-aa91117976ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vdvjg\" (UID: \"b02fdebc-e5d4-44e9-b3bc-aa91117976ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.507106 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.507038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl2t6\" (UniqueName: \"kubernetes.io/projected/b02fdebc-e5d4-44e9-b3bc-aa91117976ff-kube-api-access-rl2t6\") pod \"cert-manager-operator-controller-manager-55c444bf86-vdvjg\" (UID: \"b02fdebc-e5d4-44e9-b3bc-aa91117976ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.608063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.608010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rl2t6\" (UniqueName: \"kubernetes.io/projected/b02fdebc-e5d4-44e9-b3bc-aa91117976ff-kube-api-access-rl2t6\") pod \"cert-manager-operator-controller-manager-55c444bf86-vdvjg\" (UID: \"b02fdebc-e5d4-44e9-b3bc-aa91117976ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.608063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.608045    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b02fdebc-e5d4-44e9-b3bc-aa91117976ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vdvjg\" (UID: \"b02fdebc-e5d4-44e9-b3bc-aa91117976ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.608369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.608353    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b02fdebc-e5d4-44e9-b3bc-aa91117976ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-vdvjg\" (UID: \"b02fdebc-e5d4-44e9-b3bc-aa91117976ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.624308 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.624292    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl2t6\" (UniqueName: \"kubernetes.io/projected/b02fdebc-e5d4-44e9-b3bc-aa91117976ff-kube-api-access-rl2t6\") pod \"cert-manager-operator-controller-manager-55c444bf86-vdvjg\" (UID: \"b02fdebc-e5d4-44e9-b3bc-aa91117976ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.638067 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.638049    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"
Sep 08 10:06:02.919265 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:02.919214    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg"]
Sep 08 10:06:02.922180 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:06:02.922154    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02fdebc_e5d4_44e9_b3bc_aa91117976ff.slice/crio-b44ac57d46ec45dd3a8485c75d1e67123d80f628dda483d7c623134382b07836 WatchSource:0}: Error finding container b44ac57d46ec45dd3a8485c75d1e67123d80f628dda483d7c623134382b07836: Status 404 returned error can't find the container with id b44ac57d46ec45dd3a8485c75d1e67123d80f628dda483d7c623134382b07836
Sep 08 10:06:03.910267 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:03.910212    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg" event={"ID":"b02fdebc-e5d4-44e9-b3bc-aa91117976ff","Type":"ContainerStarted","Data":"b44ac57d46ec45dd3a8485c75d1e67123d80f628dda483d7c623134382b07836"}
Sep 08 10:06:05.919827 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:05.919795    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg" event={"ID":"b02fdebc-e5d4-44e9-b3bc-aa91117976ff","Type":"ContainerStarted","Data":"2c938945b5dcce221d0c40a99a817a449063faf831e41bae3d2b20bcfb80966f"}
Sep 08 10:06:05.940681 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:05.940636    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-vdvjg" podStartSLOduration=1.3159238850000001 podStartE2EDuration="3.940622373s" totalImagesPullingTime="2.624698488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:06:05.939438358 +0000 UTC m=+276.516308808" watchObservedRunningTime="2026-09-08 10:06:05.940622373 +0000 UTC m=+276.517492813"
Sep 08 10:06:09.346192 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.346164    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"]
Sep 08 10:06:09.348148 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.348133    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.350730 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.350709    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 10:06:09.350998 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.350982    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-69dvh\""
Sep 08 10:06:09.351106 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.351087    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eb44e3d-f858-4c3b-987a-aa46193ea8a1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vg29x\" (UID: \"9eb44e3d-f858-4c3b-987a-aa46193ea8a1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.351162 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.351120    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlm98\" (UniqueName: \"kubernetes.io/projected/9eb44e3d-f858-4c3b-987a-aa46193ea8a1-kube-api-access-tlm98\") pod \"cert-manager-cainjector-559cdd8c87-vg29x\" (UID: \"9eb44e3d-f858-4c3b-987a-aa46193ea8a1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.351797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.351780    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 10:06:09.357622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.357599    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"]
Sep 08 10:06:09.451909 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.451884    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eb44e3d-f858-4c3b-987a-aa46193ea8a1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vg29x\" (UID: \"9eb44e3d-f858-4c3b-987a-aa46193ea8a1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.452007 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.451916    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlm98\" (UniqueName: \"kubernetes.io/projected/9eb44e3d-f858-4c3b-987a-aa46193ea8a1-kube-api-access-tlm98\") pod \"cert-manager-cainjector-559cdd8c87-vg29x\" (UID: \"9eb44e3d-f858-4c3b-987a-aa46193ea8a1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.460392 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.460371    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9eb44e3d-f858-4c3b-987a-aa46193ea8a1-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-vg29x\" (UID: \"9eb44e3d-f858-4c3b-987a-aa46193ea8a1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.460466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.460435    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlm98\" (UniqueName: \"kubernetes.io/projected/9eb44e3d-f858-4c3b-987a-aa46193ea8a1-kube-api-access-tlm98\") pod \"cert-manager-cainjector-559cdd8c87-vg29x\" (UID: \"9eb44e3d-f858-4c3b-987a-aa46193ea8a1\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.657122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.657072    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"
Sep 08 10:06:09.925793 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.925764    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-vg29x"]
Sep 08 10:06:09.928521 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:06:09.928494    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9eb44e3d_f858_4c3b_987a_aa46193ea8a1.slice/crio-fb0a1f8ac501ae9b04f4509b5374c075f6ce110c59d67c3bf3528e5309a0ed80 WatchSource:0}: Error finding container fb0a1f8ac501ae9b04f4509b5374c075f6ce110c59d67c3bf3528e5309a0ed80: Status 404 returned error can't find the container with id fb0a1f8ac501ae9b04f4509b5374c075f6ce110c59d67c3bf3528e5309a0ed80
Sep 08 10:06:09.934072 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:09.934042    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x" event={"ID":"9eb44e3d-f858-4c3b-987a-aa46193ea8a1","Type":"ContainerStarted","Data":"fb0a1f8ac501ae9b04f4509b5374c075f6ce110c59d67c3bf3528e5309a0ed80"}
Sep 08 10:06:12.948510 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:12.948472    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x" event={"ID":"9eb44e3d-f858-4c3b-987a-aa46193ea8a1","Type":"ContainerStarted","Data":"021dddc1b57a079ab7a1017fef97d2f4c5bb785d9c530213d156d0868c553a56"}
Sep 08 10:06:12.968725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:12.968668    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-vg29x" podStartSLOduration=1.4427025709999999 podStartE2EDuration="3.968650878s" totalImagesPullingTime="2.525948307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:06:12.96837579 +0000 UTC m=+283.545246231" watchObservedRunningTime="2026-09-08 10:06:12.968650878 +0000 UTC m=+283.545521322"
Sep 08 10:06:23.420326 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.420291    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"]
Sep 08 10:06:23.428212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.428178    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.431017 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.430993    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2hlh4\""
Sep 08 10:06:23.431140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.431024    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 10:06:23.431140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.431065    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"]
Sep 08 10:06:23.431140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.431085    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 10:06:23.435271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.435250    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqnnp\" (UniqueName: \"kubernetes.io/projected/02d6a740-d49c-4ee5-99c5-ea9517dc7e14-kube-api-access-bqnnp\") pod \"openshift-lws-operator-fd8ccff4c-bd2ck\" (UID: \"02d6a740-d49c-4ee5-99c5-ea9517dc7e14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.435395 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.435305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02d6a740-d49c-4ee5-99c5-ea9517dc7e14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bd2ck\" (UID: \"02d6a740-d49c-4ee5-99c5-ea9517dc7e14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.535822 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.535802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqnnp\" (UniqueName: \"kubernetes.io/projected/02d6a740-d49c-4ee5-99c5-ea9517dc7e14-kube-api-access-bqnnp\") pod \"openshift-lws-operator-fd8ccff4c-bd2ck\" (UID: \"02d6a740-d49c-4ee5-99c5-ea9517dc7e14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.535952 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.535842    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02d6a740-d49c-4ee5-99c5-ea9517dc7e14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bd2ck\" (UID: \"02d6a740-d49c-4ee5-99c5-ea9517dc7e14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.536145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.536129    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/02d6a740-d49c-4ee5-99c5-ea9517dc7e14-tmp\") pod \"openshift-lws-operator-fd8ccff4c-bd2ck\" (UID: \"02d6a740-d49c-4ee5-99c5-ea9517dc7e14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.543935 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.543913    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqnnp\" (UniqueName: \"kubernetes.io/projected/02d6a740-d49c-4ee5-99c5-ea9517dc7e14-kube-api-access-bqnnp\") pod \"openshift-lws-operator-fd8ccff4c-bd2ck\" (UID: \"02d6a740-d49c-4ee5-99c5-ea9517dc7e14\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:23.738863 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:23.738812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"
Sep 08 10:06:24.008662 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:24.008601    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck"]
Sep 08 10:06:24.011660 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:06:24.011634    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod02d6a740_d49c_4ee5_99c5_ea9517dc7e14.slice/crio-211f809c4031bbb7197d984fa06076851c2f4426dabe95637fe2025affed7ea7 WatchSource:0}: Error finding container 211f809c4031bbb7197d984fa06076851c2f4426dabe95637fe2025affed7ea7: Status 404 returned error can't find the container with id 211f809c4031bbb7197d984fa06076851c2f4426dabe95637fe2025affed7ea7
Sep 08 10:06:24.991812 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:24.991760    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck" event={"ID":"02d6a740-d49c-4ee5-99c5-ea9517dc7e14","Type":"ContainerStarted","Data":"211f809c4031bbb7197d984fa06076851c2f4426dabe95637fe2025affed7ea7"}
Sep 08 10:06:27.001030 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:27.000997    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck" event={"ID":"02d6a740-d49c-4ee5-99c5-ea9517dc7e14","Type":"ContainerStarted","Data":"e4ef4f76e5a6fa2a9dacb2a50a2fd1a970090b1bb0016999ee493fb9ee3022e5"}
Sep 08 10:06:27.021596 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:27.021548    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-bd2ck" podStartSLOduration=1.614106961 podStartE2EDuration="4.021520678s" totalImagesPullingTime="2.407413717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:06:27.020513421 +0000 UTC m=+297.597383857" watchObservedRunningTime="2026-09-08 10:06:27.021520678 +0000 UTC m=+297.598391119"
Sep 08 10:06:29.800080 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:29.800055    2582 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 10:06:43.594649 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.594617    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"]
Sep 08 10:06:43.596867 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.596852    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.599384 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.599361    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 10:06:43.599495 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.599408    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nb2g9\""
Sep 08 10:06:43.599495 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.599413    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 10:06:43.599624 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.599528    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 10:06:43.599624 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.599574    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 10:06:43.611648 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.611628    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"]
Sep 08 10:06:43.663489 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.663464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f950f3e5-307a-49ee-8eea-7462bd4f8927-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.663630 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.663521    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmt5g\" (UniqueName: \"kubernetes.io/projected/f950f3e5-307a-49ee-8eea-7462bd4f8927-kube-api-access-pmt5g\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.663630 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.663563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f950f3e5-307a-49ee-8eea-7462bd4f8927-manifests\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.663630 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.663593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f950f3e5-307a-49ee-8eea-7462bd4f8927-tmp\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.663630 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.663622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f950f3e5-307a-49ee-8eea-7462bd4f8927-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.764431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.764405    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmt5g\" (UniqueName: \"kubernetes.io/projected/f950f3e5-307a-49ee-8eea-7462bd4f8927-kube-api-access-pmt5g\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.764544 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.764443    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f950f3e5-307a-49ee-8eea-7462bd4f8927-manifests\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.764544 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.764462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f950f3e5-307a-49ee-8eea-7462bd4f8927-tmp\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.764544 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.764477    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f950f3e5-307a-49ee-8eea-7462bd4f8927-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.764705 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.764611    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f950f3e5-307a-49ee-8eea-7462bd4f8927-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.764864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.764844    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/f950f3e5-307a-49ee-8eea-7462bd4f8927-manifests\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.766737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.766709    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f950f3e5-307a-49ee-8eea-7462bd4f8927-tmp\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.766940 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.766918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/f950f3e5-307a-49ee-8eea-7462bd4f8927-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.766988 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.766975    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/f950f3e5-307a-49ee-8eea-7462bd4f8927-webhook-cert\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.776382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.776362    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmt5g\" (UniqueName: \"kubernetes.io/projected/f950f3e5-307a-49ee-8eea-7462bd4f8927-kube-api-access-pmt5g\") pod \"opendatahub-operator-controller-manager-56b6d9c7b-mcc2r\" (UID: \"f950f3e5-307a-49ee-8eea-7462bd4f8927\") " pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:43.906594 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:43.906522    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:44.178985 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:44.178960    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"]
Sep 08 10:06:44.181222 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:06:44.181194    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf950f3e5_307a_49ee_8eea_7462bd4f8927.slice/crio-36f35f88ce4aa80a3453093a6d81b9b8489e27e86dc7a17556e1746310e6f152 WatchSource:0}: Error finding container 36f35f88ce4aa80a3453093a6d81b9b8489e27e86dc7a17556e1746310e6f152: Status 404 returned error can't find the container with id 36f35f88ce4aa80a3453093a6d81b9b8489e27e86dc7a17556e1746310e6f152
Sep 08 10:06:44.182946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:44.182931    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:06:45.073858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:45.073819    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r" event={"ID":"f950f3e5-307a-49ee-8eea-7462bd4f8927","Type":"ContainerStarted","Data":"36f35f88ce4aa80a3453093a6d81b9b8489e27e86dc7a17556e1746310e6f152"}
Sep 08 10:06:48.090129 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:48.090083    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r" event={"ID":"f950f3e5-307a-49ee-8eea-7462bd4f8927","Type":"ContainerStarted","Data":"2c0b79614af41423a999c29f5516bf0416be36cf2874ff89931eca563f315eb4"}
Sep 08 10:06:49.096259 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:49.096207    2582 generic.go:356] "Generic (PLEG): container finished" podID="f950f3e5-307a-49ee-8eea-7462bd4f8927" containerID="2c0b79614af41423a999c29f5516bf0416be36cf2874ff89931eca563f315eb4" exitCode=0
Sep 08 10:06:49.096623 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:49.096280    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r" event={"ID":"f950f3e5-307a-49ee-8eea-7462bd4f8927","Type":"ContainerDied","Data":"2c0b79614af41423a999c29f5516bf0416be36cf2874ff89931eca563f315eb4"}
Sep 08 10:06:50.103771 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:50.103727    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r" event={"ID":"f950f3e5-307a-49ee-8eea-7462bd4f8927","Type":"ContainerStarted","Data":"ac5fd93db9cffed4755dcc35df71a4eb119fc654c2519c83b6f08a590f91462d"}
Sep 08 10:06:50.104159 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:50.103820    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:06:50.125434 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:06:50.125381    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r" podStartSLOduration=2.479708745 podStartE2EDuration="7.125360243s" totalImagesPullingTime="3.549145956s" totalInitContainerRuntime="1.096505542s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:06:43 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:06:50.124364693 +0000 UTC m=+320.701235133" watchObservedRunningTime="2026-09-08 10:06:50.125360243 +0000 UTC m=+320.702230685"
Sep 08 10:07:01.110102 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:01.110070    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56b6d9c7b-mcc2r"
Sep 08 10:07:02.250187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.250150    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"]
Sep 08 10:07:02.254595 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.254576    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.257997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.257951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tssx4\""
Sep 08 10:07:02.257997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.257951    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 08 10:07:02.257997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.257991    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 08 10:07:02.258158 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.257957    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 08 10:07:02.261910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.261892    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"]
Sep 08 10:07:02.297507 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.297471    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-manager-config\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.297507 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.297511    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-metrics-cert\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.297701 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.297542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgpbd\" (UniqueName: \"kubernetes.io/projected/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-kube-api-access-qgpbd\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.297701 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.297589    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-cert\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.398698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.398663    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgpbd\" (UniqueName: \"kubernetes.io/projected/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-kube-api-access-qgpbd\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.398828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.398713    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-cert\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.398828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.398756    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-manager-config\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.398828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.398772    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-metrics-cert\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.399449 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.399423    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-manager-config\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.401153 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.401133    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-cert\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.401240 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.401161    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-metrics-cert\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.406515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.406497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgpbd\" (UniqueName: \"kubernetes.io/projected/4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb-kube-api-access-qgpbd\") pod \"lws-controller-manager-86bd4f8cd9-z4ssg\" (UID: \"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb\") " pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.563838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.563748    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:02.833741 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:02.833695    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"]
Sep 08 10:07:02.835877 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:07:02.835845    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc310fc_1a5f_43b8_a8d0_46bfd25dabdb.slice/crio-d48cfe22da817d594078c91bbddd59a981c5cb2bd133be62afe7b5567894e3bb WatchSource:0}: Error finding container d48cfe22da817d594078c91bbddd59a981c5cb2bd133be62afe7b5567894e3bb: Status 404 returned error can't find the container with id d48cfe22da817d594078c91bbddd59a981c5cb2bd133be62afe7b5567894e3bb
Sep 08 10:07:03.155999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:03.155919    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg" event={"ID":"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb","Type":"ContainerStarted","Data":"d48cfe22da817d594078c91bbddd59a981c5cb2bd133be62afe7b5567894e3bb"}
Sep 08 10:07:05.167100 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:05.167065    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg" event={"ID":"4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb","Type":"ContainerStarted","Data":"a753219e5784ad2beface0799715909e7865966812c7576a459b8c1cc3b7fcbc"}
Sep 08 10:07:05.167499 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:05.167195    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:15.517071 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.517005    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg" podStartSLOduration=11.51344205 podStartE2EDuration="13.516984304s" totalImagesPullingTime="2.003542254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:05.246369367 +0000 UTC m=+335.823239807" watchObservedRunningTime="2026-09-08 10:07:15.516984304 +0000 UTC m=+346.093854746"
Sep 08 10:07:15.518881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.518853    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"]
Sep 08 10:07:15.523483 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.523463    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.526040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.526011    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 10:07:15.526177 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.526024    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 10:07:15.526343 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.526322    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hf4wd\""
Sep 08 10:07:15.526505 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.526456    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 10:07:15.536000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.535979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"]
Sep 08 10:07:15.592979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.592955    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.592979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.592982    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6054a48a-1501-46f0-af6f-12d366da74e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593004    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593036    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593109    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvrxj\" (UniqueName: \"kubernetes.io/projected/6054a48a-1501-46f0-af6f-12d366da74e9-kube-api-access-hvrxj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593157    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593174    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6054a48a-1501-46f0-af6f-12d366da74e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593459 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593191    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6054a48a-1501-46f0-af6f-12d366da74e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.593459 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.593292    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694308 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694280    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694318    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694336    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6054a48a-1501-46f0-af6f-12d366da74e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694362    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694392    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694430    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvrxj\" (UniqueName: \"kubernetes.io/projected/6054a48a-1501-46f0-af6f-12d366da74e9-kube-api-access-hvrxj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694726 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694478    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694726 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694501    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6054a48a-1501-46f0-af6f-12d366da74e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694726 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694525    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6054a48a-1501-46f0-af6f-12d366da74e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694759    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694936 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694902    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.694936 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694923    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-istio-data\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.695038 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.694960    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.695452 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.695429    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6054a48a-1501-46f0-af6f-12d366da74e9-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.696999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.696979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6054a48a-1501-46f0-af6f-12d366da74e9-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.697068 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.697033    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6054a48a-1501-46f0-af6f-12d366da74e9-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.702062 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.702036    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6054a48a-1501-46f0-af6f-12d366da74e9-istio-token\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.702787 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.702763    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvrxj\" (UniqueName: \"kubernetes.io/projected/6054a48a-1501-46f0-af6f-12d366da74e9-kube-api-access-hvrxj\") pod \"data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh\" (UID: \"6054a48a-1501-46f0-af6f-12d366da74e9\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:15.839104 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:15.839014    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:16.120337 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:16.120302    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"]
Sep 08 10:07:16.122886 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:07:16.122852    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6054a48a_1501_46f0_af6f_12d366da74e9.slice/crio-c7984e73bce7d210bc9e27e144e655bf48f767e626a2aa141038505d108e8a7d WatchSource:0}: Error finding container c7984e73bce7d210bc9e27e144e655bf48f767e626a2aa141038505d108e8a7d: Status 404 returned error can't find the container with id c7984e73bce7d210bc9e27e144e655bf48f767e626a2aa141038505d108e8a7d
Sep 08 10:07:16.173402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:16.173376    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-86bd4f8cd9-z4ssg"
Sep 08 10:07:16.215212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:16.215177    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh" event={"ID":"6054a48a-1501-46f0-af6f-12d366da74e9","Type":"ContainerStarted","Data":"c7984e73bce7d210bc9e27e144e655bf48f767e626a2aa141038505d108e8a7d"}
Sep 08 10:07:19.454618 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:19.454574    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:07:19.454905 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:19.454656    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:07:19.454905 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:19.454684    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:07:20.236451 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:20.236410    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh" event={"ID":"6054a48a-1501-46f0-af6f-12d366da74e9","Type":"ContainerStarted","Data":"37aaf4486f219cf539bb10b11f20224013d8fb8f116a0b4f73b58b815b1cc802"}
Sep 08 10:07:20.257617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:20.257577    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh" podStartSLOduration=1.929574922 podStartE2EDuration="5.257561555s" totalImagesPullingTime="3.327986633s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:07:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:20.257158979 +0000 UTC m=+350.834029420" watchObservedRunningTime="2026-09-08 10:07:20.257561555 +0000 UTC m=+350.834431997"
Sep 08 10:07:20.839192 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:20.839152    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:20.844493 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:20.844470    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:21.240337 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:21.240302    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:21.241125 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:21.241106    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh"
Sep 08 10:07:23.028248 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.028154    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"]
Sep 08 10:07:23.031052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.031036    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.033787 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.033764    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 10:07:23.033905 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.033805    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 10:07:23.033905 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.033853    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 10:07:23.033905 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.033881    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-xhchn\""
Sep 08 10:07:23.045388 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.045370    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"]
Sep 08 10:07:23.158673 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158641    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/883d5193-2afb-4799-972a-e4bcb83b4818-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.158777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158702    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.158777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158754    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/883d5193-2afb-4799-972a-e4bcb83b4818-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.158898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158780    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.158898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.158898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158868    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnwmf\" (UniqueName: \"kubernetes.io/projected/883d5193-2afb-4799-972a-e4bcb83b4818-kube-api-access-pnwmf\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.159011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.158901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883d5193-2afb-4799-972a-e4bcb83b4818-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.259704 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259682    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/883d5193-2afb-4799-972a-e4bcb83b4818-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.259816 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259727    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.259816 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259749    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/883d5193-2afb-4799-972a-e4bcb83b4818-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.259816 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.259816 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259785    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.260012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnwmf\" (UniqueName: \"kubernetes.io/projected/883d5193-2afb-4799-972a-e4bcb83b4818-kube-api-access-pnwmf\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.260012 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.259849    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883d5193-2afb-4799-972a-e4bcb83b4818-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.260515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.260490    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/883d5193-2afb-4799-972a-e4bcb83b4818-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.262531 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.262503    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.262624 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.262529    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/883d5193-2afb-4799-972a-e4bcb83b4818-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.262737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.262715    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.262796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.262766    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/883d5193-2afb-4799-972a-e4bcb83b4818-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.268680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.268658    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnwmf\" (UniqueName: \"kubernetes.io/projected/883d5193-2afb-4799-972a-e4bcb83b4818-kube-api-access-pnwmf\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.268777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.268760    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/883d5193-2afb-4799-972a-e4bcb83b4818-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-s5mfj\" (UID: \"883d5193-2afb-4799-972a-e4bcb83b4818\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.340454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.340406    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:23.621250 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:23.621143    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"]
Sep 08 10:07:23.624561 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:07:23.624530    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod883d5193_2afb_4799_972a_e4bcb83b4818.slice/crio-ff2a3ef2819399e7e58929835d794d940598310d1390c67a99dcc363256bbc20 WatchSource:0}: Error finding container ff2a3ef2819399e7e58929835d794d940598310d1390c67a99dcc363256bbc20: Status 404 returned error can't find the container with id ff2a3ef2819399e7e58929835d794d940598310d1390c67a99dcc363256bbc20
Sep 08 10:07:24.253755 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:24.253666    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj" event={"ID":"883d5193-2afb-4799-972a-e4bcb83b4818","Type":"ContainerStarted","Data":"ff2a3ef2819399e7e58929835d794d940598310d1390c67a99dcc363256bbc20"}
Sep 08 10:07:26.984553 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:26.984514    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:07:26.984848 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:26.984589    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:07:27.269322 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:27.269221    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj" event={"ID":"883d5193-2afb-4799-972a-e4bcb83b4818","Type":"ContainerStarted","Data":"9ad60dd1a631a11a316e33b2dc4ee678c26bd7105187117aca98ed99e8c2716e"}
Sep 08 10:07:27.269481 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:27.269370    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:27.293647 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:27.293600    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj" podStartSLOduration=0.936043514 podStartE2EDuration="4.293586258s" totalImagesPullingTime="3.357542744s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:07:27.291803819 +0000 UTC m=+357.868674262" watchObservedRunningTime="2026-09-08 10:07:27.293586258 +0000 UTC m=+357.870456699"
Sep 08 10:07:28.279724 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:28.279691    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-s5mfj"
Sep 08 10:07:49.356364 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:07:49.356331    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78fdd88879-x5ndn"]
Sep 08 10:08:14.376364 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.376325    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78fdd88879-x5ndn" podUID="b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" containerName="console" containerID="cri-o://d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c" gracePeriod=15
Sep 08 10:08:14.609331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.609306    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:08:14.638323 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638256    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-swnfl\" (UniqueName: \"kubernetes.io/projected/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-kube-api-access-swnfl\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638323 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638303    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-config\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638385    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-oauth-serving-cert\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638418    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-service-ca\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638456    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-serving-cert\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638479    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-oauth-config\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638724 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638674    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-trusted-ca-bundle\") pod \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\" (UID: \"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef\") "
Sep 08 10:08:14.638842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638797    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:08:14.638842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638792    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-config" (OuterVolumeSpecName: "console-config") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:08:14.639095 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.638855    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-service-ca" (OuterVolumeSpecName: "service-ca") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:08:14.639095 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.639075    2582 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-oauth-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:14.639217 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.639096    2582 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:14.639217 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.639110    2582 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:14.639330 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.639213    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:08:14.640507 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.640488    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-kube-api-access-swnfl" (OuterVolumeSpecName: "kube-api-access-swnfl") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "kube-api-access-swnfl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:08:14.640660 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.640637    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:08:14.641112 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.641092    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" (UID: "b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:08:14.739622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.739589    2582 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-serving-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:14.739622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.739618    2582 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-console-oauth-config\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:14.739622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.739628    2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-trusted-ca-bundle\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:14.739825 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:14.739637    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-swnfl\" (UniqueName: \"kubernetes.io/projected/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef-kube-api-access-swnfl\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:08:15.468472 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.468434    2582 generic.go:356] "Generic (PLEG): container finished" podID="b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" containerID="d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c" exitCode=0
Sep 08 10:08:15.468850 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.468494    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78fdd88879-x5ndn"
Sep 08 10:08:15.468850 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.468524    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fdd88879-x5ndn" event={"ID":"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef","Type":"ContainerDied","Data":"d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c"}
Sep 08 10:08:15.468850 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.468576    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78fdd88879-x5ndn" event={"ID":"b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef","Type":"ContainerDied","Data":"c311595364584ed0a7d3372bb210218877fd6acd4fdbbd5b444bc0ec3a8159bb"}
Sep 08 10:08:15.468850 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.468601    2582 scope.go:117] "RemoveContainer" containerID="d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c"
Sep 08 10:08:15.478334 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.478315    2582 scope.go:117] "RemoveContainer" containerID="d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c"
Sep 08 10:08:15.478590 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:08:15.478568    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c\": container with ID starting with d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c not found: ID does not exist" containerID="d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c"
Sep 08 10:08:15.478638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.478598    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c"} err="failed to get container status \"d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c\": rpc error: code = NotFound desc = could not find container \"d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c\": container with ID starting with d07c59e25829e4970dc298d4baa2495016466ef6946063b3590bf8b5fd8c390c not found: ID does not exist"
Sep 08 10:08:15.491339 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.491316    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78fdd88879-x5ndn"]
Sep 08 10:08:15.494829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.494808    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78fdd88879-x5ndn"]
Sep 08 10:08:15.909431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:08:15.909358    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" path="/var/lib/kubelet/pods/b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef/volumes"
Sep 08 10:10:00.982089 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:00.982059    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"]
Sep 08 10:10:00.982551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:00.982348    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" containerName="console"
Sep 08 10:10:00.982551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:00.982360    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" containerName="console"
Sep 08 10:10:00.982551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:00.982419    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3792bf9-5d78-4eb8-bd8a-5eaa2a730cef" containerName="console"
Sep 08 10:10:00.991996 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:00.991967    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.000596 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.000568    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"]
Sep 08 10:10:01.001547 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.001525    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-m8gc8\""
Sep 08 10:10:01.001547 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.001539    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Sep 08 10:10:01.001790 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.001560    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 10:10:01.001790 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.001712    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 10:10:01.108112 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.108078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10-data\") pod \"postgres-69fb4594cf-gd9zh\" (UID: \"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.108297 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.108125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7jx6v\" (UniqueName: \"kubernetes.io/projected/d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10-kube-api-access-7jx6v\") pod \"postgres-69fb4594cf-gd9zh\" (UID: \"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.208716 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.208686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7jx6v\" (UniqueName: \"kubernetes.io/projected/d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10-kube-api-access-7jx6v\") pod \"postgres-69fb4594cf-gd9zh\" (UID: \"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.208871 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.208852    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10-data\") pod \"postgres-69fb4594cf-gd9zh\" (UID: \"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.209171 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.209157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10-data\") pod \"postgres-69fb4594cf-gd9zh\" (UID: \"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.218028 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.218004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7jx6v\" (UniqueName: \"kubernetes.io/projected/d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10-kube-api-access-7jx6v\") pod \"postgres-69fb4594cf-gd9zh\" (UID: \"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.304282 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.304209    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:01.572071 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.572040    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"]
Sep 08 10:10:01.574423 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:10:01.574388    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd04e2af6_dd9e_49f8_8a73_a58e8e7c0e10.slice/crio-fd8bf3bc239a04e76f55795f401763ab332fbf88f23c66d6824a548f9e99e1c0 WatchSource:0}: Error finding container fd8bf3bc239a04e76f55795f401763ab332fbf88f23c66d6824a548f9e99e1c0: Status 404 returned error can't find the container with id fd8bf3bc239a04e76f55795f401763ab332fbf88f23c66d6824a548f9e99e1c0
Sep 08 10:10:01.902685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:01.902603    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh" event={"ID":"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10","Type":"ContainerStarted","Data":"fd8bf3bc239a04e76f55795f401763ab332fbf88f23c66d6824a548f9e99e1c0"}
Sep 08 10:10:07.932172 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:07.932135    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh" event={"ID":"d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10","Type":"ContainerStarted","Data":"0568054f81430ae89b265a6863de79dd4a1e13f47216b9448f4122a82161620d"}
Sep 08 10:10:07.932573 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:07.932262    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:10:07.955065 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:07.955017    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh" podStartSLOduration=2.301520055 podStartE2EDuration="7.955003064s" totalImagesPullingTime="5.653483009s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:10:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:10:07.954277952 +0000 UTC m=+518.531148393" watchObservedRunningTime="2026-09-08 10:10:07.955003064 +0000 UTC m=+518.531873504"
Sep 08 10:10:13.965413 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:10:13.965380    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-gd9zh"
Sep 08 10:11:35.789074 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.789038    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"]
Sep 08 10:11:35.792397 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.792380    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.795367 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.795347    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fhwp9\""
Sep 08 10:11:35.796300 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.796275    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 10:11:35.796402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.796298    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 10:11:35.796402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.796344    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 10:11:35.815084 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.815058    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"]
Sep 08 10:11:35.899109 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.899080    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.899260 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.899145    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.899333 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.899273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s4gj\" (UniqueName: \"kubernetes.io/projected/d67dec95-9790-45a7-9023-3d604ea42cbb-kube-api-access-5s4gj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.899386 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.899336    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.899437 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.899380    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.899489 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.899449    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67dec95-9790-45a7-9023-3d604ea42cbb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.999979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.999940    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:35.999979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:35.999985    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000210 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000003    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s4gj\" (UniqueName: \"kubernetes.io/projected/d67dec95-9790-45a7-9023-3d604ea42cbb-kube-api-access-5s4gj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000210 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000033    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000210 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000063    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000210 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000100    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67dec95-9790-45a7-9023-3d604ea42cbb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000452 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000428    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.000525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.000508    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.002374 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.002346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d67dec95-9790-45a7-9023-3d604ea42cbb-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.002649 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.002630    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d67dec95-9790-45a7-9023-3d604ea42cbb-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.010762 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.010741    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s4gj\" (UniqueName: \"kubernetes.io/projected/d67dec95-9790-45a7-9023-3d604ea42cbb-kube-api-access-5s4gj\") pod \"e2e-distinct-simulated-kserve-59975d69f9-4h8gm\" (UID: \"d67dec95-9790-45a7-9023-3d604ea42cbb\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.102556 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.102495    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:36.396320 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:36.396293    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"]
Sep 08 10:11:36.397720 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:11:36.397696    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd67dec95_9790_45a7_9023_3d604ea42cbb.slice/crio-c93c95c66469d5b023a04e9a8efbffa2498e79a0e29eeb70ddafe97be9538107 WatchSource:0}: Error finding container c93c95c66469d5b023a04e9a8efbffa2498e79a0e29eeb70ddafe97be9538107: Status 404 returned error can't find the container with id c93c95c66469d5b023a04e9a8efbffa2498e79a0e29eeb70ddafe97be9538107
Sep 08 10:11:37.290346 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:37.290307    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm" event={"ID":"d67dec95-9790-45a7-9023-3d604ea42cbb","Type":"ContainerStarted","Data":"c93c95c66469d5b023a04e9a8efbffa2498e79a0e29eeb70ddafe97be9538107"}
Sep 08 10:11:38.296617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:38.296575    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm" event={"ID":"d67dec95-9790-45a7-9023-3d604ea42cbb","Type":"ContainerStarted","Data":"939fd059a6f453451ee2b39a58c7d0a8e36c6852e95fb25f61f0d048a2d45da6"}
Sep 08 10:11:38.318454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:38.318405    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm" podStartSLOduration=2.354618755 podStartE2EDuration="3.31838961s" totalImagesPullingTime="963.770855ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:11:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:11:38.316343269 +0000 UTC m=+608.893213711" watchObservedRunningTime="2026-09-08 10:11:38.31838961 +0000 UTC m=+608.895260050"
Sep 08 10:11:46.103169 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:46.103134    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:46.105708 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:46.103187    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:46.115588 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:46.115561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:46.339506 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:46.339468    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-4h8gm"
Sep 08 10:11:49.457594 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.457559    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"]
Sep 08 10:11:49.460963 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.460942    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.466339 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.466317    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 10:11:49.475252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.475216    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"]
Sep 08 10:11:49.607698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.607669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.607698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.607699    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.607873 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.607721    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.607873 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.607739    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k9582\" (UniqueName: \"kubernetes.io/projected/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-kube-api-access-k9582\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.607873 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.607844    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.607990 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.607925    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709035 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.708980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709035 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709099    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k9582\" (UniqueName: \"kubernetes.io/projected/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-kube-api-access-k9582\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709144    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709478 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709442    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709475    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.709586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.709502    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.711284 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.711265    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.711471 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.711454    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.720541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.720522    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k9582\" (UniqueName: \"kubernetes.io/projected/61cbcb9e-fe5d-426e-bbab-4c02dc0ec265-kube-api-access-k9582\") pod \"e2e-trlp-test-simulated-kserve-598466548d-mdv4q\" (UID: \"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:49.770913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:49.770892    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:50.077666 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:50.077595    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"]
Sep 08 10:11:50.089080 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:11:50.089057    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cbcb9e_fe5d_426e_bbab_4c02dc0ec265.slice/crio-fa3864043c3cadd9244090bb0e6e7745a0f29bb193f5c54698d1590c46592e6c WatchSource:0}: Error finding container fa3864043c3cadd9244090bb0e6e7745a0f29bb193f5c54698d1590c46592e6c: Status 404 returned error can't find the container with id fa3864043c3cadd9244090bb0e6e7745a0f29bb193f5c54698d1590c46592e6c
Sep 08 10:11:50.090346 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:50.090326    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:11:50.347630 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:50.347564    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q" event={"ID":"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265","Type":"ContainerStarted","Data":"ae00d5fc34de0fbfb7f80e12559ef88531b6968b719f62e037a0b69f6a6d16d9"}
Sep 08 10:11:50.347630 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:50.347618    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q" event={"ID":"61cbcb9e-fe5d-426e-bbab-4c02dc0ec265","Type":"ContainerStarted","Data":"fa3864043c3cadd9244090bb0e6e7745a0f29bb193f5c54698d1590c46592e6c"}
Sep 08 10:11:50.374486 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:50.374433    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q" podStartSLOduration=1.195505541 podStartE2EDuration="1.374413388s" totalImagesPullingTime="178.907847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:11:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:11:50.373089531 +0000 UTC m=+620.949959972" watchObservedRunningTime="2026-09-08 10:11:50.374413388 +0000 UTC m=+620.951283842"
Sep 08 10:11:53.256809 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.256723    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"]
Sep 08 10:11:53.260194 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.260171    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.262971 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.262951    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 08 10:11:53.271942 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.271920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"]
Sep 08 10:11:53.438578 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.438549    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.438739 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.438587    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.438739 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.438618    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.438739 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.438682    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dmkn\" (UniqueName: \"kubernetes.io/projected/d704425f-9d98-4c3c-9d3a-a998eb33b489-kube-api-access-7dmkn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.438858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.438743    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d704425f-9d98-4c3c-9d3a-a998eb33b489-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.438858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.438765    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.539959 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.539889    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d704425f-9d98-4c3c-9d3a-a998eb33b489-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.539959 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.539924    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.539959 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.539949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.540295 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.540072    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.540295 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.540115    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.540295 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.540158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dmkn\" (UniqueName: \"kubernetes.io/projected/d704425f-9d98-4c3c-9d3a-a998eb33b489-kube-api-access-7dmkn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.540449 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.540390    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.540449 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.540432    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.540535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.540494    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.542581 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.542559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d704425f-9d98-4c3c-9d3a-a998eb33b489-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.542858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.542836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d704425f-9d98-4c3c-9d3a-a998eb33b489-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.549224 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.549204    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dmkn\" (UniqueName: \"kubernetes.io/projected/d704425f-9d98-4c3c-9d3a-a998eb33b489-kube-api-access-7dmkn\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd\" (UID: \"d704425f-9d98-4c3c-9d3a-a998eb33b489\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.570651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.570631    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:11:53.840426 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:53.840399    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"]
Sep 08 10:11:53.842774 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:11:53.842743    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd704425f_9d98_4c3c_9d3a_a998eb33b489.slice/crio-85909bf4b25aa0c4ab2e088afdca70281f670a6e75dcde776bafd5a82f173a69 WatchSource:0}: Error finding container 85909bf4b25aa0c4ab2e088afdca70281f670a6e75dcde776bafd5a82f173a69: Status 404 returned error can't find the container with id 85909bf4b25aa0c4ab2e088afdca70281f670a6e75dcde776bafd5a82f173a69
Sep 08 10:11:54.373069 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:54.372973    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd" event={"ID":"d704425f-9d98-4c3c-9d3a-a998eb33b489","Type":"ContainerStarted","Data":"b6fd3ad7da50fdf901b9a9a34c27ac2d851c3fe7267b9329b9e42a86315ff24c"}
Sep 08 10:11:54.373069 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:54.373026    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd" event={"ID":"d704425f-9d98-4c3c-9d3a-a998eb33b489","Type":"ContainerStarted","Data":"85909bf4b25aa0c4ab2e088afdca70281f670a6e75dcde776bafd5a82f173a69"}
Sep 08 10:11:54.394972 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:54.394927    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd" podStartSLOduration=1.19544724 podStartE2EDuration="1.394912902s" totalImagesPullingTime="199.465662ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:11:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:11:54.393658286 +0000 UTC m=+624.970528751" watchObservedRunningTime="2026-09-08 10:11:54.394912902 +0000 UTC m=+624.971783352"
Sep 08 10:11:59.772017 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:59.771982    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:59.772407 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:59.772061    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:11:59.784258 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:11:59.784220    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:12:00.415730 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:12:00.415702    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-mdv4q"
Sep 08 10:12:03.571139 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:12:03.571111    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:12:03.571580 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:12:03.571182    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:12:03.583305 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:12:03.583282    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:12:04.432615 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:12:04.432584    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd"
Sep 08 10:13:55.655446 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.655374    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"]
Sep 08 10:13:55.658590 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.658574    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.661704 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.661683    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-cbf4760c-openshift-default-dockercfg-4l7vd\""
Sep 08 10:13:55.697646 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.697624    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"]
Sep 08 10:13:55.722542 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722517    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-certs\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.722665 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a603d70-1187-4094-a209-7376e06eb6e1-istio-podinfo\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.722665 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722593    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a603d70-1187-4094-a209-7376e06eb6e1-istiod-ca-cert\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.722665 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722630    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-credential-socket\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.722828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722667    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-envoy\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.722828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722697    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-istio-token\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.722828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-socket\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.723000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722851    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-data\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.723000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.722940    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8zqp4\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-kube-api-access-8zqp4\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824135 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824095    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-socket\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824135 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824139    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-data\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8zqp4\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-kube-api-access-8zqp4\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824202    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-certs\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a603d70-1187-4094-a209-7376e06eb6e1-istio-podinfo\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824260    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a603d70-1187-4094-a209-7376e06eb6e1-istiod-ca-cert\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824294    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-credential-socket\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824321    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-envoy\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824347    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-istio-token\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824735 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-socket\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824735 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824571    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-certs\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.824921 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824889    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-data\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.825187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.824904    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-credential-socket\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.825187 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.825103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a603d70-1187-4094-a209-7376e06eb6e1-istiod-ca-cert\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.827000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.826980    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-envoy\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.827390 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.827367    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a603d70-1187-4094-a209-7376e06eb6e1-istio-podinfo\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.833355 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.833335    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-istio-token\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.833725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.833678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8zqp4\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-kube-api-access-8zqp4\") pod \"e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") " pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:55.967763 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:55.967731    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:56.244148 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.244125    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"]
Sep 08 10:13:56.246092 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:13:56.246059    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a603d70_1187_4094_a209_7376e06eb6e1.slice/crio-ae3c48612e8679b94d1604b25f562031cdb50ee86bbec769b610befab62d2a69 WatchSource:0}: Error finding container ae3c48612e8679b94d1604b25f562031cdb50ee86bbec769b610befab62d2a69: Status 404 returned error can't find the container with id ae3c48612e8679b94d1604b25f562031cdb50ee86bbec769b610befab62d2a69
Sep 08 10:13:56.248763 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.248725    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:13:56.248837 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.248810    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:13:56.248875 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.248848    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:13:56.913661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.913624    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" event={"ID":"1a603d70-1187-4094-a209-7376e06eb6e1","Type":"ContainerStarted","Data":"c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"}
Sep 08 10:13:56.914170 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.913676    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" event={"ID":"1a603d70-1187-4094-a209-7376e06eb6e1","Type":"ContainerStarted","Data":"ae3c48612e8679b94d1604b25f562031cdb50ee86bbec769b610befab62d2a69"}
Sep 08 10:13:56.935910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.935863    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podStartSLOduration=1.935847154 podStartE2EDuration="1.935847154s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:13:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:13:56.934207646 +0000 UTC m=+747.511078099" watchObservedRunningTime="2026-09-08 10:13:56.935847154 +0000 UTC m=+747.512717595"
Sep 08 10:13:56.968841 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:56.968819    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:57.972921 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:57.972892    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:58.927919 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:58.927884    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:13:58.928851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:13:58.928831    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:01.154956 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.154888    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"]
Sep 08 10:14:01.158963 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.158941    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.162528 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.162508    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w6wth\""
Sep 08 10:14:01.162657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.162535    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-338aba-serving-cert\""
Sep 08 10:14:01.162657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.162580    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 10:14:01.168706 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.168684    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"]
Sep 08 10:14:01.270813 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.270784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.270972 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.270838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-metrics-certs\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.270972 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.270873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xgzg\" (UniqueName: \"kubernetes.io/projected/3e2ae72b-1acc-4666-b84d-42efdb019c5d-kube-api-access-2xgzg\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.270972 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.270899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ae72b-1acc-4666-b84d-42efdb019c5d-openshift-service-ca\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.371870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.371836    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-metrics-certs\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.372041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.371876    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xgzg\" (UniqueName: \"kubernetes.io/projected/3e2ae72b-1acc-4666-b84d-42efdb019c5d-kube-api-access-2xgzg\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.372041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.371897    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ae72b-1acc-4666-b84d-42efdb019c5d-openshift-service-ca\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.372041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.371967    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.372164 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:14:01.372065    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-338aba-serving-cert: secret "maas-api-e2e-autores-338aba-serving-cert" not found
Sep 08 10:14:01.372164 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:14:01.372127    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls podName:3e2ae72b-1acc-4666-b84d-42efdb019c5d nodeName:}" failed. No retries permitted until 2026-09-08 10:14:01.872110022 +0000 UTC m=+752.448980442 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls") pod "maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" (UID: "3e2ae72b-1acc-4666-b84d-42efdb019c5d") : secret "maas-api-e2e-autores-338aba-serving-cert" not found
Sep 08 10:14:01.372697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.372678    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ae72b-1acc-4666-b84d-42efdb019c5d-openshift-service-ca\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.374292 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.374269    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-metrics-certs\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.380873 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.380836    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xgzg\" (UniqueName: \"kubernetes.io/projected/3e2ae72b-1acc-4666-b84d-42efdb019c5d-kube-api-access-2xgzg\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.876209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.876172    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:01.878443 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:01.878418    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls\") pod \"maas-api-e2e-autores-338aba-578f5fddf6-qvdl9\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:02.071176 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:02.071140    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:02.349003 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:02.348971    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"]
Sep 08 10:14:02.352096 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:14:02.352066    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e2ae72b_1acc_4666_b84d_42efdb019c5d.slice/crio-4cc5cf88c2f435092d020ae1d33ee7a40bbe4bc6aef524b8ac34e633608ba792 WatchSource:0}: Error finding container 4cc5cf88c2f435092d020ae1d33ee7a40bbe4bc6aef524b8ac34e633608ba792: Status 404 returned error can't find the container with id 4cc5cf88c2f435092d020ae1d33ee7a40bbe4bc6aef524b8ac34e633608ba792
Sep 08 10:14:02.949249 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:02.949196    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" event={"ID":"3e2ae72b-1acc-4666-b84d-42efdb019c5d","Type":"ContainerStarted","Data":"4cc5cf88c2f435092d020ae1d33ee7a40bbe4bc6aef524b8ac34e633608ba792"}
Sep 08 10:14:04.961940 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:04.961904    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" event={"ID":"3e2ae72b-1acc-4666-b84d-42efdb019c5d","Type":"ContainerStarted","Data":"2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28"}
Sep 08 10:14:04.962331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:04.962049    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:04.980553 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:04.980506    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" podStartSLOduration=1.7725480980000001 podStartE2EDuration="3.980491486s" totalImagesPullingTime="2.207943388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:04.979425175 +0000 UTC m=+755.556295622" watchObservedRunningTime="2026-09-08 10:14:04.980491486 +0000 UTC m=+755.557361926"
Sep 08 10:14:10.971735 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:10.971705    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:14:14.969435 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:14.969395    2582 patch_prober.go:28] interesting pod/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 10:14:14.969957 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:14.969459    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 10:14:15.913417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.913378    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"]
Sep 08 10:14:15.917402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.917377    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.920657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.920632    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9e365b-openshift-default-dockercfg-x58xt\""
Sep 08 10:14:15.929380 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.929351    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"]
Sep 08 10:14:15.998810 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.998760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-credential-socket\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.998810 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.998801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-envoy\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.998831    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-data\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.998854    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-token\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.998917    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-certs\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.998948    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istiod-ca-cert\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.999040    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-socket\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.999064    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-podinfo\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:15.999351 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:15.999107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bphb\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-kube-api-access-5bphb\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.099684 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.099635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-certs\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.099849 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.099692    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istiod-ca-cert\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.099849 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.099763    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-socket\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.099984 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.099890    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-podinfo\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.099984 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.099949    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bphb\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-kube-api-access-5bphb\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100092 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.099997    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-credential-socket\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100092 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100021    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-envoy\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100092 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100050    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-data\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100092 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100060    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-certs\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100092 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100077    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-token\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100360 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100103    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-socket\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100360 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100329    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-credential-socket\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100603 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100580    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istiod-ca-cert\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.100674 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.100618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-data\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.102441 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.102420    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-podinfo\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.102635 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.102618    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-envoy\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.109411 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.109364    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-token\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.109411 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.109385    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bphb\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-kube-api-access-5bphb\") pod \"e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") " pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.237048 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.237021    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:16.519009 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.518920    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"]
Sep 08 10:14:16.522001 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:14:16.521974    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d527af3_67ac_4ab1_a3d1_ec24d4865b75.slice/crio-f3c8324aae3371a0bb98c4e6ce0215a4868290a8dbaef1847bd8eeed6a86dce4 WatchSource:0}: Error finding container f3c8324aae3371a0bb98c4e6ce0215a4868290a8dbaef1847bd8eeed6a86dce4: Status 404 returned error can't find the container with id f3c8324aae3371a0bb98c4e6ce0215a4868290a8dbaef1847bd8eeed6a86dce4
Sep 08 10:14:16.524133 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.524098    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:16.524207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.524162    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:16.524207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:16.524191    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:17.020408 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.020379    2582 generic.go:356] "Generic (PLEG): container finished" podID="1a603d70-1187-4094-a209-7376e06eb6e1" containerID="c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c" exitCode=0
Sep 08 10:14:17.020834 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.020454    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" event={"ID":"1a603d70-1187-4094-a209-7376e06eb6e1","Type":"ContainerDied","Data":"c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"}
Sep 08 10:14:17.020892 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.020836    2582 scope.go:117] "RemoveContainer" containerID="c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"
Sep 08 10:14:17.022074 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.022030    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:17.022188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.022085    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" event={"ID":"5d527af3-67ac-4ab1-a3d1-ec24d4865b75","Type":"ContainerStarted","Data":"d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"}
Sep 08 10:14:17.022188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.022117    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:17.022188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.022138    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" event={"ID":"5d527af3-67ac-4ab1-a3d1-ec24d4865b75","Type":"ContainerStarted","Data":"f3c8324aae3371a0bb98c4e6ce0215a4868290a8dbaef1847bd8eeed6a86dce4"}
Sep 08 10:14:17.022188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.022156    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:17.080553 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.080500    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podStartSLOduration=2.080479838 podStartE2EDuration="2.080479838s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:17.079730147 +0000 UTC m=+767.656600589" watchObservedRunningTime="2026-09-08 10:14:17.080479838 +0000 UTC m=+767.657350280"
Sep 08 10:14:17.238193 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.238155    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:17.243070 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:17.243045    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:18.029412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.029381    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" event={"ID":"1a603d70-1187-4094-a209-7376e06eb6e1","Type":"ContainerStarted","Data":"fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2"}
Sep 08 10:14:18.029876 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.029641    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:18.030522 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.030501    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:18.337799 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.337725    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"]
Sep 08 10:14:18.343891 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.343869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.346462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.346442    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-0170845d-kserve-self-signed-certs\""
Sep 08 10:14:18.349809 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.349786    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"]
Sep 08 10:14:18.425326 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.425275    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tls-certs\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.425511 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.425346    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ttm\" (UniqueName: \"kubernetes.io/projected/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-kube-api-access-27ttm\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.425511 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.425389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-home\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.425511 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.425441    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-dshm\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.425617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.425540    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-model-cache\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.425617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.425581    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tmp-dir\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.526715 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.526677    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-model-cache\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.526914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.526745    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tmp-dir\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.526914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.526778    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tls-certs\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.526914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.526816    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ttm\" (UniqueName: \"kubernetes.io/projected/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-kube-api-access-27ttm\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.526914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.526850    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-home\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.527167 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.527143    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-model-cache\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.527253 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.527170    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tmp-dir\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.527320 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.527252    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-home\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.527479 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.527452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-dshm\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.529574 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.529556    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-dshm\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.529794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.529775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tls-certs\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.534866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.534843    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ttm\" (UniqueName: \"kubernetes.io/projected/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-kube-api-access-27ttm\") pod \"e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") " pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.653951 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.653869    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:18.946448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.946423    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"]
Sep 08 10:14:18.948345 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:14:18.948320    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d1d9a34_c61f_4c6f_b8ed_9017455d6a1a.slice/crio-16d3d9e755eb388583e791467e54c56424595cb52f4ee9b07154ecc870296d79 WatchSource:0}: Error finding container 16d3d9e755eb388583e791467e54c56424595cb52f4ee9b07154ecc870296d79: Status 404 returned error can't find the container with id 16d3d9e755eb388583e791467e54c56424595cb52f4ee9b07154ecc870296d79
Sep 08 10:14:18.968666 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.968642    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:18.968851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.968827    2582 patch_prober.go:28] interesting pod/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 08 10:14:18.968926 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:18.968897    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 08 10:14:19.035924 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:19.035887    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv" event={"ID":"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a","Type":"ContainerStarted","Data":"cceb0cb920fba87f410a265599191b1b585b73f495d36f21efb007e1887e62e1"}
Sep 08 10:14:19.036368 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:19.035932    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv" event={"ID":"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a","Type":"ContainerStarted","Data":"16d3d9e755eb388583e791467e54c56424595cb52f4ee9b07154ecc870296d79"}
Sep 08 10:14:19.057217 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:19.057161    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv" podStartSLOduration=1.057140426 podStartE2EDuration="1.057140426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:19.056292987 +0000 UTC m=+769.633163428" watchObservedRunningTime="2026-09-08 10:14:19.057140426 +0000 UTC m=+769.634010870"
Sep 08 10:14:19.968023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:19.967990    2582 patch_prober.go:28] interesting pod/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 08 10:14:19.968209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:19.968060    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 08 10:14:20.969062 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:20.969025    2582 patch_prober.go:28] interesting pod/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 08 10:14:20.969433 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:20.969092    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 08 10:14:21.968883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:21.968848    2582 patch_prober.go:28] interesting pod/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 08 10:14:21.969052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:21.968904    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 08 10:14:22.968733 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:22.968699    2582 patch_prober.go:28] interesting pod/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused" start-of-body=
Sep 08 10:14:22.969119 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:22.968758    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.30:15021/healthz/ready\": dial tcp 10.133.0.30:15021: connect: connection refused"
Sep 08 10:14:23.971888 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:23.971858    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:23.972255 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:23.972203    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:23.972920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:23.972899    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:28.654150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:28.654116    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:28.654648 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:28.654164    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:28.666591 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:28.666569    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:29.090833 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:29.090806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:14:38.129414 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:38.129389    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerID="d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4" exitCode=0
Sep 08 10:14:38.129756 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:38.129469    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" event={"ID":"5d527af3-67ac-4ab1-a3d1-ec24d4865b75","Type":"ContainerDied","Data":"d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"}
Sep 08 10:14:38.129853 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:38.129839    2582 scope.go:117] "RemoveContainer" containerID="d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"
Sep 08 10:14:38.130832 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:38.130805    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:38.130892 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:38.130874    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:38.130934 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:38.130903    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:14:39.135909 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:39.135873    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" event={"ID":"5d527af3-67ac-4ab1-a3d1-ec24d4865b75","Type":"ContainerStarted","Data":"9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea"}
Sep 08 10:14:39.238100 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:39.238062    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:39.238306 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:39.238282    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 08 10:14:39.238367 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:39.238334    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 08 10:14:40.237363 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:40.237330    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 08 10:14:40.237750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:40.237380    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 08 10:14:40.900199 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:40.900155    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"]
Sep 08 10:14:40.914664 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:40.914619    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy" containerID="cri-o://fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2" gracePeriod=30
Sep 08 10:14:41.238196 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:41.238164    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 08 10:14:41.238617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:41.238219    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 08 10:14:42.237572 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:42.237534    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 08 10:14:42.237741 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:42.237588    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 08 10:14:43.237380 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:43.237341    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 08 10:14:43.237792 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:43.237446    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 08 10:14:44.237717 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:44.237679    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Sep 08 10:14:44.238141 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:44.237766    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Sep 08 10:14:45.192690 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.192661    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"]
Sep 08 10:14:45.194917 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.194901    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.197592 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.197556    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a5df2a72\""
Sep 08 10:14:45.197706 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.197642    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a5df2a72-dockercfg-pspzf\""
Sep 08 10:14:45.210813 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.210789    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"]
Sep 08 10:14:45.257932 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.257900    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:45.258469 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.258444    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:45.259497 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.259475    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:14:45.266830 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.266805    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.266942 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.266928    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26px\" (UniqueName: \"kubernetes.io/projected/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-kube-api-access-m26px\") pod \"payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.367446 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.367411    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.367594 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.367508    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26px\" (UniqueName: \"kubernetes.io/projected/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-kube-api-access-m26px\") pod \"payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.368100 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.368082    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.375820 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.375781    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26px\" (UniqueName: \"kubernetes.io/projected/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-kube-api-access-m26px\") pod \"payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.505645 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.505561    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:45.775277 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:45.775252    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"]
Sep 08 10:14:45.777327 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:14:45.777298    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3678d7f_6ac4_4bd7_87ff_87d338c0803b.slice/crio-d5536fea9fa0011ca53ae616617b0d8105090556cea70677dc471feb971a5461 WatchSource:0}: Error finding container d5536fea9fa0011ca53ae616617b0d8105090556cea70677dc471feb971a5461: Status 404 returned error can't find the container with id d5536fea9fa0011ca53ae616617b0d8105090556cea70677dc471feb971a5461
Sep 08 10:14:46.166375 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.166352    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:46.168310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.168280    2582 generic.go:356] "Generic (PLEG): container finished" podID="1a603d70-1187-4094-a209-7376e06eb6e1" containerID="fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2" exitCode=0
Sep 08 10:14:46.168448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.168325    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"
Sep 08 10:14:46.168448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.168355    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" event={"ID":"1a603d70-1187-4094-a209-7376e06eb6e1","Type":"ContainerDied","Data":"fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2"}
Sep 08 10:14:46.168448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.168402    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424" event={"ID":"1a603d70-1187-4094-a209-7376e06eb6e1","Type":"ContainerDied","Data":"ae3c48612e8679b94d1604b25f562031cdb50ee86bbec769b610befab62d2a69"}
Sep 08 10:14:46.168448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.168436    2582 scope.go:117] "RemoveContainer" containerID="fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2"
Sep 08 10:14:46.169722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.169690    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd" event={"ID":"f3678d7f-6ac4-4bd7-87ff-87d338c0803b","Type":"ContainerStarted","Data":"d5536fea9fa0011ca53ae616617b0d8105090556cea70677dc471feb971a5461"}
Sep 08 10:14:46.174142 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174120    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-istio-token\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174280 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174177    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a603d70-1187-4094-a209-7376e06eb6e1-istiod-ca-cert\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174280 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174200    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-certs\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174280 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8zqp4\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-kube-api-access-8zqp4\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174295    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-envoy\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174327    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-credential-socket\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174359    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-data\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174387    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a603d70-1187-4094-a209-7376e06eb6e1-istio-podinfo\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174428    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-socket\") pod \"1a603d70-1187-4094-a209-7376e06eb6e1\" (UID: \"1a603d70-1187-4094-a209-7376e06eb6e1\") "
Sep 08 10:14:46.174695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174564    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:46.174695 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174639    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a603d70-1187-4094-a209-7376e06eb6e1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:14:46.174797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174721    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:46.174797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174783    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.174933 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174906    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:46.174933 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.174919    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:46.176837 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.176810    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:14:46.176911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.176832    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-kube-api-access-8zqp4" (OuterVolumeSpecName: "kube-api-access-8zqp4") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "kube-api-access-8zqp4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:14:46.176911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.176887    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a603d70-1187-4094-a209-7376e06eb6e1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:14:46.177024 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.177007    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a603d70-1187-4094-a209-7376e06eb6e1" (UID: "1a603d70-1187-4094-a209-7376e06eb6e1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:14:46.177620 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.177601    2582 scope.go:117] "RemoveContainer" containerID="c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"
Sep 08 10:14:46.184989 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.184969    2582 scope.go:117] "RemoveContainer" containerID="fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2"
Sep 08 10:14:46.185288 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:14:46.185222    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2\": container with ID starting with fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2 not found: ID does not exist" containerID="fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2"
Sep 08 10:14:46.185359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.185284    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2"} err="failed to get container status \"fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2\": rpc error: code = NotFound desc = could not find container \"fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2\": container with ID starting with fd2015ff820fe3e10d945ed7c43a998d418de1bf5353eb17e1e4b200c40b9bf2 not found: ID does not exist"
Sep 08 10:14:46.185359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.185308    2582 scope.go:117] "RemoveContainer" containerID="c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"
Sep 08 10:14:46.185577 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:14:46.185559    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c\": container with ID starting with c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c not found: ID does not exist" containerID="c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"
Sep 08 10:14:46.185619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.185582    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c"} err="failed to get container status \"c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c\": rpc error: code = NotFound desc = could not find container \"c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c\": container with ID starting with c4b861675933fda7f334a0f2ff8fa3fd149cb1335f8938b8eb7d11ae79152b1c not found: ID does not exist"
Sep 08 10:14:46.275806 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275779    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275868    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275890    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a603d70-1187-4094-a209-7376e06eb6e1-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275906    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8zqp4\" (UniqueName: \"kubernetes.io/projected/1a603d70-1187-4094-a209-7376e06eb6e1-kube-api-access-8zqp4\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275920    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275935    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275949    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a603d70-1187-4094-a209-7376e06eb6e1-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.276085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.275963    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a603d70-1187-4094-a209-7376e06eb6e1-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:14:46.493961 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.493929    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"]
Sep 08 10:14:46.500653 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:46.500630    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-cbf4760c-openshift-default-77bf68f494-6s424"]
Sep 08 10:14:47.909637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:47.909601    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" path="/var/lib/kubelet/pods/1a603d70-1187-4094-a209-7376e06eb6e1/volumes"
Sep 08 10:14:50.190872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:50.190831    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd" event={"ID":"f3678d7f-6ac4-4bd7-87ff-87d338c0803b","Type":"ContainerStarted","Data":"b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e"}
Sep 08 10:14:50.191338 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:50.190924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:14:50.210744 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:14:50.210699    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd" podStartSLOduration=1.204485254 podStartE2EDuration="5.210680373s" totalImagesPullingTime="4.006195119s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:14:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:14:50.209987373 +0000 UTC m=+800.786857820" watchObservedRunningTime="2026-09-08 10:14:50.210680373 +0000 UTC m=+800.787550815"
Sep 08 10:15:00.148912 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.148828    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"]
Sep 08 10:15:00.149281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.149188    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy"
Sep 08 10:15:00.149281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.149201    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy"
Sep 08 10:15:00.149365 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.149299    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy"
Sep 08 10:15:00.152078 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.152061    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"]
Sep 08 10:15:00.152188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.152168    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"
Sep 08 10:15:00.152412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.152393    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy"
Sep 08 10:15:00.152412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.152411    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy"
Sep 08 10:15:00.152541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.152505    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a603d70-1187-4094-a209-7376e06eb6e1" containerName="istio-proxy"
Sep 08 10:15:00.154649 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.154627    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q7pww\""
Sep 08 10:15:00.155050 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.155035    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"
Sep 08 10:15:00.163353 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.163332    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"]
Sep 08 10:15:00.164960 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.164805    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"
Sep 08 10:15:00.165495 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.165474    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"]
Sep 08 10:15:00.173379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.173361    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"
Sep 08 10:15:00.450809 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.450779    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"]
Sep 08 10:15:00.451167 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:15:00.451146    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86a2fe41_e4a9_4e26_b268_1988accec7bd.slice/crio-25b6c550732e937e8c9ba65d0898e72d7d447fe6e2c870218eacbfd19640bbda WatchSource:0}: Error finding container 25b6c550732e937e8c9ba65d0898e72d7d447fe6e2c870218eacbfd19640bbda: Status 404 returned error can't find the container with id 25b6c550732e937e8c9ba65d0898e72d7d447fe6e2c870218eacbfd19640bbda
Sep 08 10:15:00.458835 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:00.458811    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"]
Sep 08 10:15:00.460636 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:15:00.460615    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ea6e1b_38fb_4714_a9cf_71fd0ff88105.slice/crio-09d5c47879c97bf51703d8a961187c1a69e54570d7bd3d7f1dc1f7d24276d634 WatchSource:0}: Error finding container 09d5c47879c97bf51703d8a961187c1a69e54570d7bd3d7f1dc1f7d24276d634: Status 404 returned error can't find the container with id 09d5c47879c97bf51703d8a961187c1a69e54570d7bd3d7f1dc1f7d24276d634
Sep 08 10:15:01.197417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:01.197390    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:15:01.250078 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:01.249496    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc" event={"ID":"86a2fe41-e4a9-4e26-b268-1988accec7bd","Type":"ContainerStarted","Data":"25b6c550732e937e8c9ba65d0898e72d7d447fe6e2c870218eacbfd19640bbda"}
Sep 08 10:15:01.252052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:01.251927    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk" event={"ID":"c2ea6e1b-38fb-4714-a9cf-71fd0ff88105","Type":"ContainerStarted","Data":"09d5c47879c97bf51703d8a961187c1a69e54570d7bd3d7f1dc1f7d24276d634"}
Sep 08 10:15:03.265400 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:03.265364    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc" event={"ID":"86a2fe41-e4a9-4e26-b268-1988accec7bd","Type":"ContainerStarted","Data":"35f75e40f690eab071a6ac50134278c6b16fe3395c7892733c683c9c817db5c2"}
Sep 08 10:15:03.266809 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:03.266787    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk" event={"ID":"c2ea6e1b-38fb-4714-a9cf-71fd0ff88105","Type":"ContainerStarted","Data":"c1b758658cf58b72458570a09fd73b6f6770199837423680d5554ea5da38b0a5"}
Sep 08 10:15:03.281019 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:03.280974    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc" podStartSLOduration=1.239294675 podStartE2EDuration="3.280960822s" totalImagesPullingTime="2.041666147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:15:03.27995674 +0000 UTC m=+813.856827192" watchObservedRunningTime="2026-09-08 10:15:03.280960822 +0000 UTC m=+813.857831263"
Sep 08 10:15:03.294914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:03.294860    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk" podStartSLOduration=1.266976545 podStartE2EDuration="3.294843875s" totalImagesPullingTime="2.02786733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:15:03.294304674 +0000 UTC m=+813.871175119" watchObservedRunningTime="2026-09-08 10:15:03.294843875 +0000 UTC m=+813.871714317"
Sep 08 10:15:04.273691 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:04.273654    2582 generic.go:356] "Generic (PLEG): container finished" podID="86a2fe41-e4a9-4e26-b268-1988accec7bd" containerID="35f75e40f690eab071a6ac50134278c6b16fe3395c7892733c683c9c817db5c2" exitCode=0
Sep 08 10:15:04.274136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:04.273748    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc" event={"ID":"86a2fe41-e4a9-4e26-b268-1988accec7bd","Type":"ContainerDied","Data":"35f75e40f690eab071a6ac50134278c6b16fe3395c7892733c683c9c817db5c2"}
Sep 08 10:15:04.275331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:04.275306    2582 generic.go:356] "Generic (PLEG): container finished" podID="c2ea6e1b-38fb-4714-a9cf-71fd0ff88105" containerID="c1b758658cf58b72458570a09fd73b6f6770199837423680d5554ea5da38b0a5" exitCode=0
Sep 08 10:15:04.275443 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:04.275356    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk" event={"ID":"c2ea6e1b-38fb-4714-a9cf-71fd0ff88105","Type":"ContainerDied","Data":"c1b758658cf58b72458570a09fd73b6f6770199837423680d5554ea5da38b0a5"}
Sep 08 10:15:05.421671 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:05.421615    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"
Sep 08 10:15:05.428271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:05.428251    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"
Sep 08 10:15:06.285994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:06.285915    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"
Sep 08 10:15:06.286142 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:06.285916    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc" event={"ID":"86a2fe41-e4a9-4e26-b268-1988accec7bd","Type":"ContainerDied","Data":"25b6c550732e937e8c9ba65d0898e72d7d447fe6e2c870218eacbfd19640bbda"}
Sep 08 10:15:06.286142 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:06.286041    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="25b6c550732e937e8c9ba65d0898e72d7d447fe6e2c870218eacbfd19640bbda"
Sep 08 10:15:06.287285 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:06.287263    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk" event={"ID":"c2ea6e1b-38fb-4714-a9cf-71fd0ff88105","Type":"ContainerDied","Data":"09d5c47879c97bf51703d8a961187c1a69e54570d7bd3d7f1dc1f7d24276d634"}
Sep 08 10:15:06.287396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:06.287292    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"
Sep 08 10:15:06.287396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:06.287300    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="09d5c47879c97bf51703d8a961187c1a69e54570d7bd3d7f1dc1f7d24276d634"
Sep 08 10:15:14.167133 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167100    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"]
Sep 08 10:15:14.167503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167436    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86a2fe41-e4a9-4e26-b268-1988accec7bd" containerName="cleanup"
Sep 08 10:15:14.167503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167450    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="86a2fe41-e4a9-4e26-b268-1988accec7bd" containerName="cleanup"
Sep 08 10:15:14.167503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167456    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2ea6e1b-38fb-4714-a9cf-71fd0ff88105" containerName="cleanup"
Sep 08 10:15:14.167503 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167461    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2ea6e1b-38fb-4714-a9cf-71fd0ff88105" containerName="cleanup"
Sep 08 10:15:14.167640 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167527    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="86a2fe41-e4a9-4e26-b268-1988accec7bd" containerName="cleanup"
Sep 08 10:15:14.167640 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.167537    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2ea6e1b-38fb-4714-a9cf-71fd0ff88105" containerName="cleanup"
Sep 08 10:15:14.170541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.170527    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.175734 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.175709    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-b-0170845d-kserve-self-signed-certs\""
Sep 08 10:15:14.193920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.193894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"]
Sep 08 10:15:14.302145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.302118    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tls-certs\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.302279 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.302155    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tmp-dir\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.302279 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.302188    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-dshm\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.302354 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.302274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-home\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.302354 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.302303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-model-cache\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.302354 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.302335    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q24h\" (UniqueName: \"kubernetes.io/projected/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-kube-api-access-6q24h\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403335    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-dshm\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403391    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-home\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403410    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-model-cache\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403444    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q24h\" (UniqueName: \"kubernetes.io/projected/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-kube-api-access-6q24h\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403507    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tls-certs\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403727 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403545    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tmp-dir\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403897 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403826    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-home\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.403897 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403873    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-model-cache\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.404018 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.403973    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tmp-dir\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.405581 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.405560    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-dshm\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.406058 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.406040    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tls-certs\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.416716 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.416687    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q24h\" (UniqueName: \"kubernetes.io/projected/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-kube-api-access-6q24h\") pod \"e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") " pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.480148 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.480090    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:14.750667 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:14.750597    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"]
Sep 08 10:15:14.753664 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:15:14.753638    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda10a3ad9_8ee8_4534_ba18_84bb67dd8344.slice/crio-4c08ca22732d9784742488262878b096ae15ef8013e184d125ae578a4203ed7d WatchSource:0}: Error finding container 4c08ca22732d9784742488262878b096ae15ef8013e184d125ae578a4203ed7d: Status 404 returned error can't find the container with id 4c08ca22732d9784742488262878b096ae15ef8013e184d125ae578a4203ed7d
Sep 08 10:15:15.331316 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:15.331277    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw" event={"ID":"a10a3ad9-8ee8-4534-ba18-84bb67dd8344","Type":"ContainerStarted","Data":"3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f"}
Sep 08 10:15:15.331722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:15.331322    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw" event={"ID":"a10a3ad9-8ee8-4534-ba18-84bb67dd8344","Type":"ContainerStarted","Data":"4c08ca22732d9784742488262878b096ae15ef8013e184d125ae578a4203ed7d"}
Sep 08 10:15:15.349585 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:15.349523    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw" podStartSLOduration=1.34950732 podStartE2EDuration="1.34950732s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:15:15.348618702 +0000 UTC m=+825.925489144" watchObservedRunningTime="2026-09-08 10:15:15.34950732 +0000 UTC m=+825.926377790"
Sep 08 10:15:15.995728 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:15.995693    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"]
Sep 08 10:15:16.004983 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.004959    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-a5df2a72-29814375-s2pxk"]
Sep 08 10:15:16.031542 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.031515    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"]
Sep 08 10:15:16.031800 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.031739    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd" podUID="f3678d7f-6ac4-4bd7-87ff-87d338c0803b" containerName="payload-pre-processing" containerID="cri-o://b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e" gracePeriod=30
Sep 08 10:15:16.275345 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.275321    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:15:16.340265 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.339600    2582 generic.go:356] "Generic (PLEG): container finished" podID="f3678d7f-6ac4-4bd7-87ff-87d338c0803b" containerID="b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e" exitCode=0
Sep 08 10:15:16.340265 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.339818    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd" event={"ID":"f3678d7f-6ac4-4bd7-87ff-87d338c0803b","Type":"ContainerDied","Data":"b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e"}
Sep 08 10:15:16.340265 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.339878    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd" event={"ID":"f3678d7f-6ac4-4bd7-87ff-87d338c0803b","Type":"ContainerDied","Data":"d5536fea9fa0011ca53ae616617b0d8105090556cea70677dc471feb971a5461"}
Sep 08 10:15:16.340265 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.339910    2582 scope.go:117] "RemoveContainer" containerID="b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e"
Sep 08 10:15:16.340903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.340537    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"
Sep 08 10:15:16.351548 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.351526    2582 scope.go:117] "RemoveContainer" containerID="b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e"
Sep 08 10:15:16.351884 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:15:16.351861    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e\": container with ID starting with b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e not found: ID does not exist" containerID="b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e"
Sep 08 10:15:16.351974 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.351903    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e"} err="failed to get container status \"b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e\": rpc error: code = NotFound desc = could not find container \"b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e\": container with ID starting with b5eaf1be7322f58f2701c8bdf095e669a6d85a6cf969e4e0cce1b115e38eef1e not found: ID does not exist"
Sep 08 10:15:16.420974 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.420947    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-plugins-config-volume\") pod \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") "
Sep 08 10:15:16.421090 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.421038    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26px\" (UniqueName: \"kubernetes.io/projected/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-kube-api-access-m26px\") pod \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\" (UID: \"f3678d7f-6ac4-4bd7-87ff-87d338c0803b\") "
Sep 08 10:15:16.421367 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.421341    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f3678d7f-6ac4-4bd7-87ff-87d338c0803b" (UID: "f3678d7f-6ac4-4bd7-87ff-87d338c0803b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:15:16.422875 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.422856    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-kube-api-access-m26px" (OuterVolumeSpecName: "kube-api-access-m26px") pod "f3678d7f-6ac4-4bd7-87ff-87d338c0803b" (UID: "f3678d7f-6ac4-4bd7-87ff-87d338c0803b"). InnerVolumeSpecName "kube-api-access-m26px". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:15:16.522292 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.522182    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:16.522292 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.522213    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26px\" (UniqueName: \"kubernetes.io/projected/f3678d7f-6ac4-4bd7-87ff-87d338c0803b-kube-api-access-m26px\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:16.664808 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.664780    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"]
Sep 08 10:15:16.673213 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:16.673186    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a5df2a72-8479887f54-xndtd"]
Sep 08 10:15:17.198977 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.198948    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"]
Sep 08 10:15:17.199382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.199364    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3678d7f-6ac4-4bd7-87ff-87d338c0803b" containerName="payload-pre-processing"
Sep 08 10:15:17.199490 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.199384    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3678d7f-6ac4-4bd7-87ff-87d338c0803b" containerName="payload-pre-processing"
Sep 08 10:15:17.199490 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.199467    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3678d7f-6ac4-4bd7-87ff-87d338c0803b" containerName="payload-pre-processing"
Sep 08 10:15:17.203782 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.203760    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.207088 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.207071    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-f688fb08-openshift-default-dockercfg-rq688\""
Sep 08 10:15:17.243723 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.243703    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"]
Sep 08 10:15:17.328770 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.328738    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qczcf\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-kube-api-access-qczcf\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.328913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.328786    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-certs\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.328913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.328815    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-credential-socket\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.328913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.328838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbf67d9-f42c-4793-a01b-804799668f69-istiod-ca-cert\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.328913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.328857    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-data\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.329046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.328980    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-envoy\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.329046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.329003    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-istio-token\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.329046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.329025    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-socket\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.329137 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.329049    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbf67d9-f42c-4793-a01b-804799668f69-istio-podinfo\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430030 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.429990    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-certs\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430030 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430035    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-credential-socket\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430156    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbf67d9-f42c-4793-a01b-804799668f69-istiod-ca-cert\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430188    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-data\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430297    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-envoy\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430316    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-istio-token\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430448    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-certs\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430452    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-socket\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430509    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbf67d9-f42c-4793-a01b-804799668f69-istio-podinfo\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-credential-socket\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430559    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qczcf\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-kube-api-access-qczcf\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430989 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430624    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-data\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430989 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430771    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-socket\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.430989 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.430875    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbf67d9-f42c-4793-a01b-804799668f69-istiod-ca-cert\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.432508 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.432488    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-envoy\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.432795 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.432775    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbf67d9-f42c-4793-a01b-804799668f69-istio-podinfo\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.439421 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.439393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qczcf\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-kube-api-access-qczcf\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.439525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.439440    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-istio-token\") pod \"e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") " pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.513766 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.513707    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:17.787207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.787183    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"]
Sep 08 10:15:17.789251 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:15:17.789208    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcbf67d9_f42c_4793_a01b_804799668f69.slice/crio-bb17b31c846cbe8c348432a0eb48c5d1d3ece1ecc76719ccea0cc4392fd72698 WatchSource:0}: Error finding container bb17b31c846cbe8c348432a0eb48c5d1d3ece1ecc76719ccea0cc4392fd72698: Status 404 returned error can't find the container with id bb17b31c846cbe8c348432a0eb48c5d1d3ece1ecc76719ccea0cc4392fd72698
Sep 08 10:15:17.791528 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.791496    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:15:17.791599 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.791561    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:15:17.791599 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.791592    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:15:17.910510 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.910470    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2ea6e1b-38fb-4714-a9cf-71fd0ff88105" path="/var/lib/kubelet/pods/c2ea6e1b-38fb-4714-a9cf-71fd0ff88105/volumes"
Sep 08 10:15:17.910797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:17.910782    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3678d7f-6ac4-4bd7-87ff-87d338c0803b" path="/var/lib/kubelet/pods/f3678d7f-6ac4-4bd7-87ff-87d338c0803b/volumes"
Sep 08 10:15:18.354800 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:18.354762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" event={"ID":"fcbf67d9-f42c-4793-a01b-804799668f69","Type":"ContainerStarted","Data":"baf7e680d5e9cae50e2e8c4aecdc63412507b8ae432cbae8d77d9a19bed429e0"}
Sep 08 10:15:18.354960 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:18.354821    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" event={"ID":"fcbf67d9-f42c-4793-a01b-804799668f69","Type":"ContainerStarted","Data":"bb17b31c846cbe8c348432a0eb48c5d1d3ece1ecc76719ccea0cc4392fd72698"}
Sep 08 10:15:18.375639 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:18.375595    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podStartSLOduration=1.375579818 podStartE2EDuration="1.375579818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:15:18.373454895 +0000 UTC m=+828.950325363" watchObservedRunningTime="2026-09-08 10:15:18.375579818 +0000 UTC m=+828.952450258"
Sep 08 10:15:18.514493 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:18.514457    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:18.519322 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:18.519297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:19.359997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:19.359964    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:19.360694 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:19.360681    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:21.815220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.815184    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"]
Sep 08 10:15:21.820851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.820835    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:21.823671 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.823640    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f688fb08-dockercfg-zg2wh\""
Sep 08 10:15:21.824679 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.824660    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f688fb08\""
Sep 08 10:15:21.835874 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.835854    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"]
Sep 08 10:15:21.860322 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.860295    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"]
Sep 08 10:15:21.864105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.864088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:21.872765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.872745    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"]
Sep 08 10:15:21.970081 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.970046    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a151479-8370-4ae6-b043-2e7f6a153fb8-plugins-config-volume\") pod \"payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") " pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:21.970081 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.970088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2341e35c-9a2b-416c-9c8b-66b8724d4472-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:21.970382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.970112    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5994l\" (UniqueName: \"kubernetes.io/projected/2341e35c-9a2b-416c-9c8b-66b8724d4472-kube-api-access-5994l\") pod \"payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:21.970382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:21.970283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfrwx\" (UniqueName: \"kubernetes.io/projected/3a151479-8370-4ae6-b043-2e7f6a153fb8-kube-api-access-sfrwx\") pod \"payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") " pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:22.071164 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.071097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a151479-8370-4ae6-b043-2e7f6a153fb8-plugins-config-volume\") pod \"payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") " pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:22.071164 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.071135    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2341e35c-9a2b-416c-9c8b-66b8724d4472-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:22.071164 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.071158    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5994l\" (UniqueName: \"kubernetes.io/projected/2341e35c-9a2b-416c-9c8b-66b8724d4472-kube-api-access-5994l\") pod \"payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:22.071420 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.071277    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfrwx\" (UniqueName: \"kubernetes.io/projected/3a151479-8370-4ae6-b043-2e7f6a153fb8-kube-api-access-sfrwx\") pod \"payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") " pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:22.071928 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.071905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2341e35c-9a2b-416c-9c8b-66b8724d4472-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:22.071992 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.071915    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a151479-8370-4ae6-b043-2e7f6a153fb8-plugins-config-volume\") pod \"payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") " pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:22.080583 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.080563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5994l\" (UniqueName: \"kubernetes.io/projected/2341e35c-9a2b-416c-9c8b-66b8724d4472-kube-api-access-5994l\") pod \"payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:22.080583 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.080576    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfrwx\" (UniqueName: \"kubernetes.io/projected/3a151479-8370-4ae6-b043-2e7f6a153fb8-kube-api-access-sfrwx\") pod \"payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") " pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:22.131113 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.131088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:22.174219 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.174193    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:22.400956 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.400932    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"]
Sep 08 10:15:22.403276 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:15:22.403252    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a151479_8370_4ae6_b043_2e7f6a153fb8.slice/crio-0f4ff0fd9699c66a40b6ed48c1d2c6b6c8dc0b042875deac38cc16c987c555eb WatchSource:0}: Error finding container 0f4ff0fd9699c66a40b6ed48c1d2c6b6c8dc0b042875deac38cc16c987c555eb: Status 404 returned error can't find the container with id 0f4ff0fd9699c66a40b6ed48c1d2c6b6c8dc0b042875deac38cc16c987c555eb
Sep 08 10:15:22.453557 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:22.453536    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"]
Sep 08 10:15:22.456758 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:15:22.456735    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2341e35c_9a2b_416c_9c8b_66b8724d4472.slice/crio-9d3099e0e19dd6e6c3b5c9546a204946440836b06e5b3a8e1363122ef7657a3f WatchSource:0}: Error finding container 9d3099e0e19dd6e6c3b5c9546a204946440836b06e5b3a8e1363122ef7657a3f: Status 404 returned error can't find the container with id 9d3099e0e19dd6e6c3b5c9546a204946440836b06e5b3a8e1363122ef7657a3f
Sep 08 10:15:23.381698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.381663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd" event={"ID":"2341e35c-9a2b-416c-9c8b-66b8724d4472","Type":"ContainerStarted","Data":"711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103"}
Sep 08 10:15:23.382143 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.381713    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd" event={"ID":"2341e35c-9a2b-416c-9c8b-66b8724d4472","Type":"ContainerStarted","Data":"9d3099e0e19dd6e6c3b5c9546a204946440836b06e5b3a8e1363122ef7657a3f"}
Sep 08 10:15:23.382143 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.381749    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:23.383189 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.383167    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p" event={"ID":"3a151479-8370-4ae6-b043-2e7f6a153fb8","Type":"ContainerStarted","Data":"0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c"}
Sep 08 10:15:23.383323 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.383202    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p" event={"ID":"3a151479-8370-4ae6-b043-2e7f6a153fb8","Type":"ContainerStarted","Data":"0f4ff0fd9699c66a40b6ed48c1d2c6b6c8dc0b042875deac38cc16c987c555eb"}
Sep 08 10:15:23.383323 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.383263    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:23.400392 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.400334    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd" podStartSLOduration=2.400321428 podStartE2EDuration="2.400321428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:15:23.397494287 +0000 UTC m=+833.974364734" watchObservedRunningTime="2026-09-08 10:15:23.400321428 +0000 UTC m=+833.977191895"
Sep 08 10:15:23.416098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:23.416055    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p" podStartSLOduration=2.416040422 podStartE2EDuration="2.416040422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:15:23.414355459 +0000 UTC m=+833.991225904" watchObservedRunningTime="2026-09-08 10:15:23.416040422 +0000 UTC m=+833.992910864"
Sep 08 10:15:24.480494 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:24.480455    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:24.480862 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:24.480514    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:24.492441 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:24.492419    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:25.403746 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:25.403713    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:15:34.390638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:34.390605    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:34.391103 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:34.390678    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:42.480300 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:42.480266    2582 generic.go:356] "Generic (PLEG): container finished" podID="fcbf67d9-f42c-4793-a01b-804799668f69" containerID="baf7e680d5e9cae50e2e8c4aecdc63412507b8ae432cbae8d77d9a19bed429e0" exitCode=0
Sep 08 10:15:42.480657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:42.480313    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" event={"ID":"fcbf67d9-f42c-4793-a01b-804799668f69","Type":"ContainerDied","Data":"baf7e680d5e9cae50e2e8c4aecdc63412507b8ae432cbae8d77d9a19bed429e0"}
Sep 08 10:15:42.480723 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:42.480704    2582 scope.go:117] "RemoveContainer" containerID="baf7e680d5e9cae50e2e8c4aecdc63412507b8ae432cbae8d77d9a19bed429e0"
Sep 08 10:15:42.481719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:42.481686    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:15:42.481777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:42.481763    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:15:42.481815 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:42.481800    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:15:43.487331 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:43.487293    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" event={"ID":"fcbf67d9-f42c-4793-a01b-804799668f69","Type":"ContainerStarted","Data":"5f87eeb3cb88c4ee5c4bf98e684db7e3f41c8f78fa7145cf511740614b4546bb"}
Sep 08 10:15:43.513903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:43.513867    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:43.514150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:43.514117    2582 patch_prober.go:28] interesting pod/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 10:15:43.514282 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:43.514183    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 10:15:44.514206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:44.514171    2582 patch_prober.go:28] interesting pod/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 10:15:44.514814 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:44.514775    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 10:15:45.514213 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:45.514175    2582 patch_prober.go:28] interesting pod/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 10:15:45.514801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:45.514770    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 10:15:46.521405 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:46.521357    2582 patch_prober.go:28] interesting pod/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 10:15:46.521950 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:46.521920    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 10:15:47.514371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:47.514331    2582 patch_prober.go:28] interesting pod/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body=
Sep 08 10:15:47.514657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:47.514626    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused"
Sep 08 10:15:48.518088 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:48.518052    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:48.518531 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:48.518361    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:48.519086 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:48.519070    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:51.240046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:51.240014    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"]
Sep 08 10:15:51.812964 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:51.812933    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"]
Sep 08 10:15:51.813220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:51.813187    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p" podUID="3a151479-8370-4ae6-b043-2e7f6a153fb8" containerName="payload-processing" containerID="cri-o://0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c" gracePeriod=30
Sep 08 10:15:51.822162 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:51.822137    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"]
Sep 08 10:15:51.822468 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:51.822421    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd" podUID="2341e35c-9a2b-416c-9c8b-66b8724d4472" containerName="payload-pre-processing" containerID="cri-o://711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103" gracePeriod=30
Sep 08 10:15:52.088004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.087983    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:52.090877 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.090858    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:52.171545 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.171522    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2341e35c-9a2b-416c-9c8b-66b8724d4472-plugins-config-volume\") pod \"2341e35c-9a2b-416c-9c8b-66b8724d4472\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") "
Sep 08 10:15:52.171737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.171634    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5994l\" (UniqueName: \"kubernetes.io/projected/2341e35c-9a2b-416c-9c8b-66b8724d4472-kube-api-access-5994l\") pod \"2341e35c-9a2b-416c-9c8b-66b8724d4472\" (UID: \"2341e35c-9a2b-416c-9c8b-66b8724d4472\") "
Sep 08 10:15:52.171737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.171692    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sfrwx\" (UniqueName: \"kubernetes.io/projected/3a151479-8370-4ae6-b043-2e7f6a153fb8-kube-api-access-sfrwx\") pod \"3a151479-8370-4ae6-b043-2e7f6a153fb8\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") "
Sep 08 10:15:52.171737 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.171713    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a151479-8370-4ae6-b043-2e7f6a153fb8-plugins-config-volume\") pod \"3a151479-8370-4ae6-b043-2e7f6a153fb8\" (UID: \"3a151479-8370-4ae6-b043-2e7f6a153fb8\") "
Sep 08 10:15:52.171971 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.171940    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2341e35c-9a2b-416c-9c8b-66b8724d4472-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2341e35c-9a2b-416c-9c8b-66b8724d4472" (UID: "2341e35c-9a2b-416c-9c8b-66b8724d4472"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:15:52.173065 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.172314    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a151479-8370-4ae6-b043-2e7f6a153fb8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3a151479-8370-4ae6-b043-2e7f6a153fb8" (UID: "3a151479-8370-4ae6-b043-2e7f6a153fb8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:15:52.173065 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.172400    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2341e35c-9a2b-416c-9c8b-66b8724d4472-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:52.175926 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.175819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2341e35c-9a2b-416c-9c8b-66b8724d4472-kube-api-access-5994l" (OuterVolumeSpecName: "kube-api-access-5994l") pod "2341e35c-9a2b-416c-9c8b-66b8724d4472" (UID: "2341e35c-9a2b-416c-9c8b-66b8724d4472"). InnerVolumeSpecName "kube-api-access-5994l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:15:52.180196 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.180154    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a151479-8370-4ae6-b043-2e7f6a153fb8-kube-api-access-sfrwx" (OuterVolumeSpecName: "kube-api-access-sfrwx") pod "3a151479-8370-4ae6-b043-2e7f6a153fb8" (UID: "3a151479-8370-4ae6-b043-2e7f6a153fb8"). InnerVolumeSpecName "kube-api-access-sfrwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:15:52.273743 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.273717    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5994l\" (UniqueName: \"kubernetes.io/projected/2341e35c-9a2b-416c-9c8b-66b8724d4472-kube-api-access-5994l\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:52.273743 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.273742    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sfrwx\" (UniqueName: \"kubernetes.io/projected/3a151479-8370-4ae6-b043-2e7f6a153fb8-kube-api-access-sfrwx\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:52.274078 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.273751    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a151479-8370-4ae6-b043-2e7f6a153fb8-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:52.549404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.549374    2582 generic.go:356] "Generic (PLEG): container finished" podID="3a151479-8370-4ae6-b043-2e7f6a153fb8" containerID="0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c" exitCode=0
Sep 08 10:15:52.549535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.549418    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"
Sep 08 10:15:52.549535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.549450    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p" event={"ID":"3a151479-8370-4ae6-b043-2e7f6a153fb8","Type":"ContainerDied","Data":"0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c"}
Sep 08 10:15:52.549535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.549499    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p" event={"ID":"3a151479-8370-4ae6-b043-2e7f6a153fb8","Type":"ContainerDied","Data":"0f4ff0fd9699c66a40b6ed48c1d2c6b6c8dc0b042875deac38cc16c987c555eb"}
Sep 08 10:15:52.549535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.549523    2582 scope.go:117] "RemoveContainer" containerID="0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c"
Sep 08 10:15:52.550757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.550737    2582 generic.go:356] "Generic (PLEG): container finished" podID="2341e35c-9a2b-416c-9c8b-66b8724d4472" containerID="711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103" exitCode=0
Sep 08 10:15:52.550839 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.550769    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"
Sep 08 10:15:52.550937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.550829    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd" event={"ID":"2341e35c-9a2b-416c-9c8b-66b8724d4472","Type":"ContainerDied","Data":"711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103"}
Sep 08 10:15:52.550937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.550880    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd" event={"ID":"2341e35c-9a2b-416c-9c8b-66b8724d4472","Type":"ContainerDied","Data":"9d3099e0e19dd6e6c3b5c9546a204946440836b06e5b3a8e1363122ef7657a3f"}
Sep 08 10:15:52.565309 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.565291    2582 scope.go:117] "RemoveContainer" containerID="0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c"
Sep 08 10:15:52.565569 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:15:52.565552    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c\": container with ID starting with 0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c not found: ID does not exist" containerID="0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c"
Sep 08 10:15:52.565626 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.565576    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c"} err="failed to get container status \"0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c\": rpc error: code = NotFound desc = could not find container \"0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c\": container with ID starting with 0860ca8b0de01cabdc648c1ed9f50298b0a2c99ca6549c8515015ca65b71ba4c not found: ID does not exist"
Sep 08 10:15:52.565626 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.565592    2582 scope.go:117] "RemoveContainer" containerID="711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103"
Sep 08 10:15:52.572898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.572875    2582 scope.go:117] "RemoveContainer" containerID="711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103"
Sep 08 10:15:52.573145 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:15:52.573129    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103\": container with ID starting with 711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103 not found: ID does not exist" containerID="711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103"
Sep 08 10:15:52.573207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.573150    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103"} err="failed to get container status \"711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103\": rpc error: code = NotFound desc = could not find container \"711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103\": container with ID starting with 711a35bbdb024bb139156f7bd55f64ab694b1cfa3883bea2fc317e9e29291103 not found: ID does not exist"
Sep 08 10:15:52.582670 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.582649    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"]
Sep 08 10:15:52.588760 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.588737    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f688fb08-886bd46cf-r8w6p"]
Sep 08 10:15:52.606430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.606403    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"]
Sep 08 10:15:52.612801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:52.612780    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f688fb08-7f947b85f8-fl5vd"]
Sep 08 10:15:53.910614 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:53.910582    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2341e35c-9a2b-416c-9c8b-66b8724d4472" path="/var/lib/kubelet/pods/2341e35c-9a2b-416c-9c8b-66b8724d4472/volumes"
Sep 08 10:15:53.910977 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:53.910960    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a151479-8370-4ae6-b043-2e7f6a153fb8" path="/var/lib/kubelet/pods/3a151479-8370-4ae6-b043-2e7f6a153fb8/volumes"
Sep 08 10:15:54.433238 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:54.433198    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"]
Sep 08 10:15:54.433425 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:54.433405    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy" containerID="cri-o://5f87eeb3cb88c4ee5c4bf98e684db7e3f41c8f78fa7145cf511740614b4546bb" gracePeriod=30
Sep 08 10:15:59.539158 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539127    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"]
Sep 08 10:15:59.539532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539519    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a151479-8370-4ae6-b043-2e7f6a153fb8" containerName="payload-processing"
Sep 08 10:15:59.539532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539533    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a151479-8370-4ae6-b043-2e7f6a153fb8" containerName="payload-processing"
Sep 08 10:15:59.539609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539543    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2341e35c-9a2b-416c-9c8b-66b8724d4472" containerName="payload-pre-processing"
Sep 08 10:15:59.539609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539549    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2341e35c-9a2b-416c-9c8b-66b8724d4472" containerName="payload-pre-processing"
Sep 08 10:15:59.539609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539603    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a151479-8370-4ae6-b043-2e7f6a153fb8" containerName="payload-processing"
Sep 08 10:15:59.539712 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.539613    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2341e35c-9a2b-416c-9c8b-66b8724d4472" containerName="payload-pre-processing"
Sep 08 10:15:59.542769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.541812    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.545402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.545381    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-057291ac\""
Sep 08 10:15:59.546401 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.546381    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-057291ac-dockercfg-lk2pp\""
Sep 08 10:15:59.555485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.555459    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"]
Sep 08 10:15:59.591403 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.591371    2582 generic.go:356] "Generic (PLEG): container finished" podID="fcbf67d9-f42c-4793-a01b-804799668f69" containerID="5f87eeb3cb88c4ee5c4bf98e684db7e3f41c8f78fa7145cf511740614b4546bb" exitCode=0
Sep 08 10:15:59.591560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.591445    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" event={"ID":"fcbf67d9-f42c-4793-a01b-804799668f69","Type":"ContainerDied","Data":"5f87eeb3cb88c4ee5c4bf98e684db7e3f41c8f78fa7145cf511740614b4546bb"}
Sep 08 10:15:59.591560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.591504    2582 scope.go:117] "RemoveContainer" containerID="baf7e680d5e9cae50e2e8c4aecdc63412507b8ae432cbae8d77d9a19bed429e0"
Sep 08 10:15:59.598430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.598408    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"]
Sep 08 10:15:59.601125 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.601102    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.615207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.614862    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"]
Sep 08 10:15:59.646528 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.645432    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4kh7\" (UniqueName: \"kubernetes.io/projected/42c2e8d7-8141-4793-946b-14aaa8b6405c-kube-api-access-n4kh7\") pod \"payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") " pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.646528 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.645506    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c2e8d7-8141-4793-946b-14aaa8b6405c-plugins-config-volume\") pod \"payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") " pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.685834 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.685812    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:15:59.746162 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.746091    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hp755\" (UniqueName: \"kubernetes.io/projected/2742d628-1b7f-45c5-b8f4-e252b05f6956-kube-api-access-hp755\") pod \"payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.746162 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.746138    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4kh7\" (UniqueName: \"kubernetes.io/projected/42c2e8d7-8141-4793-946b-14aaa8b6405c-kube-api-access-n4kh7\") pod \"payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") " pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.746162 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.746160    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2742d628-1b7f-45c5-b8f4-e252b05f6956-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.746386 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.746251    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c2e8d7-8141-4793-946b-14aaa8b6405c-plugins-config-volume\") pod \"payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") " pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.746878 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.746860    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c2e8d7-8141-4793-946b-14aaa8b6405c-plugins-config-volume\") pod \"payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") " pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.755732 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.755711    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4kh7\" (UniqueName: \"kubernetes.io/projected/42c2e8d7-8141-4793-946b-14aaa8b6405c-kube-api-access-n4kh7\") pod \"payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") " pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.847220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847193    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbf67d9-f42c-4793-a01b-804799668f69-istiod-ca-cert\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847290    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-istio-token\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847317    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbf67d9-f42c-4793-a01b-804799668f69-istio-podinfo\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847337    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-certs\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847378    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-envoy\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847608 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847409    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-credential-socket\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847608 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847444    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-data\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847608 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847525    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-socket\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847608 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847552    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qczcf\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-kube-api-access-qczcf\") pod \"fcbf67d9-f42c-4793-a01b-804799668f69\" (UID: \"fcbf67d9-f42c-4793-a01b-804799668f69\") "
Sep 08 10:15:59.847859 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847611    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcbf67d9-f42c-4793-a01b-804799668f69-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:15:59.847859 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847647    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:15:59.847859 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847755    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:15:59.848026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847867    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:15:59.848026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847883    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hp755\" (UniqueName: \"kubernetes.io/projected/2742d628-1b7f-45c5-b8f4-e252b05f6956-kube-api-access-hp755\") pod \"payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.848026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847930    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:15:59.848026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.847955    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2742d628-1b7f-45c5-b8f4-e252b05f6956-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.848246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.848037    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.848246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.848054    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.848246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.848068    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.848246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.848083    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.848246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.848096    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcbf67d9-f42c-4793-a01b-804799668f69-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.848804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.848782    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2742d628-1b7f-45c5-b8f4-e252b05f6956-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.849682 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.849661    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:15:59.849682 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.849669    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcbf67d9-f42c-4793-a01b-804799668f69-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:15:59.849873 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.849859    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:15:59.849964 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.849946    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-kube-api-access-qczcf" (OuterVolumeSpecName: "kube-api-access-qczcf") pod "fcbf67d9-f42c-4793-a01b-804799668f69" (UID: "fcbf67d9-f42c-4793-a01b-804799668f69"). InnerVolumeSpecName "kube-api-access-qczcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:15:59.853076 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.853061    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:15:59.857361 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.857342    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hp755\" (UniqueName: \"kubernetes.io/projected/2742d628-1b7f-45c5-b8f4-e252b05f6956-kube-api-access-hp755\") pod \"payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.913804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.913758    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:15:59.949179 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.949151    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qczcf\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-kube-api-access-qczcf\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.949179 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.949177    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcbf67d9-f42c-4793-a01b-804799668f69-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.949380 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.949192    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcbf67d9-f42c-4793-a01b-804799668f69-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:15:59.949380 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:15:59.949204    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcbf67d9-f42c-4793-a01b-804799668f69-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:00.123134 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.123108    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"]
Sep 08 10:16:00.124903 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:16:00.124870    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42c2e8d7_8141_4793_946b_14aaa8b6405c.slice/crio-5a67095f1a1d654f992b87ef482e8abd8a6f3b95a47e29084c928bfcbd7a2045 WatchSource:0}: Error finding container 5a67095f1a1d654f992b87ef482e8abd8a6f3b95a47e29084c928bfcbd7a2045: Status 404 returned error can't find the container with id 5a67095f1a1d654f992b87ef482e8abd8a6f3b95a47e29084c928bfcbd7a2045
Sep 08 10:16:00.189858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.189835    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"]
Sep 08 10:16:00.190743 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:16:00.190721    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2742d628_1b7f_45c5_b8f4_e252b05f6956.slice/crio-dcd54b3b2c2d4f1dcde4a0a7b1faf979043af26466d3285d63dd2fc504965592 WatchSource:0}: Error finding container dcd54b3b2c2d4f1dcde4a0a7b1faf979043af26466d3285d63dd2fc504965592: Status 404 returned error can't find the container with id dcd54b3b2c2d4f1dcde4a0a7b1faf979043af26466d3285d63dd2fc504965592
Sep 08 10:16:00.598471 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.598433    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69" event={"ID":"42c2e8d7-8141-4793-946b-14aaa8b6405c","Type":"ContainerStarted","Data":"2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9"}
Sep 08 10:16:00.598957 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.598508    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:16:00.598957 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.598534    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69" event={"ID":"42c2e8d7-8141-4793-946b-14aaa8b6405c","Type":"ContainerStarted","Data":"5a67095f1a1d654f992b87ef482e8abd8a6f3b95a47e29084c928bfcbd7a2045"}
Sep 08 10:16:00.600212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.600184    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb" event={"ID":"2742d628-1b7f-45c5-b8f4-e252b05f6956","Type":"ContainerStarted","Data":"70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190"}
Sep 08 10:16:00.600371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.600257    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb" event={"ID":"2742d628-1b7f-45c5-b8f4-e252b05f6956","Type":"ContainerStarted","Data":"dcd54b3b2c2d4f1dcde4a0a7b1faf979043af26466d3285d63dd2fc504965592"}
Sep 08 10:16:00.600371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.600291    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:16:00.602112 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.602091    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"
Sep 08 10:16:00.602209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.602134    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql" event={"ID":"fcbf67d9-f42c-4793-a01b-804799668f69","Type":"ContainerDied","Data":"bb17b31c846cbe8c348432a0eb48c5d1d3ece1ecc76719ccea0cc4392fd72698"}
Sep 08 10:16:00.602209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.602191    2582 scope.go:117] "RemoveContainer" containerID="5f87eeb3cb88c4ee5c4bf98e684db7e3f41c8f78fa7145cf511740614b4546bb"
Sep 08 10:16:00.617768 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.617726    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69" podStartSLOduration=1.617713451 podStartE2EDuration="1.617713451s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:16:00.615820601 +0000 UTC m=+871.192691061" watchObservedRunningTime="2026-09-08 10:16:00.617713451 +0000 UTC m=+871.194583891"
Sep 08 10:16:00.632791 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.632750    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb" podStartSLOduration=1.632739145 podStartE2EDuration="1.632739145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:15:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:16:00.631826102 +0000 UTC m=+871.208696544" watchObservedRunningTime="2026-09-08 10:16:00.632739145 +0000 UTC m=+871.209609585"
Sep 08 10:16:00.646273 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.646249    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"]
Sep 08 10:16:00.651903 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:00.651882    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-f688fb08-openshift-default-684fddd7cb-xlhql"]
Sep 08 10:16:01.910944 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:01.910909    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" path="/var/lib/kubelet/pods/fcbf67d9-f42c-4793-a01b-804799668f69/volumes"
Sep 08 10:16:04.077111 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.077082    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"]
Sep 08 10:16:04.077504 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.077336    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" podUID="3e2ae72b-1acc-4666-b84d-42efdb019c5d" containerName="maas-api" containerID="cri-o://2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28" gracePeriod=30
Sep 08 10:16:04.321929 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.321903    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:16:04.384979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.384917    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls\") pod \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") "
Sep 08 10:16:04.385089 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.384982    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2xgzg\" (UniqueName: \"kubernetes.io/projected/3e2ae72b-1acc-4666-b84d-42efdb019c5d-kube-api-access-2xgzg\") pod \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") "
Sep 08 10:16:04.385138 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.385080    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-metrics-certs\") pod \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") "
Sep 08 10:16:04.385138 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.385115    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ae72b-1acc-4666-b84d-42efdb019c5d-openshift-service-ca\") pod \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\" (UID: \"3e2ae72b-1acc-4666-b84d-42efdb019c5d\") "
Sep 08 10:16:04.385482 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.385459    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e2ae72b-1acc-4666-b84d-42efdb019c5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3e2ae72b-1acc-4666-b84d-42efdb019c5d" (UID: "3e2ae72b-1acc-4666-b84d-42efdb019c5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:16:04.387082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.387051    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3e2ae72b-1acc-4666-b84d-42efdb019c5d" (UID: "3e2ae72b-1acc-4666-b84d-42efdb019c5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:04.387082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.387061    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e2ae72b-1acc-4666-b84d-42efdb019c5d-kube-api-access-2xgzg" (OuterVolumeSpecName: "kube-api-access-2xgzg") pod "3e2ae72b-1acc-4666-b84d-42efdb019c5d" (UID: "3e2ae72b-1acc-4666-b84d-42efdb019c5d"). InnerVolumeSpecName "kube-api-access-2xgzg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:04.387205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.387085    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3e2ae72b-1acc-4666-b84d-42efdb019c5d" (UID: "3e2ae72b-1acc-4666-b84d-42efdb019c5d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:04.486378 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.486337    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2xgzg\" (UniqueName: \"kubernetes.io/projected/3e2ae72b-1acc-4666-b84d-42efdb019c5d-kube-api-access-2xgzg\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:04.486378 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.486366    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:04.486378 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.486378    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e2ae72b-1acc-4666-b84d-42efdb019c5d-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:04.486378 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.486387    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3e2ae72b-1acc-4666-b84d-42efdb019c5d-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:04.628298 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.628264    2582 generic.go:356] "Generic (PLEG): container finished" podID="3e2ae72b-1acc-4666-b84d-42efdb019c5d" containerID="2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28" exitCode=0
Sep 08 10:16:04.628431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.628309    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"
Sep 08 10:16:04.628431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.628325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" event={"ID":"3e2ae72b-1acc-4666-b84d-42efdb019c5d","Type":"ContainerDied","Data":"2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28"}
Sep 08 10:16:04.628431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.628368    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9" event={"ID":"3e2ae72b-1acc-4666-b84d-42efdb019c5d","Type":"ContainerDied","Data":"4cc5cf88c2f435092d020ae1d33ee7a40bbe4bc6aef524b8ac34e633608ba792"}
Sep 08 10:16:04.628431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.628389    2582 scope.go:117] "RemoveContainer" containerID="2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28"
Sep 08 10:16:04.637470 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.637453    2582 scope.go:117] "RemoveContainer" containerID="2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28"
Sep 08 10:16:04.637723 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:16:04.637704    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28\": container with ID starting with 2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28 not found: ID does not exist" containerID="2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28"
Sep 08 10:16:04.637776 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.637732    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28"} err="failed to get container status \"2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28\": rpc error: code = NotFound desc = could not find container \"2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28\": container with ID starting with 2871dec4d3875703c0b64ceb74c97c2c383f8b0f89d8a33b068b814e89b01a28 not found: ID does not exist"
Sep 08 10:16:04.649527 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.649508    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"]
Sep 08 10:16:04.655883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:04.655861    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-338aba-578f5fddf6-qvdl9"]
Sep 08 10:16:05.910003 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:05.909970    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e2ae72b-1acc-4666-b84d-42efdb019c5d" path="/var/lib/kubelet/pods/3e2ae72b-1acc-4666-b84d-42efdb019c5d/volumes"
Sep 08 10:16:06.259605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.259568    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw" podUID="a10a3ad9-8ee8-4534-ba18-84bb67dd8344" containerName="main" containerID="cri-o://3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f" gracePeriod=45
Sep 08 10:16:06.514673 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.514616    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:16:06.603680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.602829    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tmp-dir\") pod \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") "
Sep 08 10:16:06.603680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.602907    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-dshm\") pod \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") "
Sep 08 10:16:06.603680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.602941    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-model-cache\") pod \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") "
Sep 08 10:16:06.603680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.602983    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tls-certs\") pod \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") "
Sep 08 10:16:06.603680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.603052    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6q24h\" (UniqueName: \"kubernetes.io/projected/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-kube-api-access-6q24h\") pod \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") "
Sep 08 10:16:06.603680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.603093    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-home\") pod \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\" (UID: \"a10a3ad9-8ee8-4534-ba18-84bb67dd8344\") "
Sep 08 10:16:06.604054 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.603732    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-home" (OuterVolumeSpecName: "home") pod "a10a3ad9-8ee8-4534-ba18-84bb67dd8344" (UID: "a10a3ad9-8ee8-4534-ba18-84bb67dd8344"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:06.604054 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.603908    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "a10a3ad9-8ee8-4534-ba18-84bb67dd8344" (UID: "a10a3ad9-8ee8-4534-ba18-84bb67dd8344"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:06.606452 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.606423    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-model-cache" (OuterVolumeSpecName: "model-cache") pod "a10a3ad9-8ee8-4534-ba18-84bb67dd8344" (UID: "a10a3ad9-8ee8-4534-ba18-84bb67dd8344"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:06.608666 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.608634    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-dshm" (OuterVolumeSpecName: "dshm") pod "a10a3ad9-8ee8-4534-ba18-84bb67dd8344" (UID: "a10a3ad9-8ee8-4534-ba18-84bb67dd8344"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:06.609249 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.609193    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-kube-api-access-6q24h" (OuterVolumeSpecName: "kube-api-access-6q24h") pod "a10a3ad9-8ee8-4534-ba18-84bb67dd8344" (UID: "a10a3ad9-8ee8-4534-ba18-84bb67dd8344"). InnerVolumeSpecName "kube-api-access-6q24h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:06.609862 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.609841    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "a10a3ad9-8ee8-4534-ba18-84bb67dd8344" (UID: "a10a3ad9-8ee8-4534-ba18-84bb67dd8344"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:06.639902 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.639871    2582 generic.go:356] "Generic (PLEG): container finished" podID="a10a3ad9-8ee8-4534-ba18-84bb67dd8344" containerID="3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f" exitCode=0
Sep 08 10:16:06.639999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.639929    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"
Sep 08 10:16:06.639999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.639932    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw" event={"ID":"a10a3ad9-8ee8-4534-ba18-84bb67dd8344","Type":"ContainerDied","Data":"3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f"}
Sep 08 10:16:06.639999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.639969    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw" event={"ID":"a10a3ad9-8ee8-4534-ba18-84bb67dd8344","Type":"ContainerDied","Data":"4c08ca22732d9784742488262878b096ae15ef8013e184d125ae578a4203ed7d"}
Sep 08 10:16:06.639999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.639992    2582 scope.go:117] "RemoveContainer" containerID="3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f"
Sep 08 10:16:06.648268 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.648252    2582 scope.go:117] "RemoveContainer" containerID="3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f"
Sep 08 10:16:06.648599 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:16:06.648581    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f\": container with ID starting with 3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f not found: ID does not exist" containerID="3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f"
Sep 08 10:16:06.648677 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.648606    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f"} err="failed to get container status \"3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f\": rpc error: code = NotFound desc = could not find container \"3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f\": container with ID starting with 3469e7d4cf1afbdde00ca377c34ca62ffbedb31541ef4db8c23e4c4c2976811f not found: ID does not exist"
Sep 08 10:16:06.666698 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.666678    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"]
Sep 08 10:16:06.673614 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.673595    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-b-0170845d-kserve-6cd4b7d9c6-gwrlw"]
Sep 08 10:16:06.703963 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.703943    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-dshm\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.703963 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.703960    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-model-cache\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.704086 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.703970    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tls-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.704086 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.703978    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6q24h\" (UniqueName: \"kubernetes.io/projected/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-kube-api-access-6q24h\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.704086 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.703985    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-home\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:06.704086 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:06.703994    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a10a3ad9-8ee8-4534-ba18-84bb67dd8344-tmp-dir\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:07.911218 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:07.911193    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a10a3ad9-8ee8-4534-ba18-84bb67dd8344" path="/var/lib/kubelet/pods/a10a3ad9-8ee8-4534-ba18-84bb67dd8344/volumes"
Sep 08 10:16:11.611726 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.611690    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:16:11.612100 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.611850    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:16:11.902912 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.902825    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"]
Sep 08 10:16:11.903257 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903224    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e2ae72b-1acc-4666-b84d-42efdb019c5d" containerName="maas-api"
Sep 08 10:16:11.903357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903260    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e2ae72b-1acc-4666-b84d-42efdb019c5d" containerName="maas-api"
Sep 08 10:16:11.903357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903273    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a10a3ad9-8ee8-4534-ba18-84bb67dd8344" containerName="main"
Sep 08 10:16:11.903357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903281    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a10a3ad9-8ee8-4534-ba18-84bb67dd8344" containerName="main"
Sep 08 10:16:11.903357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903290    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy"
Sep 08 10:16:11.903357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903298    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy"
Sep 08 10:16:11.903610 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903396    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy"
Sep 08 10:16:11.903610 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903411    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e2ae72b-1acc-4666-b84d-42efdb019c5d" containerName="maas-api"
Sep 08 10:16:11.903610 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903424    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy"
Sep 08 10:16:11.903610 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.903435    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a10a3ad9-8ee8-4534-ba18-84bb67dd8344" containerName="main"
Sep 08 10:16:11.906451 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.906427    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.909245 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.909214    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-9c734c-openshift-default-dockercfg-x4p5w\""
Sep 08 10:16:11.918510 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.918487    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"]
Sep 08 10:16:11.949359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949325    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-token\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-envoy\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949430    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-podinfo\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5x7nw\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-kube-api-access-5x7nw\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949463    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044c4230-75a9-4974-a0e6-bea68f7a7063-istiod-ca-cert\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949495    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-data\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949523    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-certs\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949835 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-socket\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:11.949835 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:11.949588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-credential-socket\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050414    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044c4230-75a9-4974-a0e6-bea68f7a7063-istiod-ca-cert\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050462    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-data\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050486    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-certs\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050523    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-socket\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050542    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-credential-socket\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050598    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-token\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050638 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050637    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-envoy\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050987 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-podinfo\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050987 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050694    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5x7nw\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-kube-api-access-5x7nw\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.050987 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.050953    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-data\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.051288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.051253    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-certs\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.051432 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.051346    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044c4230-75a9-4974-a0e6-bea68f7a7063-istiod-ca-cert\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.051560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.051538    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-socket\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.051722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.051596    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-credential-socket\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.053678 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.053654    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-envoy\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.053857 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.053837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-podinfo\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.064025 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.063999    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5x7nw\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-kube-api-access-5x7nw\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.064171 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.064144    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-token\") pod \"e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") " pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.218541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.218511    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:12.491300 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.491273    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"]
Sep 08 10:16:12.493011 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:16:12.492979    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod044c4230_75a9_4974_a0e6_bea68f7a7063.slice/crio-fa81be606889285c74795534e004cb13478d9d7bb0dad385d826f86a9f063dd2 WatchSource:0}: Error finding container fa81be606889285c74795534e004cb13478d9d7bb0dad385d826f86a9f063dd2: Status 404 returned error can't find the container with id fa81be606889285c74795534e004cb13478d9d7bb0dad385d826f86a9f063dd2
Sep 08 10:16:12.495255 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.495209    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:16:12.495309 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.495288    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:16:12.495342 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.495317    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:16:12.674061 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.674025    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" event={"ID":"044c4230-75a9-4974-a0e6-bea68f7a7063","Type":"ContainerStarted","Data":"c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"}
Sep 08 10:16:12.674462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.674079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" event={"ID":"044c4230-75a9-4974-a0e6-bea68f7a7063","Type":"ContainerStarted","Data":"fa81be606889285c74795534e004cb13478d9d7bb0dad385d826f86a9f063dd2"}
Sep 08 10:16:12.701767 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:12.701721    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podStartSLOduration=1.701705403 podStartE2EDuration="1.701705403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:16:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:16:12.700028194 +0000 UTC m=+883.276898634" watchObservedRunningTime="2026-09-08 10:16:12.701705403 +0000 UTC m=+883.278575844"
Sep 08 10:16:13.218922 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:13.218885    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:13.223911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:13.223887    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:13.679819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:13.679787    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:13.680858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:13.680837    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:15.752664 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.752627    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"]
Sep 08 10:16:15.753045 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.753031    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy"
Sep 08 10:16:15.753098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.753046    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcbf67d9-f42c-4793-a01b-804799668f69" containerName="istio-proxy"
Sep 08 10:16:15.755193 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.755177    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.758042 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.758021    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w6wth\""
Sep 08 10:16:15.758768 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.758749    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-explicit-9c734c-serving-cert\""
Sep 08 10:16:15.758835 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.758756    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 10:16:15.772431 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.772406    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"]
Sep 08 10:16:15.784271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.784221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.784398 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.784378    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w6fw\" (UniqueName: \"kubernetes.io/projected/31694c7e-5ac6-4aec-8097-5481fcd55fc3-kube-api-access-2w6fw\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.784508 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.784492    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-metrics-certs\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.784628 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.784598    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31694c7e-5ac6-4aec-8097-5481fcd55fc3-openshift-service-ca\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.885391 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.885354    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w6fw\" (UniqueName: \"kubernetes.io/projected/31694c7e-5ac6-4aec-8097-5481fcd55fc3-kube-api-access-2w6fw\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.885564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.885408    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-metrics-certs\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.885564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.885459    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31694c7e-5ac6-4aec-8097-5481fcd55fc3-openshift-service-ca\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.885659 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.885590    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.885751 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:16:15.885732    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-serving-cert: secret "maas-api-e2e-explicit-9c734c-serving-cert" not found
Sep 08 10:16:15.885826 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:16:15.885813    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls podName:31694c7e-5ac6-4aec-8097-5481fcd55fc3 nodeName:}" failed. No retries permitted until 2026-09-08 10:16:16.385791246 +0000 UTC m=+886.962661684 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls") pod "maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" (UID: "31694c7e-5ac6-4aec-8097-5481fcd55fc3") : secret "maas-api-e2e-explicit-9c734c-serving-cert" not found
Sep 08 10:16:15.886154 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.886138    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31694c7e-5ac6-4aec-8097-5481fcd55fc3-openshift-service-ca\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.887936 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.887918    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-metrics-certs\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:15.896377 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:15.896347    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w6fw\" (UniqueName: \"kubernetes.io/projected/31694c7e-5ac6-4aec-8097-5481fcd55fc3-kube-api-access-2w6fw\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:16.390316 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:16.390284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:16.392645 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:16.392622    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls\") pod \"maas-api-e2e-explicit-9c734c-5655d86554-gcqrr\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") " pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:16.665902 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:16.665875    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:16.941510 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:16.941431    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"]
Sep 08 10:16:16.944682 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:16:16.944655    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31694c7e_5ac6_4aec_8097_5481fcd55fc3.slice/crio-408d49315ff24c117017b5df94cc130e636a8a6c1f4fde4ab41694a5f4f2a356 WatchSource:0}: Error finding container 408d49315ff24c117017b5df94cc130e636a8a6c1f4fde4ab41694a5f4f2a356: Status 404 returned error can't find the container with id 408d49315ff24c117017b5df94cc130e636a8a6c1f4fde4ab41694a5f4f2a356
Sep 08 10:16:17.707076 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:17.707043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" event={"ID":"31694c7e-5ac6-4aec-8097-5481fcd55fc3","Type":"ContainerStarted","Data":"c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee"}
Sep 08 10:16:17.707254 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:17.707095    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" event={"ID":"31694c7e-5ac6-4aec-8097-5481fcd55fc3","Type":"ContainerStarted","Data":"408d49315ff24c117017b5df94cc130e636a8a6c1f4fde4ab41694a5f4f2a356"}
Sep 08 10:16:17.707254 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:17.707181    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:17.730719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:17.730653    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" podStartSLOduration=2.186276531 podStartE2EDuration="2.730638624s" totalImagesPullingTime="544.362093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:16:17.728560922 +0000 UTC m=+888.305431363" watchObservedRunningTime="2026-09-08 10:16:17.730638624 +0000 UTC m=+888.307509064"
Sep 08 10:16:23.717818 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:23.717743    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:16:27.628875 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:27.628835    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"]
Sep 08 10:16:29.662819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:29.662785    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"]
Sep 08 10:16:29.663247 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:29.663029    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69" podUID="42c2e8d7-8141-4793-946b-14aaa8b6405c" containerName="payload-processing" containerID="cri-o://2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9" gracePeriod=30
Sep 08 10:16:29.672407 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:29.672361    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"]
Sep 08 10:16:29.672644 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:29.672566    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb" podUID="2742d628-1b7f-45c5-b8f4-e252b05f6956" containerName="payload-pre-processing" containerID="cri-o://70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190" gracePeriod=30
Sep 08 10:16:29.926400 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:29.926378    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:16:29.950207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:29.950180    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:16:30.008653 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.008623    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4kh7\" (UniqueName: \"kubernetes.io/projected/42c2e8d7-8141-4793-946b-14aaa8b6405c-kube-api-access-n4kh7\") pod \"42c2e8d7-8141-4793-946b-14aaa8b6405c\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") "
Sep 08 10:16:30.008805 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.008663    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c2e8d7-8141-4793-946b-14aaa8b6405c-plugins-config-volume\") pod \"42c2e8d7-8141-4793-946b-14aaa8b6405c\" (UID: \"42c2e8d7-8141-4793-946b-14aaa8b6405c\") "
Sep 08 10:16:30.008805 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.008712    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hp755\" (UniqueName: \"kubernetes.io/projected/2742d628-1b7f-45c5-b8f4-e252b05f6956-kube-api-access-hp755\") pod \"2742d628-1b7f-45c5-b8f4-e252b05f6956\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") "
Sep 08 10:16:30.008805 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.008776    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2742d628-1b7f-45c5-b8f4-e252b05f6956-plugins-config-volume\") pod \"2742d628-1b7f-45c5-b8f4-e252b05f6956\" (UID: \"2742d628-1b7f-45c5-b8f4-e252b05f6956\") "
Sep 08 10:16:30.009122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.009090    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/42c2e8d7-8141-4793-946b-14aaa8b6405c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "42c2e8d7-8141-4793-946b-14aaa8b6405c" (UID: "42c2e8d7-8141-4793-946b-14aaa8b6405c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:16:30.009253 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.009185    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2742d628-1b7f-45c5-b8f4-e252b05f6956-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2742d628-1b7f-45c5-b8f4-e252b05f6956" (UID: "2742d628-1b7f-45c5-b8f4-e252b05f6956"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:16:30.010730 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.010704    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42c2e8d7-8141-4793-946b-14aaa8b6405c-kube-api-access-n4kh7" (OuterVolumeSpecName: "kube-api-access-n4kh7") pod "42c2e8d7-8141-4793-946b-14aaa8b6405c" (UID: "42c2e8d7-8141-4793-946b-14aaa8b6405c"). InnerVolumeSpecName "kube-api-access-n4kh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:30.010832 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.010746    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2742d628-1b7f-45c5-b8f4-e252b05f6956-kube-api-access-hp755" (OuterVolumeSpecName: "kube-api-access-hp755") pod "2742d628-1b7f-45c5-b8f4-e252b05f6956" (UID: "2742d628-1b7f-45c5-b8f4-e252b05f6956"). InnerVolumeSpecName "kube-api-access-hp755". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:30.110543 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.110506    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2742d628-1b7f-45c5-b8f4-e252b05f6956-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:30.110543 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.110534    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4kh7\" (UniqueName: \"kubernetes.io/projected/42c2e8d7-8141-4793-946b-14aaa8b6405c-kube-api-access-n4kh7\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:30.110543 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.110545    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/42c2e8d7-8141-4793-946b-14aaa8b6405c-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:30.110769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.110555    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hp755\" (UniqueName: \"kubernetes.io/projected/2742d628-1b7f-45c5-b8f4-e252b05f6956-kube-api-access-hp755\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:30.771184 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.771149    2582 generic.go:356] "Generic (PLEG): container finished" podID="42c2e8d7-8141-4793-946b-14aaa8b6405c" containerID="2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9" exitCode=0
Sep 08 10:16:30.771618 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.771192    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"
Sep 08 10:16:30.771618 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.771243    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69" event={"ID":"42c2e8d7-8141-4793-946b-14aaa8b6405c","Type":"ContainerDied","Data":"2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9"}
Sep 08 10:16:30.771618 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.771301    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69" event={"ID":"42c2e8d7-8141-4793-946b-14aaa8b6405c","Type":"ContainerDied","Data":"5a67095f1a1d654f992b87ef482e8abd8a6f3b95a47e29084c928bfcbd7a2045"}
Sep 08 10:16:30.771618 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.771334    2582 scope.go:117] "RemoveContainer" containerID="2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9"
Sep 08 10:16:30.772668 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.772602    2582 generic.go:356] "Generic (PLEG): container finished" podID="2742d628-1b7f-45c5-b8f4-e252b05f6956" containerID="70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190" exitCode=0
Sep 08 10:16:30.772668 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.772653    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"
Sep 08 10:16:30.772794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.772657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb" event={"ID":"2742d628-1b7f-45c5-b8f4-e252b05f6956","Type":"ContainerDied","Data":"70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190"}
Sep 08 10:16:30.772794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.772776    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb" event={"ID":"2742d628-1b7f-45c5-b8f4-e252b05f6956","Type":"ContainerDied","Data":"dcd54b3b2c2d4f1dcde4a0a7b1faf979043af26466d3285d63dd2fc504965592"}
Sep 08 10:16:30.781011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.780938    2582 scope.go:117] "RemoveContainer" containerID="2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9"
Sep 08 10:16:30.781384 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:16:30.781358    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9\": container with ID starting with 2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9 not found: ID does not exist" containerID="2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9"
Sep 08 10:16:30.781467 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.781395    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9"} err="failed to get container status \"2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9\": rpc error: code = NotFound desc = could not find container \"2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9\": container with ID starting with 2afbaf8ebb009ef9e181aa5c50b9a88df90db0947b33b7d4aa88203f80e43df9 not found: ID does not exist"
Sep 08 10:16:30.781467 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.781413    2582 scope.go:117] "RemoveContainer" containerID="70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190"
Sep 08 10:16:30.789129 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.789113    2582 scope.go:117] "RemoveContainer" containerID="70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190"
Sep 08 10:16:30.789432 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:16:30.789416    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190\": container with ID starting with 70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190 not found: ID does not exist" containerID="70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190"
Sep 08 10:16:30.789487 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.789437    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190"} err="failed to get container status \"70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190\": rpc error: code = NotFound desc = could not find container \"70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190\": container with ID starting with 70f7a1f7cb8e8823d9256437f1c6f8d7ea9a236c7ecb04dac2380f1a4b796190 not found: ID does not exist"
Sep 08 10:16:30.797866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.797845    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"]
Sep 08 10:16:30.801757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.801738    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-057291ac-cc4b7fb97-sfx69"]
Sep 08 10:16:30.818070 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.818047    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"]
Sep 08 10:16:30.828269 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:30.828241    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-057291ac-5b4d867cf4-f2lkb"]
Sep 08 10:16:31.913736 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:31.913697    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2742d628-1b7f-45c5-b8f4-e252b05f6956" path="/var/lib/kubelet/pods/2742d628-1b7f-45c5-b8f4-e252b05f6956/volumes"
Sep 08 10:16:31.914829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:31.914807    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42c2e8d7-8141-4793-946b-14aaa8b6405c" path="/var/lib/kubelet/pods/42c2e8d7-8141-4793-946b-14aaa8b6405c/volumes"
Sep 08 10:16:39.821851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:39.821820    2582 generic.go:356] "Generic (PLEG): container finished" podID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerID="c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09" exitCode=0
Sep 08 10:16:39.822183 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:39.821890    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" event={"ID":"044c4230-75a9-4974-a0e6-bea68f7a7063","Type":"ContainerDied","Data":"c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"}
Sep 08 10:16:39.822290 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:39.822275    2582 scope.go:117] "RemoveContainer" containerID="c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"
Sep 08 10:16:39.823302 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:39.823273    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:16:39.823395 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:39.823340    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:16:39.823395 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:39.823372    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:16:40.828473 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:40.828438    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" event={"ID":"044c4230-75a9-4974-a0e6-bea68f7a7063","Type":"ContainerStarted","Data":"f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5"}
Sep 08 10:16:41.218913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:41.218873    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:41.220217 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:41.220192    2582 patch_prober.go:28] interesting pod/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 08 10:16:41.220359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:41.220259    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 08 10:16:42.218897 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:42.218862    2582 patch_prober.go:28] interesting pod/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 08 10:16:42.219316 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:42.218928    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 08 10:16:42.648685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:42.648596    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv" podUID="1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" containerName="main" containerID="cri-o://cceb0cb920fba87f410a265599191b1b585b73f495d36f21efb007e1887e62e1" gracePeriod=45
Sep 08 10:16:42.847496 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:42.847469    2582 generic.go:356] "Generic (PLEG): container finished" podID="1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" containerID="cceb0cb920fba87f410a265599191b1b585b73f495d36f21efb007e1887e62e1" exitCode=0
Sep 08 10:16:42.847694 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:42.847657    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv" event={"ID":"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a","Type":"ContainerDied","Data":"cceb0cb920fba87f410a265599191b1b585b73f495d36f21efb007e1887e62e1"}
Sep 08 10:16:42.937501 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:42.937477    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:16:43.025650 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025622    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27ttm\" (UniqueName: \"kubernetes.io/projected/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-kube-api-access-27ttm\") pod \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") "
Sep 08 10:16:43.025785 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025683    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-model-cache\") pod \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") "
Sep 08 10:16:43.025785 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tls-certs\") pod \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") "
Sep 08 10:16:43.025785 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025754    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-home\") pod \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") "
Sep 08 10:16:43.025785 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025784    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tmp-dir\") pod \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") "
Sep 08 10:16:43.026011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025812    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-dshm\") pod \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\" (UID: \"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a\") "
Sep 08 10:16:43.026011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.025929    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-model-cache" (OuterVolumeSpecName: "model-cache") pod "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" (UID: "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:43.026110 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.026000    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" (UID: "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:43.026110 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.026012    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-home" (OuterVolumeSpecName: "home") pod "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" (UID: "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:43.026256 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.026118    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-home\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:43.026256 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.026138    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tmp-dir\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:43.026256 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.026152    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-model-cache\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:43.027775 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.027753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-kube-api-access-27ttm" (OuterVolumeSpecName: "kube-api-access-27ttm") pod "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" (UID: "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a"). InnerVolumeSpecName "kube-api-access-27ttm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:16:43.027829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.027777    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" (UID: "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:16:43.027829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.027818    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-dshm" (OuterVolumeSpecName: "dshm") pod "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" (UID: "1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:16:43.127559 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.127536    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27ttm\" (UniqueName: \"kubernetes.io/projected/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-kube-api-access-27ttm\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:43.127559 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.127559    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-tls-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:43.127720 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.127570    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a-dshm\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:16:43.219868 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.219800    2582 patch_prober.go:28] interesting pod/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 08 10:16:43.219868 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.219857    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 08 10:16:43.680027 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.679995    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:43.854467 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.854432    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"
Sep 08 10:16:43.854650 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.854474    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv" event={"ID":"1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a","Type":"ContainerDied","Data":"16d3d9e755eb388583e791467e54c56424595cb52f4ee9b07154ecc870296d79"}
Sep 08 10:16:43.854650 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.854531    2582 scope.go:117] "RemoveContainer" containerID="cceb0cb920fba87f410a265599191b1b585b73f495d36f21efb007e1887e62e1"
Sep 08 10:16:43.876396 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.876374    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"]
Sep 08 10:16:43.880911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.880891    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-0170845d-kserve-7754488b78-lc2mv"]
Sep 08 10:16:43.913815 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:43.913780    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" path="/var/lib/kubelet/pods/1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a/volumes"
Sep 08 10:16:44.219691 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:44.219651    2582 patch_prober.go:28] interesting pod/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 08 10:16:44.219859 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:44.219722    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 08 10:16:45.219809 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:45.219778    2582 patch_prober.go:28] interesting pod/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 08 10:16:45.220222 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:45.219829    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 08 10:16:46.219754 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:46.219720    2582 patch_prober.go:28] interesting pod/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused" start-of-body=
Sep 08 10:16:46.219930 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:46.219776    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.43:15021/healthz/ready\": dial tcp 10.133.0.43:15021: connect: connection refused"
Sep 08 10:16:47.222766 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:47.222736    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:16:47.223705 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:16:47.223677    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:17:02.150053 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150017    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"]
Sep 08 10:17:02.150430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150365    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2742d628-1b7f-45c5-b8f4-e252b05f6956" containerName="payload-pre-processing"
Sep 08 10:17:02.150430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150376    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="2742d628-1b7f-45c5-b8f4-e252b05f6956" containerName="payload-pre-processing"
Sep 08 10:17:02.150430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150389    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" containerName="main"
Sep 08 10:17:02.150430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150395    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" containerName="main"
Sep 08 10:17:02.150430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150402    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42c2e8d7-8141-4793-946b-14aaa8b6405c" containerName="payload-processing"
Sep 08 10:17:02.150430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150408    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="42c2e8d7-8141-4793-946b-14aaa8b6405c" containerName="payload-processing"
Sep 08 10:17:02.150637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150463    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="2742d628-1b7f-45c5-b8f4-e252b05f6956" containerName="payload-pre-processing"
Sep 08 10:17:02.150637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150474    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d1d9a34-c61f-4c6f-b8ed-9017455d6a1a" containerName="main"
Sep 08 10:17:02.150637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.150481    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="42c2e8d7-8141-4793-946b-14aaa8b6405c" containerName="payload-processing"
Sep 08 10:17:02.153344 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.153328    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.156135 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.156113    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-9c734c\"/\"openshift-service-ca.crt\""
Sep 08 10:17:02.156366 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.156349    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-9c734c\"/\"default-dockercfg-78zzv\""
Sep 08 10:17:02.157098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.157081    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-9c734c\"/\"kube-root-ca.crt\""
Sep 08 10:17:02.157212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.157189    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-9c734c\"/\"explicit-model-9c734c-kserve-self-signed-certs\""
Sep 08 10:17:02.164559 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.164538    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"]
Sep 08 10:17:02.179971 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.179937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-dshm\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.180101 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.179987    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-model-cache\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.180101 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.180017    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tls-certs\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.180214 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.180107    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bstf\" (UniqueName: \"kubernetes.io/projected/95dec0db-a96f-4955-a8b3-8aca6a3817b4-kube-api-access-9bstf\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.180214 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.180168    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tmp-dir\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.180324 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.180242    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-home\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281514 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281485    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-dshm\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281522    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-model-cache\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281540    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tls-certs\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281567    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bstf\" (UniqueName: \"kubernetes.io/projected/95dec0db-a96f-4955-a8b3-8aca6a3817b4-kube-api-access-9bstf\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281600    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tmp-dir\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281814 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-home\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.281934 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281916    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-model-cache\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.282009 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281962    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-home\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.282009 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.281994    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tmp-dir\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.283607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.283590    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-dshm\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.283948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.283931    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tls-certs\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.290142 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.290119    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bstf\" (UniqueName: \"kubernetes.io/projected/95dec0db-a96f-4955-a8b3-8aca6a3817b4-kube-api-access-9bstf\") pod \"explicit-model-9c734c-kserve-866c65b767-r5s4f\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") " pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.462600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.462566    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:02.735296 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.735266    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"]
Sep 08 10:17:02.737047 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:17:02.737016    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95dec0db_a96f_4955_a8b3_8aca6a3817b4.slice/crio-44b08910d7540f29120c8c36a5274615e40c67d27c35f2c1d405464c075af4dc WatchSource:0}: Error finding container 44b08910d7540f29120c8c36a5274615e40c67d27c35f2c1d405464c075af4dc: Status 404 returned error can't find the container with id 44b08910d7540f29120c8c36a5274615e40c67d27c35f2c1d405464c075af4dc
Sep 08 10:17:02.944209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.944170    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f" event={"ID":"95dec0db-a96f-4955-a8b3-8aca6a3817b4","Type":"ContainerStarted","Data":"1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca"}
Sep 08 10:17:02.944370 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.944220    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f" event={"ID":"95dec0db-a96f-4955-a8b3-8aca6a3817b4","Type":"ContainerStarted","Data":"44b08910d7540f29120c8c36a5274615e40c67d27c35f2c1d405464c075af4dc"}
Sep 08 10:17:02.962385 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:02.962338    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f" podStartSLOduration=0.962322205 podStartE2EDuration="962.322205ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:02.960593152 +0000 UTC m=+933.537463593" watchObservedRunningTime="2026-09-08 10:17:02.962322205 +0000 UTC m=+933.539192686"
Sep 08 10:17:12.463142 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:12.463104    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:12.463620 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:12.463162    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:12.475094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:12.475070    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:13.003136 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:13.003108    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:35.403600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:35.403563    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"]
Sep 08 10:17:46.244127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.244096    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"]
Sep 08 10:17:46.244736 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.244312    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" podUID="31694c7e-5ac6-4aec-8097-5481fcd55fc3" containerName="maas-api" containerID="cri-o://c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee" gracePeriod=30
Sep 08 10:17:46.488582 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.488555    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:17:46.645697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.645597    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-metrics-certs\") pod \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") "
Sep 08 10:17:46.645697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.645658    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31694c7e-5ac6-4aec-8097-5481fcd55fc3-openshift-service-ca\") pod \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") "
Sep 08 10:17:46.645697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.645690    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls\") pod \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") "
Sep 08 10:17:46.646004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.645817    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w6fw\" (UniqueName: \"kubernetes.io/projected/31694c7e-5ac6-4aec-8097-5481fcd55fc3-kube-api-access-2w6fw\") pod \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\" (UID: \"31694c7e-5ac6-4aec-8097-5481fcd55fc3\") "
Sep 08 10:17:46.646167 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.646116    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31694c7e-5ac6-4aec-8097-5481fcd55fc3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "31694c7e-5ac6-4aec-8097-5481fcd55fc3" (UID: "31694c7e-5ac6-4aec-8097-5481fcd55fc3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:17:46.648629 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.648586    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "31694c7e-5ac6-4aec-8097-5481fcd55fc3" (UID: "31694c7e-5ac6-4aec-8097-5481fcd55fc3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:17:46.648754 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.648682    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31694c7e-5ac6-4aec-8097-5481fcd55fc3-kube-api-access-2w6fw" (OuterVolumeSpecName: "kube-api-access-2w6fw") pod "31694c7e-5ac6-4aec-8097-5481fcd55fc3" (UID: "31694c7e-5ac6-4aec-8097-5481fcd55fc3"). InnerVolumeSpecName "kube-api-access-2w6fw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:17:46.648754 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.648695    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "31694c7e-5ac6-4aec-8097-5481fcd55fc3" (UID: "31694c7e-5ac6-4aec-8097-5481fcd55fc3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:17:46.747205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.747176    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w6fw\" (UniqueName: \"kubernetes.io/projected/31694c7e-5ac6-4aec-8097-5481fcd55fc3-kube-api-access-2w6fw\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:46.747205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.747199    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:46.747205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.747209    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/31694c7e-5ac6-4aec-8097-5481fcd55fc3-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:46.747406 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:46.747217    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/31694c7e-5ac6-4aec-8097-5481fcd55fc3-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:47.147911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.147878    2582 generic.go:356] "Generic (PLEG): container finished" podID="31694c7e-5ac6-4aec-8097-5481fcd55fc3" containerID="c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee" exitCode=0
Sep 08 10:17:47.148161 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.147942    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"
Sep 08 10:17:47.148161 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.147966    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" event={"ID":"31694c7e-5ac6-4aec-8097-5481fcd55fc3","Type":"ContainerDied","Data":"c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee"}
Sep 08 10:17:47.148161 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.148046    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr" event={"ID":"31694c7e-5ac6-4aec-8097-5481fcd55fc3","Type":"ContainerDied","Data":"408d49315ff24c117017b5df94cc130e636a8a6c1f4fde4ab41694a5f4f2a356"}
Sep 08 10:17:47.148161 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.148068    2582 scope.go:117] "RemoveContainer" containerID="c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee"
Sep 08 10:17:47.158323 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.158301    2582 scope.go:117] "RemoveContainer" containerID="c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee"
Sep 08 10:17:47.158587 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:17:47.158567    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee\": container with ID starting with c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee not found: ID does not exist" containerID="c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee"
Sep 08 10:17:47.158641 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.158595    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee"} err="failed to get container status \"c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee\": rpc error: code = NotFound desc = could not find container \"c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee\": container with ID starting with c9cae382627b80c55c45ce134d328b2e45b7b4f2c3df00fb03ea38fb8e8f62ee not found: ID does not exist"
Sep 08 10:17:47.177933 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.177901    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"]
Sep 08 10:17:47.181319 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.181291    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-explicit-9c734c-5655d86554-gcqrr"]
Sep 08 10:17:47.909649 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:47.909609    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31694c7e-5ac6-4aec-8097-5481fcd55fc3" path="/var/lib/kubelet/pods/31694c7e-5ac6-4aec-8097-5481fcd55fc3/volumes"
Sep 08 10:17:50.422216 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.422162    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f" podUID="95dec0db-a96f-4955-a8b3-8aca6a3817b4" containerName="main" containerID="cri-o://1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca" gracePeriod=45
Sep 08 10:17:50.662832 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.662806    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:50.781417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781356    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bstf\" (UniqueName: \"kubernetes.io/projected/95dec0db-a96f-4955-a8b3-8aca6a3817b4-kube-api-access-9bstf\") pod \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") "
Sep 08 10:17:50.781417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781396    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tls-certs\") pod \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") "
Sep 08 10:17:50.781561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781429    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-model-cache\") pod \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") "
Sep 08 10:17:50.781561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781450    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-dshm\") pod \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") "
Sep 08 10:17:50.781561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781501    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-home\") pod \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") "
Sep 08 10:17:50.781561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781541    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tmp-dir\") pod \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\" (UID: \"95dec0db-a96f-4955-a8b3-8aca6a3817b4\") "
Sep 08 10:17:50.781821 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781745    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-model-cache" (OuterVolumeSpecName: "model-cache") pod "95dec0db-a96f-4955-a8b3-8aca6a3817b4" (UID: "95dec0db-a96f-4955-a8b3-8aca6a3817b4"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:17:50.781920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781815    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-home" (OuterVolumeSpecName: "home") pod "95dec0db-a96f-4955-a8b3-8aca6a3817b4" (UID: "95dec0db-a96f-4955-a8b3-8aca6a3817b4"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:17:50.781920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.781874    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "95dec0db-a96f-4955-a8b3-8aca6a3817b4" (UID: "95dec0db-a96f-4955-a8b3-8aca6a3817b4"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:17:50.783627 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.783604    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-dshm" (OuterVolumeSpecName: "dshm") pod "95dec0db-a96f-4955-a8b3-8aca6a3817b4" (UID: "95dec0db-a96f-4955-a8b3-8aca6a3817b4"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:17:50.783721 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.783666    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "95dec0db-a96f-4955-a8b3-8aca6a3817b4" (UID: "95dec0db-a96f-4955-a8b3-8aca6a3817b4"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:17:50.783780 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.783749    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95dec0db-a96f-4955-a8b3-8aca6a3817b4-kube-api-access-9bstf" (OuterVolumeSpecName: "kube-api-access-9bstf") pod "95dec0db-a96f-4955-a8b3-8aca6a3817b4" (UID: "95dec0db-a96f-4955-a8b3-8aca6a3817b4"). InnerVolumeSpecName "kube-api-access-9bstf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:17:50.882617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.882592    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-home\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:50.882617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.882612    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tmp-dir\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:50.882750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.882622    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bstf\" (UniqueName: \"kubernetes.io/projected/95dec0db-a96f-4955-a8b3-8aca6a3817b4-kube-api-access-9bstf\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:50.882750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.882630    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/95dec0db-a96f-4955-a8b3-8aca6a3817b4-tls-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:50.882750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.882639    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-model-cache\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:50.882750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:50.882646    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/95dec0db-a96f-4955-a8b3-8aca6a3817b4-dshm\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:17:51.167621 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.167592    2582 generic.go:356] "Generic (PLEG): container finished" podID="95dec0db-a96f-4955-a8b3-8aca6a3817b4" containerID="1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca" exitCode=0
Sep 08 10:17:51.167842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.167634    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"
Sep 08 10:17:51.167842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.167637    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f" event={"ID":"95dec0db-a96f-4955-a8b3-8aca6a3817b4","Type":"ContainerDied","Data":"1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca"}
Sep 08 10:17:51.167842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.167751    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f" event={"ID":"95dec0db-a96f-4955-a8b3-8aca6a3817b4","Type":"ContainerDied","Data":"44b08910d7540f29120c8c36a5274615e40c67d27c35f2c1d405464c075af4dc"}
Sep 08 10:17:51.167842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.167777    2582 scope.go:117] "RemoveContainer" containerID="1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca"
Sep 08 10:17:51.176890 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.176870    2582 scope.go:117] "RemoveContainer" containerID="1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca"
Sep 08 10:17:51.177141 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:17:51.177116    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca\": container with ID starting with 1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca not found: ID does not exist" containerID="1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca"
Sep 08 10:17:51.177188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.177150    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca"} err="failed to get container status \"1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca\": rpc error: code = NotFound desc = could not find container \"1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca\": container with ID starting with 1a4f23a07bd9f7d51cba5f13f821d8e4bbf610cfafdf88b118e3b47fd50e13ca not found: ID does not exist"
Sep 08 10:17:51.195118 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.195092    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"]
Sep 08 10:17:51.200216 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.200196    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-9c734c/explicit-model-9c734c-kserve-866c65b767-r5s4f"]
Sep 08 10:17:51.913434 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:51.911431    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95dec0db-a96f-4955-a8b3-8aca6a3817b4" path="/var/lib/kubelet/pods/95dec0db-a96f-4955-a8b3-8aca6a3817b4/volumes"
Sep 08 10:17:55.914375 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:55.914305    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"]
Sep 08 10:17:55.914731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:55.914517    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy" containerID="cri-o://f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5" gracePeriod=30
Sep 08 10:17:56.841332 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841299    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"]
Sep 08 10:17:56.841697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841678    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31694c7e-5ac6-4aec-8097-5481fcd55fc3" containerName="maas-api"
Sep 08 10:17:56.841796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841699    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="31694c7e-5ac6-4aec-8097-5481fcd55fc3" containerName="maas-api"
Sep 08 10:17:56.841796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841723    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95dec0db-a96f-4955-a8b3-8aca6a3817b4" containerName="main"
Sep 08 10:17:56.841796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841732    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="95dec0db-a96f-4955-a8b3-8aca6a3817b4" containerName="main"
Sep 08 10:17:56.841953 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841808    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="31694c7e-5ac6-4aec-8097-5481fcd55fc3" containerName="maas-api"
Sep 08 10:17:56.841953 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.841824    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="95dec0db-a96f-4955-a8b3-8aca6a3817b4" containerName="main"
Sep 08 10:17:56.852287 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.852264    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:56.855674 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.855654    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-738ee5-openshift-default-dockercfg-whb68\""
Sep 08 10:17:56.860379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:56.860280    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"]
Sep 08 10:17:57.030900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.030855    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istiod-ca-cert\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.030920    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-data\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.030958    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkmsb\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-kube-api-access-gkmsb\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.031002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-credential-socket\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.031180    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-socket\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.031277    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-podinfo\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.031351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-envoy\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031369 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.031372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-token\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.031647 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.031398    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-certs\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.132693 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132612    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-socket\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.132693 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132648    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-podinfo\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.132693 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132671    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-envoy\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.132693 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-token\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132714    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-certs\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132765    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istiod-ca-cert\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-data\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132848    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkmsb\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-kube-api-access-gkmsb\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.132874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-credential-socket\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133373 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.133046    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-socket\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133373 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.133163    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-data\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133373 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.133200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-certs\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133373 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.133360    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-credential-socket\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.133560 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.133543    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istiod-ca-cert\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.134987 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.134965    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-envoy\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.135216 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.135200    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-podinfo\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.144118 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.144094    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-token\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.144822 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.144806    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkmsb\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-kube-api-access-gkmsb\") pod \"e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") " pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.164727 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.164704    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:57.451452 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.451421    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"]
Sep 08 10:17:57.453095 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:17:57.453064    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea19fe8_b6c2_4f39_8c46_6baeee08d3a8.slice/crio-1e41e2d1d9abe239d25888344c1b327d52502b9fd14829d027b9ccaa0296431e WatchSource:0}: Error finding container 1e41e2d1d9abe239d25888344c1b327d52502b9fd14829d027b9ccaa0296431e: Status 404 returned error can't find the container with id 1e41e2d1d9abe239d25888344c1b327d52502b9fd14829d027b9ccaa0296431e
Sep 08 10:17:57.455343 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.455308    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:17:57.455448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.455387    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:17:57.455448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:57.455434    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:17:58.200798 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:58.200767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf" event={"ID":"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8","Type":"ContainerStarted","Data":"eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e"}
Sep 08 10:17:58.201158 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:58.200815    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf" event={"ID":"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8","Type":"ContainerStarted","Data":"1e41e2d1d9abe239d25888344c1b327d52502b9fd14829d027b9ccaa0296431e"}
Sep 08 10:17:58.251461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:58.251409    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf" podStartSLOduration=2.251390924 podStartE2EDuration="2.251390924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:17:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:17:58.250169507 +0000 UTC m=+988.827039970" watchObservedRunningTime="2026-09-08 10:17:58.251390924 +0000 UTC m=+988.828261366"
Sep 08 10:17:59.165210 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:59.165177    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:59.169976 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:59.169951    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:59.205784 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:59.205756    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:17:59.206720 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:17:59.206698    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:18:01.151459 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.151435    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:18:01.161824 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161799    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-socket\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.161945 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161833    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-podinfo\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.161945 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161874    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-data\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.161945 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161912    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5x7nw\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-kube-api-access-5x7nw\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.161945 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161928    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044c4230-75a9-4974-a0e6-bea68f7a7063-istiod-ca-cert\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.161945 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161944    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-credential-socket\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.162219 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.161971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-envoy\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.162219 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162017    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-token\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.162219 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162036    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:01.162219 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162052    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-certs\") pod \"044c4230-75a9-4974-a0e6-bea68f7a7063\" (UID: \"044c4230-75a9-4974-a0e6-bea68f7a7063\") "
Sep 08 10:18:01.162219 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162155    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-data" (OuterVolumeSpecName: "istio-data") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:01.162515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162360    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:01.162515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162427    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/044c4230-75a9-4974-a0e6-bea68f7a7063-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:18:01.162515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162458    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.162515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162477    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.162515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162491    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.162730 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.162614    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:01.164511 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.164485    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:18:01.164608 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.164506    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-kube-api-access-5x7nw" (OuterVolumeSpecName: "kube-api-access-5x7nw") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "kube-api-access-5x7nw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:18:01.164608 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.164596    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:01.164691 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.164619    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-token" (OuterVolumeSpecName: "istio-token") pod "044c4230-75a9-4974-a0e6-bea68f7a7063" (UID: "044c4230-75a9-4974-a0e6-bea68f7a7063"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:18:01.215967 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.215895    2582 generic.go:356] "Generic (PLEG): container finished" podID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerID="f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5" exitCode=0
Sep 08 10:18:01.215967 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.215939    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"
Sep 08 10:18:01.216155 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.215971    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" event={"ID":"044c4230-75a9-4974-a0e6-bea68f7a7063","Type":"ContainerDied","Data":"f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5"}
Sep 08 10:18:01.216155 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.216021    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh" event={"ID":"044c4230-75a9-4974-a0e6-bea68f7a7063","Type":"ContainerDied","Data":"fa81be606889285c74795534e004cb13478d9d7bb0dad385d826f86a9f063dd2"}
Sep 08 10:18:01.216155 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.216051    2582 scope.go:117] "RemoveContainer" containerID="f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5"
Sep 08 10:18:01.224777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.224758    2582 scope.go:117] "RemoveContainer" containerID="c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"
Sep 08 10:18:01.232205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.232189    2582 scope.go:117] "RemoveContainer" containerID="f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5"
Sep 08 10:18:01.232480 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:18:01.232463    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5\": container with ID starting with f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5 not found: ID does not exist" containerID="f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5"
Sep 08 10:18:01.232525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.232487    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5"} err="failed to get container status \"f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5\": rpc error: code = NotFound desc = could not find container \"f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5\": container with ID starting with f0dbbf002f1f32347bfb622cadcbe9be899d4342208ee702f7751efa438a9fe5 not found: ID does not exist"
Sep 08 10:18:01.232525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.232503    2582 scope.go:117] "RemoveContainer" containerID="c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"
Sep 08 10:18:01.232722 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:18:01.232707    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09\": container with ID starting with c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09 not found: ID does not exist" containerID="c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"
Sep 08 10:18:01.232766 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.232725    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09"} err="failed to get container status \"c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09\": rpc error: code = NotFound desc = could not find container \"c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09\": container with ID starting with c889bda8d2999955b4c48567dc8fb82700aa731881a45323b8d640f1e61e3c09 not found: ID does not exist"
Sep 08 10:18:01.239507 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.239486    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"]
Sep 08 10:18:01.246522 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.246502    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-9c734c-openshift-default-677dcb5b44-s56jh"]
Sep 08 10:18:01.263368 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.263343    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5x7nw\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-kube-api-access-5x7nw\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.263466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.263368    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/044c4230-75a9-4974-a0e6-bea68f7a7063-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.263466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.263385    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.263466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.263397    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.263466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.263409    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/044c4230-75a9-4974-a0e6-bea68f7a7063-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.263466 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.263422    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/044c4230-75a9-4974-a0e6-bea68f7a7063-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:01.915319 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:01.915286    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" path="/var/lib/kubelet/pods/044c4230-75a9-4974-a0e6-bea68f7a7063/volumes"
Sep 08 10:18:10.656763 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.656730    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"]
Sep 08 10:18:10.657195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.657059    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy"
Sep 08 10:18:10.657195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.657070    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy"
Sep 08 10:18:10.657195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.657081    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy"
Sep 08 10:18:10.657195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.657087    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy"
Sep 08 10:18:10.657195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.657136    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy"
Sep 08 10:18:10.657195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.657143    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="044c4230-75a9-4974-a0e6-bea68f7a7063" containerName="istio-proxy"
Sep 08 10:18:10.661474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.661458    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.664399 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.664378    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-0a3f5190-openshift-default-dockercfg-prdt4\""
Sep 08 10:18:10.683183 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.683158    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"]
Sep 08 10:18:10.733886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.733862    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3914c4c8-7e88-491d-899b-1cee36f24547-istiod-ca-cert\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.733980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.733894    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-credential-socket\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.733980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.733929    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tw7x\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-kube-api-access-9tw7x\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.734103 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.734028    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-certs\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.734103 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.734078    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-socket\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.734205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.734142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3914c4c8-7e88-491d-899b-1cee36f24547-istio-podinfo\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.734205 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.734178    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-envoy\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.734326 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.734214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-data\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.734326 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.734272    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-istio-token\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.835720 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.835678    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-certs\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.835898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.835726    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-socket\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.835898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.835857    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3914c4c8-7e88-491d-899b-1cee36f24547-istio-podinfo\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.835904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-envoy\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.835945    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-data\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.835973    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-istio-token\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3914c4c8-7e88-491d-899b-1cee36f24547-istiod-ca-cert\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836272 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-credential-socket\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836272 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-socket\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836272 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836097    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tw7x\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-kube-api-access-9tw7x\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836272 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836157    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-certs\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836464 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836365    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-data\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836464 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-credential-socket\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.836771 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.836723    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3914c4c8-7e88-491d-899b-1cee36f24547-istiod-ca-cert\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.838406 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.838382    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-envoy\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.838684 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.838665    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3914c4c8-7e88-491d-899b-1cee36f24547-istio-podinfo\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.855222 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.855187    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-istio-token\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.859957 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.859940    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tw7x\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-kube-api-access-9tw7x\") pod \"e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") " pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:10.971401 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:10.971364    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:11.252318 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:11.252295    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"]
Sep 08 10:18:11.254454 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:18:11.254424    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3914c4c8_7e88_491d_899b_1cee36f24547.slice/crio-89dd1e789ed3245f6cb6e233a9eb20f3deb66b3b1300f2f14cc19c7b26ea4c19 WatchSource:0}: Error finding container 89dd1e789ed3245f6cb6e233a9eb20f3deb66b3b1300f2f14cc19c7b26ea4c19: Status 404 returned error can't find the container with id 89dd1e789ed3245f6cb6e233a9eb20f3deb66b3b1300f2f14cc19c7b26ea4c19
Sep 08 10:18:11.256540 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:11.256508    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:18:11.256607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:11.256570    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:18:11.256607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:11.256599    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:18:11.262792 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:11.262762    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" event={"ID":"3914c4c8-7e88-491d-899b-1cee36f24547","Type":"ContainerStarted","Data":"89dd1e789ed3245f6cb6e233a9eb20f3deb66b3b1300f2f14cc19c7b26ea4c19"}
Sep 08 10:18:12.268624 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:12.268577    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" event={"ID":"3914c4c8-7e88-491d-899b-1cee36f24547","Type":"ContainerStarted","Data":"472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"}
Sep 08 10:18:12.305914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:12.305866    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podStartSLOduration=2.305849656 podStartE2EDuration="2.305849656s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:12.305068055 +0000 UTC m=+1002.881938497" watchObservedRunningTime="2026-09-08 10:18:12.305849656 +0000 UTC m=+1002.882720097"
Sep 08 10:18:12.972209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:12.972176    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:12.976923 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:12.976898    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:13.273150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:13.273081    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:13.273940 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:13.273921    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:16.929425 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.929395    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"]
Sep 08 10:18:16.932767 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.932749    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:16.945458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.945441    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-0a3f5190-dockercfg-5kh5j\""
Sep 08 10:18:16.945550 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.945469    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-0a3f5190\""
Sep 08 10:18:16.958405 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.958378    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"]
Sep 08 10:18:16.985116 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.985094    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c622b0d-cb56-46f9-b157-b7c09768c264-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:16.985223 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:16.985121    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wskdh\" (UniqueName: \"kubernetes.io/projected/9c622b0d-cb56-46f9-b157-b7c09768c264-kube-api-access-wskdh\") pod \"payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:17.086672 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.086639    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c622b0d-cb56-46f9-b157-b7c09768c264-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:17.086672 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.086686    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wskdh\" (UniqueName: \"kubernetes.io/projected/9c622b0d-cb56-46f9-b157-b7c09768c264-kube-api-access-wskdh\") pod \"payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:17.087342 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.087322    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c622b0d-cb56-46f9-b157-b7c09768c264-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:17.109080 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.109048    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"]
Sep 08 10:18:17.112509 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.112488    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.117195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.117175    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wskdh\" (UniqueName: \"kubernetes.io/projected/9c622b0d-cb56-46f9-b157-b7c09768c264-kube-api-access-wskdh\") pod \"payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:17.166775 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.166751    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"]
Sep 08 10:18:17.187971 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.187921    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkqfw\" (UniqueName: \"kubernetes.io/projected/b9d8a8da-c43a-4104-ba22-7249c85e96a2-kube-api-access-dkqfw\") pod \"payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") " pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.187971 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.187961    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d8a8da-c43a-4104-ba22-7249c85e96a2-plugins-config-volume\") pod \"payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") " pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.242977 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.242958    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:17.289430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.289396    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkqfw\" (UniqueName: \"kubernetes.io/projected/b9d8a8da-c43a-4104-ba22-7249c85e96a2-kube-api-access-dkqfw\") pod \"payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") " pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.289591 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.289454    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d8a8da-c43a-4104-ba22-7249c85e96a2-plugins-config-volume\") pod \"payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") " pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.290345 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.290320    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d8a8da-c43a-4104-ba22-7249c85e96a2-plugins-config-volume\") pod \"payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") " pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.337589 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.337559    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkqfw\" (UniqueName: \"kubernetes.io/projected/b9d8a8da-c43a-4104-ba22-7249c85e96a2-kube-api-access-dkqfw\") pod \"payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") " pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.430434 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.430400    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:17.610266 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.606937    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"]
Sep 08 10:18:17.715532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:17.715463    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"]
Sep 08 10:18:17.718583 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:18:17.718550    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d8a8da_c43a_4104_ba22_7249c85e96a2.slice/crio-47e2f43e45b6ca2969f83db2f51648db98dda058800c0f5863f46d396ed3dad7 WatchSource:0}: Error finding container 47e2f43e45b6ca2969f83db2f51648db98dda058800c0f5863f46d396ed3dad7: Status 404 returned error can't find the container with id 47e2f43e45b6ca2969f83db2f51648db98dda058800c0f5863f46d396ed3dad7
Sep 08 10:18:18.300055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.300020    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h" event={"ID":"9c622b0d-cb56-46f9-b157-b7c09768c264","Type":"ContainerStarted","Data":"41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313"}
Sep 08 10:18:18.300500 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.300076    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h" event={"ID":"9c622b0d-cb56-46f9-b157-b7c09768c264","Type":"ContainerStarted","Data":"cc13bb038e6e5fe999b621ae29b71b34ffea939cca3933756ec8ffd5fd0ca30e"}
Sep 08 10:18:18.300500 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.300103    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:18.301645 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.301621    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc" event={"ID":"b9d8a8da-c43a-4104-ba22-7249c85e96a2","Type":"ContainerStarted","Data":"406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8"}
Sep 08 10:18:18.301742 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.301672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:18.301742 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.301696    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc" event={"ID":"b9d8a8da-c43a-4104-ba22-7249c85e96a2","Type":"ContainerStarted","Data":"47e2f43e45b6ca2969f83db2f51648db98dda058800c0f5863f46d396ed3dad7"}
Sep 08 10:18:18.319536 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.319490    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h" podStartSLOduration=2.319476747 podStartE2EDuration="2.319476747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:18.31714057 +0000 UTC m=+1008.894011016" watchObservedRunningTime="2026-09-08 10:18:18.319476747 +0000 UTC m=+1008.896347188"
Sep 08 10:18:18.337015 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:18.336962    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc" podStartSLOduration=2.336948587 podStartE2EDuration="2.336948587s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:18:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:18:18.334523339 +0000 UTC m=+1008.911393779" watchObservedRunningTime="2026-09-08 10:18:18.336948587 +0000 UTC m=+1008.913819027"
Sep 08 10:18:29.311010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:29.310976    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:18:29.311829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:29.311812    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:18:32.475728 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:32.475688    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"]
Sep 08 10:18:32.476143 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:32.475966    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf" podUID="9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" containerName="istio-proxy" containerID="cri-o://eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e" gracePeriod=30
Sep 08 10:18:33.617764 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.617728    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"]
Sep 08 10:18:33.622538 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.622520    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:33.625310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.625287    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q7pww\""
Sep 08 10:18:33.634917 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.634894    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"]
Sep 08 10:18:33.744964 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.744931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe38c501-d47b-47de-a811-5a417e4972c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c28013-77gwv\" (UID: \"fe38c501-d47b-47de-a811-5a417e4972c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:33.846129 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.846101    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe38c501-d47b-47de-a811-5a417e4972c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c28013-77gwv\" (UID: \"fe38c501-d47b-47de-a811-5a417e4972c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:33.846686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.846663    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe38c501-d47b-47de-a811-5a417e4972c4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-c28013-77gwv\" (UID: \"fe38c501-d47b-47de-a811-5a417e4972c4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:33.933271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:33.933251    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:34.220436 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:34.220413    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"]
Sep 08 10:18:34.222917 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:18:34.222877    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe38c501_d47b_47de_a811_5a417e4972c4.slice/crio-54bb222e2369a04bfef39c84eaf9e4b93bba02eca84fd4fd3fc4f222f2f0273f WatchSource:0}: Error finding container 54bb222e2369a04bfef39c84eaf9e4b93bba02eca84fd4fd3fc4f222f2f0273f: Status 404 returned error can't find the container with id 54bb222e2369a04bfef39c84eaf9e4b93bba02eca84fd4fd3fc4f222f2f0273f
Sep 08 10:18:34.380607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:34.380571    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv" event={"ID":"fe38c501-d47b-47de-a811-5a417e4972c4","Type":"ContainerStarted","Data":"54bb222e2369a04bfef39c84eaf9e4b93bba02eca84fd4fd3fc4f222f2f0273f"}
Sep 08 10:18:35.387170 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.387142    2582 generic.go:356] "Generic (PLEG): container finished" podID="3914c4c8-7e88-491d-899b-1cee36f24547" containerID="472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c" exitCode=0
Sep 08 10:18:35.387651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.387214    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" event={"ID":"3914c4c8-7e88-491d-899b-1cee36f24547","Type":"ContainerDied","Data":"472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"}
Sep 08 10:18:35.387651 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.387613    2582 scope.go:117] "RemoveContainer" containerID="472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"
Sep 08 10:18:35.388696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.388660    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:18:35.388810 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.388737    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:18:35.388810 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.388768    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:18:35.388927 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.388854    2582 generic.go:356] "Generic (PLEG): container finished" podID="fe38c501-d47b-47de-a811-5a417e4972c4" containerID="feb4b524e41115dbed7d66a0ae9e6931f855766c0e695629ee26db8709750267" exitCode=0
Sep 08 10:18:35.388981 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:35.388924    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv" event={"ID":"fe38c501-d47b-47de-a811-5a417e4972c4","Type":"ContainerDied","Data":"feb4b524e41115dbed7d66a0ae9e6931f855766c0e695629ee26db8709750267"}
Sep 08 10:18:36.399173 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.399129    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" event={"ID":"3914c4c8-7e88-491d-899b-1cee36f24547","Type":"ContainerStarted","Data":"5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c"}
Sep 08 10:18:36.577877 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.577848    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:36.672430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.672395    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe38c501-d47b-47de-a811-5a417e4972c4-maas-api-service-ca\") pod \"fe38c501-d47b-47de-a811-5a417e4972c4\" (UID: \"fe38c501-d47b-47de-a811-5a417e4972c4\") "
Sep 08 10:18:36.672729 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.672706    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe38c501-d47b-47de-a811-5a417e4972c4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fe38c501-d47b-47de-a811-5a417e4972c4" (UID: "fe38c501-d47b-47de-a811-5a417e4972c4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:18:36.774039 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.774006    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe38c501-d47b-47de-a811-5a417e4972c4-maas-api-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:36.972443 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.972365    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:36.972586 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.972563    2582 patch_prober.go:28] interesting pod/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 10:18:36.972633 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:36.972616    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 10:18:37.418472 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.418438    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"
Sep 08 10:18:37.418916 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.418441    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv" event={"ID":"fe38c501-d47b-47de-a811-5a417e4972c4","Type":"ContainerDied","Data":"54bb222e2369a04bfef39c84eaf9e4b93bba02eca84fd4fd3fc4f222f2f0273f"}
Sep 08 10:18:37.418916 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.418614    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="54bb222e2369a04bfef39c84eaf9e4b93bba02eca84fd4fd3fc4f222f2f0273f"
Sep 08 10:18:37.750087 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.750065    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:18:37.884095 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884065    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gkmsb\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-kube-api-access-gkmsb\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884103    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-envoy\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884162    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-credential-socket\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884206    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-token\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884258    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-data\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884299 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884299    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istiod-ca-cert\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884593 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884348    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-podinfo\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884593 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884405    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-socket\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884593 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884440    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-certs\") pod \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\" (UID: \"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8\") "
Sep 08 10:18:37.884593 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884476    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:37.884804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884598    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-data" (OuterVolumeSpecName: "istio-data") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:37.884804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884662    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:18:37.884804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884773    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.884804 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884794    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.885015 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884808    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.885015 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884822    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:37.885015 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.884901    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:37.886395 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.886365    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-kube-api-access-gkmsb" (OuterVolumeSpecName: "kube-api-access-gkmsb") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "kube-api-access-gkmsb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:18:37.886488 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.886392    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:18:37.886488 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.886399    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:18:37.886488 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.886454    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-token" (OuterVolumeSpecName: "istio-token") pod "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" (UID: "9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:18:37.971960 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.971930    2582 patch_prober.go:28] interesting pod/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 10:18:37.972067 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.971979    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 10:18:37.985236 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.985167    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.985236 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.985188    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.985236 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.985198    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.985236 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.985207    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.985236 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.985217    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gkmsb\" (UniqueName: \"kubernetes.io/projected/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-kube-api-access-gkmsb\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:37.985236 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:37.985237    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:38.424692 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.424657    2582 generic.go:356] "Generic (PLEG): container finished" podID="9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" containerID="eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e" exitCode=0
Sep 08 10:18:38.425115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.424704    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"
Sep 08 10:18:38.425115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.424708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf" event={"ID":"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8","Type":"ContainerDied","Data":"eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e"}
Sep 08 10:18:38.425115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.424824    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf" event={"ID":"9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8","Type":"ContainerDied","Data":"1e41e2d1d9abe239d25888344c1b327d52502b9fd14829d027b9ccaa0296431e"}
Sep 08 10:18:38.425115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.424849    2582 scope.go:117] "RemoveContainer" containerID="eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e"
Sep 08 10:18:38.433270 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.433252    2582 scope.go:117] "RemoveContainer" containerID="eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e"
Sep 08 10:18:38.433527 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:18:38.433506    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e\": container with ID starting with eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e not found: ID does not exist" containerID="eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e"
Sep 08 10:18:38.433592 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.433539    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e"} err="failed to get container status \"eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e\": rpc error: code = NotFound desc = could not find container \"eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e\": container with ID starting with eb23133cdb6754efd2f8889fd7d7e332b4b3f56ecd094fa7dcc53ae564d0e93e not found: ID does not exist"
Sep 08 10:18:38.445919 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.445895    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"]
Sep 08 10:18:38.448189 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.448166    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-738ee5-openshift-default-6f565dc466-9jpzf"]
Sep 08 10:18:38.972459 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.972423    2582 patch_prober.go:28] interesting pod/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 10:18:38.972625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:38.972474    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 10:18:39.914060 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:39.914019    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" path="/var/lib/kubelet/pods/9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8/volumes"
Sep 08 10:18:39.972066 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:39.972037    2582 patch_prober.go:28] interesting pod/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 10:18:39.972189 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:39.972085    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 10:18:40.972470 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:40.972436    2582 patch_prober.go:28] interesting pod/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Sep 08 10:18:40.972860 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:40.972506    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Sep 08 10:18:42.121464 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:42.121422    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:42.122048 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:42.122025    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:42.123065 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:42.123040    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:18:44.765277 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:44.765248    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"]
Sep 08 10:18:44.771600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:44.771573    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-a-c28013-29814375-56vkc"]
Sep 08 10:18:45.193140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:45.193105    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"]
Sep 08 10:18:45.199935 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:45.199905    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-c28013-77gwv"]
Sep 08 10:18:45.909368 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:45.909335    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86a2fe41-e4a9-4e26-b268-1988accec7bd" path="/var/lib/kubelet/pods/86a2fe41-e4a9-4e26-b268-1988accec7bd/volumes"
Sep 08 10:18:45.909729 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:45.909628    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe38c501-d47b-47de-a811-5a417e4972c4" path="/var/lib/kubelet/pods/fe38c501-d47b-47de-a811-5a417e4972c4/volumes"
Sep 08 10:18:52.946696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.946661    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"]
Sep 08 10:18:52.947091 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.947019    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe38c501-d47b-47de-a811-5a417e4972c4" containerName="revoke-keys"
Sep 08 10:18:52.947091 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.947030    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe38c501-d47b-47de-a811-5a417e4972c4" containerName="revoke-keys"
Sep 08 10:18:52.947091 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.947042    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" containerName="istio-proxy"
Sep 08 10:18:52.947091 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.947048    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" containerName="istio-proxy"
Sep 08 10:18:52.947221 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.947110    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe38c501-d47b-47de-a811-5a417e4972c4" containerName="revoke-keys"
Sep 08 10:18:52.947221 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.947117    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ea19fe8-b6c2-4f39-8c46-6baeee08d3a8" containerName="istio-proxy"
Sep 08 10:18:52.951756 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.951736    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:52.956661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.956641    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q7pww\""
Sep 08 10:18:52.960410 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:52.960387    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"]
Sep 08 10:18:53.118082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:53.118048    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790e3be1-7d2f-4733-80d1-82b189340f6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb\" (UID: \"790e3be1-7d2f-4733-80d1-82b189340f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:53.218734 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:53.218635    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790e3be1-7d2f-4733-80d1-82b189340f6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb\" (UID: \"790e3be1-7d2f-4733-80d1-82b189340f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:53.219283 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:53.219263    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790e3be1-7d2f-4733-80d1-82b189340f6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb\" (UID: \"790e3be1-7d2f-4733-80d1-82b189340f6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:53.262606 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:53.262583    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:53.558358 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:53.558335    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"]
Sep 08 10:18:54.510863 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:54.510826    2582 generic.go:356] "Generic (PLEG): container finished" podID="790e3be1-7d2f-4733-80d1-82b189340f6e" containerID="578ab8ef73116335f4a62aa24dd516e1c70a4ba0caa8e40dd1a8e9417624a667" exitCode=0
Sep 08 10:18:54.511252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:54.510911    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb" event={"ID":"790e3be1-7d2f-4733-80d1-82b189340f6e","Type":"ContainerDied","Data":"578ab8ef73116335f4a62aa24dd516e1c70a4ba0caa8e40dd1a8e9417624a667"}
Sep 08 10:18:54.511252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:54.510967    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb" event={"ID":"790e3be1-7d2f-4733-80d1-82b189340f6e","Type":"ContainerStarted","Data":"e4c450ad82d35018ae1e5472176aa6759edb7db03157ee065e1ed8388ff0ec2e"}
Sep 08 10:18:55.639504 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:55.639481    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:55.736900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:55.736877    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790e3be1-7d2f-4733-80d1-82b189340f6e-maas-api-service-ca\") pod \"790e3be1-7d2f-4733-80d1-82b189340f6e\" (UID: \"790e3be1-7d2f-4733-80d1-82b189340f6e\") "
Sep 08 10:18:55.737182 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:55.737158    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/790e3be1-7d2f-4733-80d1-82b189340f6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "790e3be1-7d2f-4733-80d1-82b189340f6e" (UID: "790e3be1-7d2f-4733-80d1-82b189340f6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:18:55.837628 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:55.837554    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/790e3be1-7d2f-4733-80d1-82b189340f6e-maas-api-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:18:56.522347 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:56.522315    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"
Sep 08 10:18:56.522524 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:56.522357    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb" event={"ID":"790e3be1-7d2f-4733-80d1-82b189340f6e","Type":"ContainerDied","Data":"e4c450ad82d35018ae1e5472176aa6759edb7db03157ee065e1ed8388ff0ec2e"}
Sep 08 10:18:56.522524 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:18:56.522411    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4c450ad82d35018ae1e5472176aa6759edb7db03157ee065e1ed8388ff0ec2e"
Sep 08 10:19:03.655906 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.655872    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"]
Sep 08 10:19:03.656529 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.656071    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc" podUID="b9d8a8da-c43a-4104-ba22-7249c85e96a2" containerName="payload-processing" containerID="cri-o://406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8" gracePeriod=30
Sep 08 10:19:03.664886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.664862    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"]
Sep 08 10:19:03.665079 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.665044    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h" podUID="9c622b0d-cb56-46f9-b157-b7c09768c264" containerName="payload-pre-processing" containerID="cri-o://41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313" gracePeriod=30
Sep 08 10:19:03.694372 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.694339    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"]
Sep 08 10:19:03.700208 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.700183    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-9e365b-z85tb"]
Sep 08 10:19:03.910929 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.910899    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="790e3be1-7d2f-4733-80d1-82b189340f6e" path="/var/lib/kubelet/pods/790e3be1-7d2f-4733-80d1-82b189340f6e/volumes"
Sep 08 10:19:03.939583 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.939560    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:19:03.942622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:03.942601    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:19:04.006481 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.006451    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d8a8da-c43a-4104-ba22-7249c85e96a2-plugins-config-volume\") pod \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") "
Sep 08 10:19:04.006685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.006505    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c622b0d-cb56-46f9-b157-b7c09768c264-plugins-config-volume\") pod \"9c622b0d-cb56-46f9-b157-b7c09768c264\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") "
Sep 08 10:19:04.006685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.006532    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkqfw\" (UniqueName: \"kubernetes.io/projected/b9d8a8da-c43a-4104-ba22-7249c85e96a2-kube-api-access-dkqfw\") pod \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\" (UID: \"b9d8a8da-c43a-4104-ba22-7249c85e96a2\") "
Sep 08 10:19:04.006685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.006593    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wskdh\" (UniqueName: \"kubernetes.io/projected/9c622b0d-cb56-46f9-b157-b7c09768c264-kube-api-access-wskdh\") pod \"9c622b0d-cb56-46f9-b157-b7c09768c264\" (UID: \"9c622b0d-cb56-46f9-b157-b7c09768c264\") "
Sep 08 10:19:04.006923 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.006894    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9d8a8da-c43a-4104-ba22-7249c85e96a2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "b9d8a8da-c43a-4104-ba22-7249c85e96a2" (UID: "b9d8a8da-c43a-4104-ba22-7249c85e96a2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:19:04.007477 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.007394    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c622b0d-cb56-46f9-b157-b7c09768c264-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c622b0d-cb56-46f9-b157-b7c09768c264" (UID: "9c622b0d-cb56-46f9-b157-b7c09768c264"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:19:04.009368 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.009339    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c622b0d-cb56-46f9-b157-b7c09768c264-kube-api-access-wskdh" (OuterVolumeSpecName: "kube-api-access-wskdh") pod "9c622b0d-cb56-46f9-b157-b7c09768c264" (UID: "9c622b0d-cb56-46f9-b157-b7c09768c264"). InnerVolumeSpecName "kube-api-access-wskdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:19:04.009575 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.009548    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9d8a8da-c43a-4104-ba22-7249c85e96a2-kube-api-access-dkqfw" (OuterVolumeSpecName: "kube-api-access-dkqfw") pod "b9d8a8da-c43a-4104-ba22-7249c85e96a2" (UID: "b9d8a8da-c43a-4104-ba22-7249c85e96a2"). InnerVolumeSpecName "kube-api-access-dkqfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:19:04.108328 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.108294    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wskdh\" (UniqueName: \"kubernetes.io/projected/9c622b0d-cb56-46f9-b157-b7c09768c264-kube-api-access-wskdh\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:04.108328 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.108328    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b9d8a8da-c43a-4104-ba22-7249c85e96a2-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:04.108498 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.108342    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c622b0d-cb56-46f9-b157-b7c09768c264-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:04.108498 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.108356    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkqfw\" (UniqueName: \"kubernetes.io/projected/b9d8a8da-c43a-4104-ba22-7249c85e96a2-kube-api-access-dkqfw\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:04.564607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.564575    2582 generic.go:356] "Generic (PLEG): container finished" podID="9c622b0d-cb56-46f9-b157-b7c09768c264" containerID="41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313" exitCode=0
Sep 08 10:19:04.564760 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.564619    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"
Sep 08 10:19:04.564760 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.564663    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h" event={"ID":"9c622b0d-cb56-46f9-b157-b7c09768c264","Type":"ContainerDied","Data":"41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313"}
Sep 08 10:19:04.564760 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.564714    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h" event={"ID":"9c622b0d-cb56-46f9-b157-b7c09768c264","Type":"ContainerDied","Data":"cc13bb038e6e5fe999b621ae29b71b34ffea939cca3933756ec8ffd5fd0ca30e"}
Sep 08 10:19:04.564760 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.564735    2582 scope.go:117] "RemoveContainer" containerID="41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313"
Sep 08 10:19:04.565997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.565974    2582 generic.go:356] "Generic (PLEG): container finished" podID="b9d8a8da-c43a-4104-ba22-7249c85e96a2" containerID="406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8" exitCode=0
Sep 08 10:19:04.566098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.566019    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"
Sep 08 10:19:04.566098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.566030    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc" event={"ID":"b9d8a8da-c43a-4104-ba22-7249c85e96a2","Type":"ContainerDied","Data":"406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8"}
Sep 08 10:19:04.566098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.566071    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc" event={"ID":"b9d8a8da-c43a-4104-ba22-7249c85e96a2","Type":"ContainerDied","Data":"47e2f43e45b6ca2969f83db2f51648db98dda058800c0f5863f46d396ed3dad7"}
Sep 08 10:19:04.574617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.574601    2582 scope.go:117] "RemoveContainer" containerID="41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313"
Sep 08 10:19:04.574884 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:04.574864    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313\": container with ID starting with 41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313 not found: ID does not exist" containerID="41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313"
Sep 08 10:19:04.574937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.574891    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313"} err="failed to get container status \"41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313\": rpc error: code = NotFound desc = could not find container \"41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313\": container with ID starting with 41dc78f22cbf66ec15fe13c27d86a977fee8698bb40008a658f8c9ec109af313 not found: ID does not exist"
Sep 08 10:19:04.574937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.574906    2582 scope.go:117] "RemoveContainer" containerID="406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8"
Sep 08 10:19:04.582567 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.582550    2582 scope.go:117] "RemoveContainer" containerID="406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8"
Sep 08 10:19:04.582822 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:04.582803    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8\": container with ID starting with 406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8 not found: ID does not exist" containerID="406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8"
Sep 08 10:19:04.582871 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.582829    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8"} err="failed to get container status \"406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8\": rpc error: code = NotFound desc = could not find container \"406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8\": container with ID starting with 406adaf650774d0e2258c8cc80a1958f12c6a7d62c50835436aa5c81320c42b8 not found: ID does not exist"
Sep 08 10:19:04.585931 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.585914    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"]
Sep 08 10:19:04.593157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.593138    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-0a3f5190-db6d5fcfd-89n8h"]
Sep 08 10:19:04.603355 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.603338    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"]
Sep 08 10:19:04.607709 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:04.607691    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-0a3f5190-7fb8c66b49-pfcfc"]
Sep 08 10:19:05.909847 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:05.909814    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c622b0d-cb56-46f9-b157-b7c09768c264" path="/var/lib/kubelet/pods/9c622b0d-cb56-46f9-b157-b7c09768c264/volumes"
Sep 08 10:19:05.910213 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:05.910155    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9d8a8da-c43a-4104-ba22-7249c85e96a2" path="/var/lib/kubelet/pods/b9d8a8da-c43a-4104-ba22-7249c85e96a2/volumes"
Sep 08 10:19:10.574330 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:10.574294    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"]
Sep 08 10:19:10.574792 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:10.574549    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" containerID="cri-o://9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea" gracePeriod=30
Sep 08 10:19:11.037350 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:11.037318    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"]
Sep 08 10:19:11.037530 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:11.037508    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" containerID="cri-o://5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c" gracePeriod=30
Sep 08 10:19:12.124418 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:12.124377    2582 patch_prober.go:28] interesting pod/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 10:19:12.124796 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:12.124455    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 10:19:15.260533 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.260491    2582 patch_prober.go:28] interesting pod/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 10:19:15.260918 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.260570    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 10:19:15.823558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.823531    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:19:15.902535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902472    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-token\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902535 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902509    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bphb\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-kube-api-access-5bphb\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902735 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902543    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istiod-ca-cert\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902735 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902671    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-envoy\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902846 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902739    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-credential-socket\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902846 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902798    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-data\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-certs\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902877    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-socket\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.902948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902896    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:19:15.902948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.902915    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-podinfo\") pod \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\" (UID: \"5d527af3-67ac-4ab1-a3d1-ec24d4865b75\") "
Sep 08 10:19:15.903140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903025    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:15.903140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903036    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-data" (OuterVolumeSpecName: "istio-data") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:15.903283 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903197    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:15.903353 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903277    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:15.903353 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903291    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:15.903353 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903311    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:15.903353 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.903326    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:15.904707 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.904686    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-token" (OuterVolumeSpecName: "istio-token") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:19:15.905115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.905097    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-kube-api-access-5bphb" (OuterVolumeSpecName: "kube-api-access-5bphb") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "kube-api-access-5bphb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:19:15.905206 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.905105    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:15.905319 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:15.905303    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5d527af3-67ac-4ab1-a3d1-ec24d4865b75" (UID: "5d527af3-67ac-4ab1-a3d1-ec24d4865b75"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:19:16.003726 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.003703    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.003726 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.003724    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.003870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.003733    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.003870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.003742    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.003870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.003751    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.003870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.003760    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bphb\" (UniqueName: \"kubernetes.io/projected/5d527af3-67ac-4ab1-a3d1-ec24d4865b75-kube-api-access-5bphb\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.268744 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.268720    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:19:16.407561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407532    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-certs\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.407740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407582    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-credential-socket\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.407740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407608    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-socket\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.407740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407624    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-data\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.407740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407688    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9tw7x\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-kube-api-access-9tw7x\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.407740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407723    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3914c4c8-7e88-491d-899b-1cee36f24547-istiod-ca-cert\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.408032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407772    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3914c4c8-7e88-491d-899b-1cee36f24547-istio-podinfo\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.408032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407796    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-istio-token\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.408032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407823    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-envoy\") pod \"3914c4c8-7e88-491d-899b-1cee36f24547\" (UID: \"3914c4c8-7e88-491d-899b-1cee36f24547\") "
Sep 08 10:19:16.408032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407851    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:16.408032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:16.408032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.407965    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-data" (OuterVolumeSpecName: "istio-data") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:16.408450 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.408046    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:16.408450 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.408124    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.408450 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.408143    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.408450 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.408158    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.408450 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.408172    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.408779 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.408569    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3914c4c8-7e88-491d-899b-1cee36f24547-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:19:16.410102 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.410077    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3914c4c8-7e88-491d-899b-1cee36f24547-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:19:16.410207 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.410151    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-istio-token" (OuterVolumeSpecName: "istio-token") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:19:16.410388 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.410369    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:19:16.410485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.410383    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-kube-api-access-9tw7x" (OuterVolumeSpecName: "kube-api-access-9tw7x") pod "3914c4c8-7e88-491d-899b-1cee36f24547" (UID: "3914c4c8-7e88-491d-899b-1cee36f24547"). InnerVolumeSpecName "kube-api-access-9tw7x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:19:16.420494 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420472    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"]
Sep 08 10:19:16.420823 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420811    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9d8a8da-c43a-4104-ba22-7249c85e96a2" containerName="payload-processing"
Sep 08 10:19:16.420866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420825    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9d8a8da-c43a-4104-ba22-7249c85e96a2" containerName="payload-processing"
Sep 08 10:19:16.420866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420837    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c622b0d-cb56-46f9-b157-b7c09768c264" containerName="payload-pre-processing"
Sep 08 10:19:16.420866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420842    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c622b0d-cb56-46f9-b157-b7c09768c264" containerName="payload-pre-processing"
Sep 08 10:19:16.420866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420848    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy"
Sep 08 10:19:16.420866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420854    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy"
Sep 08 10:19:16.420866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420862    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="790e3be1-7d2f-4733-80d1-82b189340f6e" containerName="revoke-keys"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420870    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="790e3be1-7d2f-4733-80d1-82b189340f6e" containerName="revoke-keys"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420878    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420883    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420895    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420900    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420906    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420913    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420964    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="790e3be1-7d2f-4733-80d1-82b189340f6e" containerName="revoke-keys"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420974    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420980    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420985    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9d8a8da-c43a-4104-ba22-7249c85e96a2" containerName="payload-processing"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420991    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c622b0d-cb56-46f9-b157-b7c09768c264" containerName="payload-pre-processing"
Sep 08 10:19:16.421046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.420997    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerName="istio-proxy"
Sep 08 10:19:16.424124 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.424108    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.426653 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.426631    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-71a7a1\""
Sep 08 10:19:16.439021 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.438999    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"]
Sep 08 10:19:16.509617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509553    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.509617 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509588    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dbwrz\" (UniqueName: \"kubernetes.io/projected/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-kube-api-access-dbwrz\") pod \"payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.509772 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509619    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9tw7x\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-kube-api-access-9tw7x\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.509772 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509631    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3914c4c8-7e88-491d-899b-1cee36f24547-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.509772 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509644    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3914c4c8-7e88-491d-899b-1cee36f24547-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.509772 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509655    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3914c4c8-7e88-491d-899b-1cee36f24547-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.509772 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.509664    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3914c4c8-7e88-491d-899b-1cee36f24547-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:19:16.610760 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.610732    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.610889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.610773    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dbwrz\" (UniqueName: \"kubernetes.io/projected/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-kube-api-access-dbwrz\") pod \"payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.611428 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.611410    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.619597 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.619572    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dbwrz\" (UniqueName: \"kubernetes.io/projected/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-kube-api-access-dbwrz\") pod \"payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:16.633476 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.633452    2582 generic.go:356] "Generic (PLEG): container finished" podID="3914c4c8-7e88-491d-899b-1cee36f24547" containerID="5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c" exitCode=0
Sep 08 10:19:16.633574 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.633496    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"
Sep 08 10:19:16.633574 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.633538    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" event={"ID":"3914c4c8-7e88-491d-899b-1cee36f24547","Type":"ContainerDied","Data":"5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c"}
Sep 08 10:19:16.633676 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.633597    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7" event={"ID":"3914c4c8-7e88-491d-899b-1cee36f24547","Type":"ContainerDied","Data":"89dd1e789ed3245f6cb6e233a9eb20f3deb66b3b1300f2f14cc19c7b26ea4c19"}
Sep 08 10:19:16.633676 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.633633    2582 scope.go:117] "RemoveContainer" containerID="5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c"
Sep 08 10:19:16.635298 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.635275    2582 generic.go:356] "Generic (PLEG): container finished" podID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" containerID="9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea" exitCode=0
Sep 08 10:19:16.635395 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.635311    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"
Sep 08 10:19:16.635395 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.635360    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" event={"ID":"5d527af3-67ac-4ab1-a3d1-ec24d4865b75","Type":"ContainerDied","Data":"9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea"}
Sep 08 10:19:16.635525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.635411    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6" event={"ID":"5d527af3-67ac-4ab1-a3d1-ec24d4865b75","Type":"ContainerDied","Data":"f3c8324aae3371a0bb98c4e6ce0215a4868290a8dbaef1847bd8eeed6a86dce4"}
Sep 08 10:19:16.645417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.645390    2582 scope.go:117] "RemoveContainer" containerID="472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"
Sep 08 10:19:16.652997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.652983    2582 scope.go:117] "RemoveContainer" containerID="5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c"
Sep 08 10:19:16.653286 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:16.653265    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c\": container with ID starting with 5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c not found: ID does not exist" containerID="5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c"
Sep 08 10:19:16.653335 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.653294    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c"} err="failed to get container status \"5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c\": rpc error: code = NotFound desc = could not find container \"5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c\": container with ID starting with 5b974d23af9873f5ed6d9f3d7b7190c30b405e5fa1c7437eeefa3c7d5587081c not found: ID does not exist"
Sep 08 10:19:16.653335 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.653311    2582 scope.go:117] "RemoveContainer" containerID="472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"
Sep 08 10:19:16.653559 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:16.653540    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c\": container with ID starting with 472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c not found: ID does not exist" containerID="472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"
Sep 08 10:19:16.653603 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.653565    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c"} err="failed to get container status \"472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c\": rpc error: code = NotFound desc = could not find container \"472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c\": container with ID starting with 472ac836633d8501b4607217ae5bd04f8f9bc48b98c01a0b9f985e3685fc002c not found: ID does not exist"
Sep 08 10:19:16.653603 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.653580    2582 scope.go:117] "RemoveContainer" containerID="9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea"
Sep 08 10:19:16.660814 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.660787    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"]
Sep 08 10:19:16.661273 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.661257    2582 scope.go:117] "RemoveContainer" containerID="d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"
Sep 08 10:19:16.670759 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.670740    2582 scope.go:117] "RemoveContainer" containerID="9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea"
Sep 08 10:19:16.671059 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:16.671040    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea\": container with ID starting with 9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea not found: ID does not exist" containerID="9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea"
Sep 08 10:19:16.671150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.671062    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea"} err="failed to get container status \"9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea\": rpc error: code = NotFound desc = could not find container \"9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea\": container with ID starting with 9c6aecbcef50b44a2a5da0c5a625b8eeb784c5bcedf33522ec3664ad91927aea not found: ID does not exist"
Sep 08 10:19:16.671150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.671075    2582 scope.go:117] "RemoveContainer" containerID="d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"
Sep 08 10:19:16.671331 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:16.671314    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4\": container with ID starting with d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4 not found: ID does not exist" containerID="d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"
Sep 08 10:19:16.671398 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.671334    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4"} err="failed to get container status \"d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4\": rpc error: code = NotFound desc = could not find container \"d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4\": container with ID starting with d8b12cb8080d99f15972e20132df5f5bcf6cd6e3edabb8c27360407e5c1b4ca4 not found: ID does not exist"
Sep 08 10:19:16.671883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.671861    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-0a3f5190-openshift-default-6f8f5674d8-rhpj7"]
Sep 08 10:19:16.686791 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.686768    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"]
Sep 08 10:19:16.689727 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.689707    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9e365b-openshift-default-5b8bf84696-h2nf6"]
Sep 08 10:19:16.733478 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:16.733459    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:17.005468 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.005443    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"]
Sep 08 10:19:17.007393 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:19:17.007364    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9edd88_0e0d_4ac1_8041_330fe95c8f51.slice/crio-53b9bc3ed3d60f12a3798ea809c49a045284cc4c7ac6e2e48f9a8456550605d4 WatchSource:0}: Error finding container 53b9bc3ed3d60f12a3798ea809c49a045284cc4c7ac6e2e48f9a8456550605d4: Status 404 returned error can't find the container with id 53b9bc3ed3d60f12a3798ea809c49a045284cc4c7ac6e2e48f9a8456550605d4
Sep 08 10:19:17.642983 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.642950    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs" event={"ID":"1f9edd88-0e0d-4ac1-8041-330fe95c8f51","Type":"ContainerStarted","Data":"130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1"}
Sep 08 10:19:17.643462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.643000    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs" event={"ID":"1f9edd88-0e0d-4ac1-8041-330fe95c8f51","Type":"ContainerStarted","Data":"53b9bc3ed3d60f12a3798ea809c49a045284cc4c7ac6e2e48f9a8456550605d4"}
Sep 08 10:19:17.643462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.643031    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:17.666657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.666607    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs" podStartSLOduration=1.6665916969999999 podStartE2EDuration="1.666591697s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:19:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:19:17.664679908 +0000 UTC m=+1068.241550349" watchObservedRunningTime="2026-09-08 10:19:17.666591697 +0000 UTC m=+1068.243462137"
Sep 08 10:19:17.909485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.909409    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" path="/var/lib/kubelet/pods/3914c4c8-7e88-491d-899b-1cee36f24547/volumes"
Sep 08 10:19:17.909819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:17.909806    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d527af3-67ac-4ab1-a3d1-ec24d4865b75" path="/var/lib/kubelet/pods/5d527af3-67ac-4ab1-a3d1-ec24d4865b75/volumes"
Sep 08 10:19:28.651928 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:28.651842    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:19:30.863174 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.863139    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"]
Sep 08 10:19:30.863659 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.863525    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3914c4c8-7e88-491d-899b-1cee36f24547" containerName="istio-proxy"
Sep 08 10:19:30.868043 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.868022    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:30.870679 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.870658    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-af58b2-serving-cert\""
Sep 08 10:19:30.871580 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.871562    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 10:19:30.871635 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.871565    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w6wth\""
Sep 08 10:19:30.881149 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:30.881122    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"]
Sep 08 10:19:31.025934 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.025899    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q27jv\" (UniqueName: \"kubernetes.io/projected/c4c9ab3d-0b25-4812-bd52-2e491f72c489-kube-api-access-q27jv\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.026085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.025969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c9ab3d-0b25-4812-bd52-2e491f72c489-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.026085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.025993    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.026085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.026022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.127088 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.127010    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c9ab3d-0b25-4812-bd52-2e491f72c489-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.127088 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.127043    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.127088 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.127069    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.127366 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:31.127168    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-serving-cert: secret "maas-api-e2e-shared-a-w2-af58b2-serving-cert" not found
Sep 08 10:19:31.127366 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:31.127253    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls podName:c4c9ab3d-0b25-4812-bd52-2e491f72c489 nodeName:}" failed. No retries permitted until 2026-09-08 10:19:31.627218446 +0000 UTC m=+1082.204088865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls") pod "maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" (UID: "c4c9ab3d-0b25-4812-bd52-2e491f72c489") : secret "maas-api-e2e-shared-a-w2-af58b2-serving-cert" not found
Sep 08 10:19:31.127366 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.127275    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q27jv\" (UniqueName: \"kubernetes.io/projected/c4c9ab3d-0b25-4812-bd52-2e491f72c489-kube-api-access-q27jv\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.127833 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.127816    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c9ab3d-0b25-4812-bd52-2e491f72c489-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.129481 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.129460    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.136825 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.136804    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q27jv\" (UniqueName: \"kubernetes.io/projected/c4c9ab3d-0b25-4812-bd52-2e491f72c489-kube-api-access-q27jv\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.631382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.631345    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.634650 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.634620    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:31.778402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:31.778360    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:32.053278 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:32.053254    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"]
Sep 08 10:19:32.054752 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:19:32.054728    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4c9ab3d_0b25_4812_bd52_2e491f72c489.slice/crio-30ecb15c3d08567b1ae2fe6c8909a4233441d44e06ab585c4e8aa47e11eec727 WatchSource:0}: Error finding container 30ecb15c3d08567b1ae2fe6c8909a4233441d44e06ab585c4e8aa47e11eec727: Status 404 returned error can't find the container with id 30ecb15c3d08567b1ae2fe6c8909a4233441d44e06ab585c4e8aa47e11eec727
Sep 08 10:19:32.056014 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:32.055997    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:19:32.714057 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:32.714019    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" event={"ID":"c4c9ab3d-0b25-4812-bd52-2e491f72c489","Type":"ContainerStarted","Data":"8953d7d2fca52508190d4637da64ba6ae267c132eeac1ce6ee2e16dfc2e9ea94"}
Sep 08 10:19:32.714222 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:32.714199    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:32.714322 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:32.714259    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" event={"ID":"c4c9ab3d-0b25-4812-bd52-2e491f72c489","Type":"ContainerStarted","Data":"30ecb15c3d08567b1ae2fe6c8909a4233441d44e06ab585c4e8aa47e11eec727"}
Sep 08 10:19:32.733973 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:32.733926    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" podStartSLOduration=2.293330595 podStartE2EDuration="2.733912159s" totalImagesPullingTime="440.581564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:19:32.732168736 +0000 UTC m=+1083.309039196" watchObservedRunningTime="2026-09-08 10:19:32.733912159 +0000 UTC m=+1083.310782599"
Sep 08 10:19:38.724195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:38.724166    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:19:44.802565 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.802530    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"]
Sep 08 10:19:44.805992 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.805969    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:44.808910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.808894    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-d6e53c-serving-cert\""
Sep 08 10:19:44.824271 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.824249    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"]
Sep 08 10:19:44.933280 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.933252    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g687p\" (UniqueName: \"kubernetes.io/projected/3c01553c-99be-48f6-a7d4-8ddc2d748a98-kube-api-access-g687p\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:44.933429 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.933303    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:44.933429 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.933386    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c01553c-99be-48f6-a7d4-8ddc2d748a98-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:44.933510 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:44.933436    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.034269 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.034223    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.034401 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.034285    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c01553c-99be-48f6-a7d4-8ddc2d748a98-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.034401 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.034331    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.034401 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.034367    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g687p\" (UniqueName: \"kubernetes.io/projected/3c01553c-99be-48f6-a7d4-8ddc2d748a98-kube-api-access-g687p\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.034574 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:45.034454    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-serving-cert: secret "maas-api-e2e-shared-b-w3-d6e53c-serving-cert" not found
Sep 08 10:19:45.034574 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:19:45.034521    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls podName:3c01553c-99be-48f6-a7d4-8ddc2d748a98 nodeName:}" failed. No retries permitted until 2026-09-08 10:19:45.53450365 +0000 UTC m=+1096.111374073 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls") pod "maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" (UID: "3c01553c-99be-48f6-a7d4-8ddc2d748a98") : secret "maas-api-e2e-shared-b-w3-d6e53c-serving-cert" not found
Sep 08 10:19:45.035038 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.035013    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c01553c-99be-48f6-a7d4-8ddc2d748a98-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.036605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.036588    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.048920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.048899    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g687p\" (UniqueName: \"kubernetes.io/projected/3c01553c-99be-48f6-a7d4-8ddc2d748a98-kube-api-access-g687p\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.537805 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.537769    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.540048 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.540026    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.715881 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.715847    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:45.995632 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:45.995607    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"]
Sep 08 10:19:45.997454 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:19:45.997425    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c01553c_99be_48f6_a7d4_8ddc2d748a98.slice/crio-23621e4a6ccae21cc077f8428aaa8563895202a7d14b64167e2121f668885fc4 WatchSource:0}: Error finding container 23621e4a6ccae21cc077f8428aaa8563895202a7d14b64167e2121f668885fc4: Status 404 returned error can't find the container with id 23621e4a6ccae21cc077f8428aaa8563895202a7d14b64167e2121f668885fc4
Sep 08 10:19:46.784166 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:46.784130    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" event={"ID":"3c01553c-99be-48f6-a7d4-8ddc2d748a98","Type":"ContainerStarted","Data":"54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c"}
Sep 08 10:19:46.784349 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:46.784191    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" event={"ID":"3c01553c-99be-48f6-a7d4-8ddc2d748a98","Type":"ContainerStarted","Data":"23621e4a6ccae21cc077f8428aaa8563895202a7d14b64167e2121f668885fc4"}
Sep 08 10:19:46.784349 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:46.784219    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:46.812014 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:46.811969    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" podStartSLOduration=2.442500531 podStartE2EDuration="2.811952402s" totalImagesPullingTime="369.451871ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:19:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:19:46.811682724 +0000 UTC m=+1097.388553166" watchObservedRunningTime="2026-09-08 10:19:46.811952402 +0000 UTC m=+1097.388822843"
Sep 08 10:19:52.794208 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:52.794180    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:19:55.305573 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.305540    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"]
Sep 08 10:19:55.312482 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.310777    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.314067 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.314043    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-37ed05-openshift-default-dockercfg-rc6ts\""
Sep 08 10:19:55.323889 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.323861    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"]
Sep 08 10:19:55.413498 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413461    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-istio-token\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.413774 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413524    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-certs\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.413774 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413556    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-data\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.413774 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413580    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5pks\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-kube-api-access-s5pks\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.413774 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efc3f280-2623-4c25-8eec-87008c695972-istiod-ca-cert\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.413774 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-socket\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.413774 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413753    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efc3f280-2623-4c25-8eec-87008c695972-istio-podinfo\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.414094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413779    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-envoy\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.414094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.413836    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-credential-socket\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514688 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514653    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-credential-socket\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514699    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-istio-token\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514744    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-certs\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514774    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-data\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514797    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5pks\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-kube-api-access-s5pks\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514846    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efc3f280-2623-4c25-8eec-87008c695972-istiod-ca-cert\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.514886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514874    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-socket\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514911    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efc3f280-2623-4c25-8eec-87008c695972-istio-podinfo\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.514942    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-envoy\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.515019    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-credential-socket\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515451 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.515426    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-certs\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515632 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.515455    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-data\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515762 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.515683    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-socket\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.515926 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.515905    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efc3f280-2623-4c25-8eec-87008c695972-istiod-ca-cert\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.517209 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.517182    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-envoy\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.517622 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.517605    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efc3f280-2623-4c25-8eec-87008c695972-istio-podinfo\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.526036 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.526014    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-istio-token\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.526900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.526883    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5pks\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-kube-api-access-s5pks\") pod \"e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") " pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.623180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.623088    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:55.902007 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.901979    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"]
Sep 08 10:19:55.903573 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:19:55.903550    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc3f280_2623_4c25_8eec_87008c695972.slice/crio-8002831076c0bee8bb312068d7dff993440c4d0f1c1a4f7eb587722253a55bfb WatchSource:0}: Error finding container 8002831076c0bee8bb312068d7dff993440c4d0f1c1a4f7eb587722253a55bfb: Status 404 returned error can't find the container with id 8002831076c0bee8bb312068d7dff993440c4d0f1c1a4f7eb587722253a55bfb
Sep 08 10:19:55.906033 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.905997    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:19:55.906117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.906062    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:19:55.906117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:55.906091    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:19:56.829365 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:56.829328    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" event={"ID":"efc3f280-2623-4c25-8eec-87008c695972","Type":"ContainerStarted","Data":"cab5774bf23684592766018c7314896d022b6485fda6152dbf776a27fe2a63e5"}
Sep 08 10:19:56.829857 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:56.829390    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" event={"ID":"efc3f280-2623-4c25-8eec-87008c695972","Type":"ContainerStarted","Data":"8002831076c0bee8bb312068d7dff993440c4d0f1c1a4f7eb587722253a55bfb"}
Sep 08 10:19:56.850707 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:56.850663    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podStartSLOduration=1.8506476269999999 podStartE2EDuration="1.850647627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:19:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:19:56.849615115 +0000 UTC m=+1107.426485571" watchObservedRunningTime="2026-09-08 10:19:56.850647627 +0000 UTC m=+1107.427518062"
Sep 08 10:19:57.623680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:57.623649    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:57.628417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:57.628393    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:57.835041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:57.834999    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:19:57.835942 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:19:57.835924    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:20:01.043663 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.043626    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"]
Sep 08 10:20:01.046969 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.046951    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.049561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.049536    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-37ed05-dockercfg-msj4r\""
Sep 08 10:20:01.049673 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.049595    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-37ed05\""
Sep 08 10:20:01.057933 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.057908    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"]
Sep 08 10:20:01.164648 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.164607    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7x2b\" (UniqueName: \"kubernetes.io/projected/7414839f-9f00-4681-87a1-12484860f674-kube-api-access-c7x2b\") pod \"payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.164821 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.164658    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7414839f-9f00-4681-87a1-12484860f674-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.265102 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.265073    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7x2b\" (UniqueName: \"kubernetes.io/projected/7414839f-9f00-4681-87a1-12484860f674-kube-api-access-c7x2b\") pod \"payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.265268 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.265120    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7414839f-9f00-4681-87a1-12484860f674-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.265756 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.265737    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7414839f-9f00-4681-87a1-12484860f674-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.274353 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.274330    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7x2b\" (UniqueName: \"kubernetes.io/projected/7414839f-9f00-4681-87a1-12484860f674-kube-api-access-c7x2b\") pod \"payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.358131 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.358067    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.630382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.630306    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"]
Sep 08 10:20:01.633636 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:20:01.633597    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7414839f_9f00_4681_87a1_12484860f674.slice/crio-8825f0e1d834e9eaa95bdb792f089133b5a323cac22176fb67d990d503588cb6 WatchSource:0}: Error finding container 8825f0e1d834e9eaa95bdb792f089133b5a323cac22176fb67d990d503588cb6: Status 404 returned error can't find the container with id 8825f0e1d834e9eaa95bdb792f089133b5a323cac22176fb67d990d503588cb6
Sep 08 10:20:01.855090 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.855051    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg" event={"ID":"7414839f-9f00-4681-87a1-12484860f674","Type":"ContainerStarted","Data":"c304f5404c8345de4028d5a2828673e80d5bfbb424e1c7f56feda895834532b6"}
Sep 08 10:20:01.855258 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.855117    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg" event={"ID":"7414839f-9f00-4681-87a1-12484860f674","Type":"ContainerStarted","Data":"8825f0e1d834e9eaa95bdb792f089133b5a323cac22176fb67d990d503588cb6"}
Sep 08 10:20:01.855258 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.855149    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:01.872188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:01.872141    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg" podStartSLOduration=0.872125081 podStartE2EDuration="872.125081ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:20:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:20:01.871262006 +0000 UTC m=+1112.448132446" watchObservedRunningTime="2026-09-08 10:20:01.872125081 +0000 UTC m=+1112.448995526"
Sep 08 10:20:12.862883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:12.862850    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:20:18.958523 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:18.958494    2582 generic.go:356] "Generic (PLEG): container finished" podID="efc3f280-2623-4c25-8eec-87008c695972" containerID="cab5774bf23684592766018c7314896d022b6485fda6152dbf776a27fe2a63e5" exitCode=0
Sep 08 10:20:18.958867 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:18.958566    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" event={"ID":"efc3f280-2623-4c25-8eec-87008c695972","Type":"ContainerDied","Data":"cab5774bf23684592766018c7314896d022b6485fda6152dbf776a27fe2a63e5"}
Sep 08 10:20:18.959024 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:18.959007    2582 scope.go:117] "RemoveContainer" containerID="cab5774bf23684592766018c7314896d022b6485fda6152dbf776a27fe2a63e5"
Sep 08 10:20:18.960106 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:18.960074    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:20:18.960288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:18.960160    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:20:18.960288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:18.960209    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:20:19.965644 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:19.965604    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" event={"ID":"efc3f280-2623-4c25-8eec-87008c695972","Type":"ContainerStarted","Data":"438d186942bb99beb0cd6eadc9cbc12afc4aad5d525ddfb91b84927794e9544d"}
Sep 08 10:20:20.623746 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:20.623561    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:20:20.630361 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:20.630294    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 10:20:20.630536 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:20.630463    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 10:20:21.624324 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:21.624289    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 10:20:21.624686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:21.624343    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 10:20:22.624090 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:22.624053    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 10:20:22.624279 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:22.624112    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 10:20:23.624461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:23.624423    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 10:20:23.624847 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:23.624482    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 10:20:24.624170 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:24.624135    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Sep 08 10:20:24.624352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:24.624194    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Sep 08 10:20:25.627980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:25.627949    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:20:25.628485 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:25.628213    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:20:25.628993 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:25.628976    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:20:41.193358 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.193325    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"]
Sep 08 10:20:41.197512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.197490    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.199754 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.199730    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8118c657-serving-cert\""
Sep 08 10:20:41.206005 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.205972    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-openshift-service-ca\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.206122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.206038    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-metrics-certs\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.206189 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.206135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xft7g\" (UniqueName: \"kubernetes.io/projected/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-kube-api-access-xft7g\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.206189 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.206164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.206899 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.206878    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"]
Sep 08 10:20:41.307110 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.307074    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-openshift-service-ca\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.307310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.307124    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-metrics-certs\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.307310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.307180    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xft7g\" (UniqueName: \"kubernetes.io/projected/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-kube-api-access-xft7g\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.307310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.307200    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.307477 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:20:41.307322    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-serving-cert: secret "maas-api-e2e-mt-8118c657-serving-cert" not found
Sep 08 10:20:41.307477 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:20:41.307409    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls podName:940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3 nodeName:}" failed. No retries permitted until 2026-09-08 10:20:41.807389146 +0000 UTC m=+1152.384259581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls") pod "maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" (UID: "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3") : secret "maas-api-e2e-mt-8118c657-serving-cert" not found
Sep 08 10:20:41.307932 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.307907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-openshift-service-ca\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.310593 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.310563    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-metrics-certs\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.316430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.316403    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xft7g\" (UniqueName: \"kubernetes.io/projected/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-kube-api-access-xft7g\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.811671 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.811633    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.814016 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.813982    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls\") pod \"maas-api-e2e-mt-8118c657-b44864f4c-gk4xv\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:41.896667 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.896637    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"]
Sep 08 10:20:41.899885 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.899871    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:41.902864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.902847    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8118c657\""
Sep 08 10:20:41.903001 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.902987    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8118c657-dockercfg-5s5nj\""
Sep 08 10:20:41.912372 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.912344    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qppf\" (UniqueName: \"kubernetes.io/projected/6498c796-cd28-42f8-bc13-ac22f0792307-kube-api-access-9qppf\") pod \"payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") " pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:41.912480 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.912395    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6498c796-cd28-42f8-bc13-ac22f0792307-plugins-config-volume\") pod \"payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") " pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:41.913053 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:41.913035    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"]
Sep 08 10:20:42.013348 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.013317    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6498c796-cd28-42f8-bc13-ac22f0792307-plugins-config-volume\") pod \"payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") " pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:42.013516 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.013417    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qppf\" (UniqueName: \"kubernetes.io/projected/6498c796-cd28-42f8-bc13-ac22f0792307-kube-api-access-9qppf\") pod \"payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") " pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:42.013992 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.013972    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6498c796-cd28-42f8-bc13-ac22f0792307-plugins-config-volume\") pod \"payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") " pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:42.022891 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.022865    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qppf\" (UniqueName: \"kubernetes.io/projected/6498c796-cd28-42f8-bc13-ac22f0792307-kube-api-access-9qppf\") pod \"payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") " pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:42.109179 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.109124    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:42.210610 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.210575    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:42.380073 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.380004    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"]
Sep 08 10:20:42.383342 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:20:42.383308    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod940d5e14_d8dd_421b_9d3b_3cfb0bfdcbe3.slice/crio-48e6a4ca325456653eb81a6f480c965538302b74b5f14f5cfb11815098528626 WatchSource:0}: Error finding container 48e6a4ca325456653eb81a6f480c965538302b74b5f14f5cfb11815098528626: Status 404 returned error can't find the container with id 48e6a4ca325456653eb81a6f480c965538302b74b5f14f5cfb11815098528626
Sep 08 10:20:42.482318 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:42.482298    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"]
Sep 08 10:20:42.484188 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:20:42.484163    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6498c796_cd28_42f8_bc13_ac22f0792307.slice/crio-e81719a117de28d88f6c2cc7400276fc4a1e753b945bf9f3c60ba15a9b7f2214 WatchSource:0}: Error finding container e81719a117de28d88f6c2cc7400276fc4a1e753b945bf9f3c60ba15a9b7f2214: Status 404 returned error can't find the container with id e81719a117de28d88f6c2cc7400276fc4a1e753b945bf9f3c60ba15a9b7f2214
Sep 08 10:20:43.077414 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:43.077376    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p" event={"ID":"6498c796-cd28-42f8-bc13-ac22f0792307","Type":"ContainerStarted","Data":"671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e"}
Sep 08 10:20:43.077580 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:43.077435    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p" event={"ID":"6498c796-cd28-42f8-bc13-ac22f0792307","Type":"ContainerStarted","Data":"e81719a117de28d88f6c2cc7400276fc4a1e753b945bf9f3c60ba15a9b7f2214"}
Sep 08 10:20:43.077580 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:43.077463    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:20:43.078559 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:43.078537    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" event={"ID":"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3","Type":"ContainerStarted","Data":"48e6a4ca325456653eb81a6f480c965538302b74b5f14f5cfb11815098528626"}
Sep 08 10:20:43.102511 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:43.102461    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p" podStartSLOduration=2.102446721 podStartE2EDuration="2.102446721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:20:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:20:43.101500574 +0000 UTC m=+1153.678371018" watchObservedRunningTime="2026-09-08 10:20:43.102446721 +0000 UTC m=+1153.679317215"
Sep 08 10:20:46.095553 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:46.095518    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" event={"ID":"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3","Type":"ContainerStarted","Data":"d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628"}
Sep 08 10:20:46.095955 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:46.095644    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:46.149037 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:46.148993    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" podStartSLOduration=2.391548273 podStartE2EDuration="5.148978665s" totalImagesPullingTime="2.757430392s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:20:46.142807307 +0000 UTC m=+1156.719677747" watchObservedRunningTime="2026-09-08 10:20:46.148978665 +0000 UTC m=+1156.725849107"
Sep 08 10:20:52.105870 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:52.105841    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:20:54.087636 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:20:54.087554    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:21:29.989614 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:21:29.989582    2582 scope.go:117] "RemoveContainer" containerID="c1b758658cf58b72458570a09fd73b6f6770199837423680d5554ea5da38b0a5"
Sep 08 10:21:29.997909 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:21:29.997871    2582 scope.go:117] "RemoveContainer" containerID="35f75e40f690eab071a6ac50134278c6b16fe3395c7892733c683c9c817db5c2"
Sep 08 10:22:15.735122 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:15.735089    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"]
Sep 08 10:22:15.735621 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:15.735294    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" podUID="940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" containerName="maas-api" containerID="cri-o://d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628" gracePeriod=30
Sep 08 10:22:15.795671 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:15.795627    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"]
Sep 08 10:22:15.796034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:15.795876    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p" podUID="6498c796-cd28-42f8-bc13-ac22f0792307" containerName="payload-processing" containerID="cri-o://671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e" gracePeriod=30
Sep 08 10:22:16.060486 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.060457    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:22:16.063197 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.063178    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:22:16.182748 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.182720    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-metrics-certs\") pod \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") "
Sep 08 10:22:16.182883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.182804    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xft7g\" (UniqueName: \"kubernetes.io/projected/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-kube-api-access-xft7g\") pod \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") "
Sep 08 10:22:16.182883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.182843    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-openshift-service-ca\") pod \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") "
Sep 08 10:22:16.182883 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.182869    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6498c796-cd28-42f8-bc13-ac22f0792307-plugins-config-volume\") pod \"6498c796-cd28-42f8-bc13-ac22f0792307\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") "
Sep 08 10:22:16.183051 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.182900    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qppf\" (UniqueName: \"kubernetes.io/projected/6498c796-cd28-42f8-bc13-ac22f0792307-kube-api-access-9qppf\") pod \"6498c796-cd28-42f8-bc13-ac22f0792307\" (UID: \"6498c796-cd28-42f8-bc13-ac22f0792307\") "
Sep 08 10:22:16.183051 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.182985    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls\") pod \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\" (UID: \"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3\") "
Sep 08 10:22:16.183333 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.183187    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" (UID: "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:22:16.183463 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.183412    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6498c796-cd28-42f8-bc13-ac22f0792307-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6498c796-cd28-42f8-bc13-ac22f0792307" (UID: "6498c796-cd28-42f8-bc13-ac22f0792307"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:22:16.185081 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.185056    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6498c796-cd28-42f8-bc13-ac22f0792307-kube-api-access-9qppf" (OuterVolumeSpecName: "kube-api-access-9qppf") pod "6498c796-cd28-42f8-bc13-ac22f0792307" (UID: "6498c796-cd28-42f8-bc13-ac22f0792307"). InnerVolumeSpecName "kube-api-access-9qppf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:22:16.185178 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.185066    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" (UID: "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:22:16.185311 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.185287    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" (UID: "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:22:16.185391 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.185308    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-kube-api-access-xft7g" (OuterVolumeSpecName: "kube-api-access-xft7g") pod "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" (UID: "940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3"). InnerVolumeSpecName "kube-api-access-xft7g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:22:16.284052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.283968    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:22:16.284052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.283996    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:22:16.284052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.284007    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xft7g\" (UniqueName: \"kubernetes.io/projected/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-kube-api-access-xft7g\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:22:16.284052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.284017    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:22:16.284052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.284026    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6498c796-cd28-42f8-bc13-ac22f0792307-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:22:16.284052 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.284035    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qppf\" (UniqueName: \"kubernetes.io/projected/6498c796-cd28-42f8-bc13-ac22f0792307-kube-api-access-9qppf\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:22:16.549488 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.549412    2582 generic.go:356] "Generic (PLEG): container finished" podID="6498c796-cd28-42f8-bc13-ac22f0792307" containerID="671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e" exitCode=0
Sep 08 10:22:16.549488 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.549457    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"
Sep 08 10:22:16.549697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.549504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p" event={"ID":"6498c796-cd28-42f8-bc13-ac22f0792307","Type":"ContainerDied","Data":"671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e"}
Sep 08 10:22:16.549697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.549556    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p" event={"ID":"6498c796-cd28-42f8-bc13-ac22f0792307","Type":"ContainerDied","Data":"e81719a117de28d88f6c2cc7400276fc4a1e753b945bf9f3c60ba15a9b7f2214"}
Sep 08 10:22:16.549697 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.549580    2582 scope.go:117] "RemoveContainer" containerID="671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e"
Sep 08 10:22:16.557671 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.557641    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" event={"ID":"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3","Type":"ContainerDied","Data":"d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628"}
Sep 08 10:22:16.557671 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.557654    2582 generic.go:356] "Generic (PLEG): container finished" podID="940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" containerID="d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628" exitCode=0
Sep 08 10:22:16.557830 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.557715    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv" event={"ID":"940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3","Type":"ContainerDied","Data":"48e6a4ca325456653eb81a6f480c965538302b74b5f14f5cfb11815098528626"}
Sep 08 10:22:16.557830 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.557731    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"
Sep 08 10:22:16.565703 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.565686    2582 scope.go:117] "RemoveContainer" containerID="671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e"
Sep 08 10:22:16.566010 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:22:16.565986    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e\": container with ID starting with 671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e not found: ID does not exist" containerID="671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e"
Sep 08 10:22:16.566098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.566015    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e"} err="failed to get container status \"671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e\": rpc error: code = NotFound desc = could not find container \"671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e\": container with ID starting with 671f9591ad582cc1835cef2101cb0b44866c8fbee25afdde43eea7fbe40a0f6e not found: ID does not exist"
Sep 08 10:22:16.566098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.566036    2582 scope.go:117] "RemoveContainer" containerID="d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628"
Sep 08 10:22:16.575861 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.575837    2582 scope.go:117] "RemoveContainer" containerID="d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628"
Sep 08 10:22:16.576407 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:22:16.576382    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628\": container with ID starting with d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628 not found: ID does not exist" containerID="d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628"
Sep 08 10:22:16.576498 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.576411    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628"} err="failed to get container status \"d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628\": rpc error: code = NotFound desc = could not find container \"d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628\": container with ID starting with d71cc041a913f13b69399bea1d7c73cffb42cd64cc44aa56bc85b80f9011d628 not found: ID does not exist"
Sep 08 10:22:16.577947 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.577927    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"]
Sep 08 10:22:16.580527 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.580507    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8118c657-76495fd4b9-fw85p"]
Sep 08 10:22:16.592162 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.592142    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"]
Sep 08 10:22:16.597048 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:16.597029    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8118c657-b44864f4c-gk4xv"]
Sep 08 10:22:17.909696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:17.909661    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6498c796-cd28-42f8-bc13-ac22f0792307" path="/var/lib/kubelet/pods/6498c796-cd28-42f8-bc13-ac22f0792307/volumes"
Sep 08 10:22:17.910061 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:22:17.910018    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" path="/var/lib/kubelet/pods/940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3/volumes"
Sep 08 10:24:07.487086 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487049    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"]
Sep 08 10:24:07.487532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487429    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" containerName="maas-api"
Sep 08 10:24:07.487532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487442    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" containerName="maas-api"
Sep 08 10:24:07.487532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487452    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6498c796-cd28-42f8-bc13-ac22f0792307" containerName="payload-processing"
Sep 08 10:24:07.487532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487459    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="6498c796-cd28-42f8-bc13-ac22f0792307" containerName="payload-processing"
Sep 08 10:24:07.487532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487528    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="6498c796-cd28-42f8-bc13-ac22f0792307" containerName="payload-processing"
Sep 08 10:24:07.487532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.487536    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="940d5e14-d8dd-421b-9d3b-3cfb0bfdcbe3" containerName="maas-api"
Sep 08 10:24:07.490345 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.490326    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.493129 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.493105    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-22af43-serving-cert\""
Sep 08 10:24:07.502740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.502716    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"]
Sep 08 10:24:07.569951 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.569919    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp6tn\" (UniqueName: \"kubernetes.io/projected/465015d6-c157-4a33-abe3-cb36c0ff17b8-kube-api-access-xp6tn\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.570123 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.569971    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-metrics-certs\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.570123 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.570042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.570123 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.570084    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465015d6-c157-4a33-abe3-cb36c0ff17b8-openshift-service-ca\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.671146 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.671113    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-metrics-certs\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.671324 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.671159    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.671324 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.671182    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465015d6-c157-4a33-abe3-cb36c0ff17b8-openshift-service-ca\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.671324 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.671218    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp6tn\" (UniqueName: \"kubernetes.io/projected/465015d6-c157-4a33-abe3-cb36c0ff17b8-kube-api-access-xp6tn\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.671324 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:24:07.671302    2582 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-serving-cert: secret "maas-api-e2e-api-a-22af43-serving-cert" not found
Sep 08 10:24:07.671461 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:24:07.671403    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls podName:465015d6-c157-4a33-abe3-cb36c0ff17b8 nodeName:}" failed. No retries permitted until 2026-09-08 10:24:08.171379817 +0000 UTC m=+1358.748250256 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls") pod "maas-api-e2e-api-a-22af43-5b97768595-j8ddv" (UID: "465015d6-c157-4a33-abe3-cb36c0ff17b8") : secret "maas-api-e2e-api-a-22af43-serving-cert" not found
Sep 08 10:24:07.671915 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.671885    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465015d6-c157-4a33-abe3-cb36c0ff17b8-openshift-service-ca\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.673724 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.673666    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-metrics-certs\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:07.685547 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:07.685528    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp6tn\" (UniqueName: \"kubernetes.io/projected/465015d6-c157-4a33-abe3-cb36c0ff17b8-kube-api-access-xp6tn\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:08.175174 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.175148    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:08.177367 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.177348    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls\") pod \"maas-api-e2e-api-a-22af43-5b97768595-j8ddv\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:08.253418 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.253390    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"]
Sep 08 10:24:08.256795 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.256780    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.259422 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.259401    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-22af43-dockercfg-42vhz\""
Sep 08 10:24:08.259532 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.259401    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-22af43\""
Sep 08 10:24:08.268758 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.268739    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"]
Sep 08 10:24:08.377337 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.377297    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdf1ce8-6e29-4165-9a95-5407cfa89234-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.377628 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.377599    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flfcn\" (UniqueName: \"kubernetes.io/projected/4fdf1ce8-6e29-4165-9a95-5407cfa89234-kube-api-access-flfcn\") pod \"payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.402011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.401984    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:08.478715 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.478689    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdf1ce8-6e29-4165-9a95-5407cfa89234-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.478839 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.478734    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flfcn\" (UniqueName: \"kubernetes.io/projected/4fdf1ce8-6e29-4165-9a95-5407cfa89234-kube-api-access-flfcn\") pod \"payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.479677 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.479651    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdf1ce8-6e29-4165-9a95-5407cfa89234-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.490283 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.490264    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flfcn\" (UniqueName: \"kubernetes.io/projected/4fdf1ce8-6e29-4165-9a95-5407cfa89234-kube-api-access-flfcn\") pod \"payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.566274 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.566215    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:08.678260 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.678213    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"]
Sep 08 10:24:08.679467 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:24:08.679436    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod465015d6_c157_4a33_abe3_cb36c0ff17b8.slice/crio-051658f23ae609fb0a4ebaf9a12d0a1eb0befb9a32f420e55793e8acc77aa077 WatchSource:0}: Error finding container 051658f23ae609fb0a4ebaf9a12d0a1eb0befb9a32f420e55793e8acc77aa077: Status 404 returned error can't find the container with id 051658f23ae609fb0a4ebaf9a12d0a1eb0befb9a32f420e55793e8acc77aa077
Sep 08 10:24:08.842443 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:08.842419    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"]
Sep 08 10:24:08.844740 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:24:08.844713    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fdf1ce8_6e29_4165_9a95_5407cfa89234.slice/crio-8668ea4d2b132965cdc72b105a70711b52c244a532c6f3e679cc707370c9a7e7 WatchSource:0}: Error finding container 8668ea4d2b132965cdc72b105a70711b52c244a532c6f3e679cc707370c9a7e7: Status 404 returned error can't find the container with id 8668ea4d2b132965cdc72b105a70711b52c244a532c6f3e679cc707370c9a7e7
Sep 08 10:24:09.106218 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:09.106112    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch" event={"ID":"4fdf1ce8-6e29-4165-9a95-5407cfa89234","Type":"ContainerStarted","Data":"0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1"}
Sep 08 10:24:09.106412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:09.106217    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch" event={"ID":"4fdf1ce8-6e29-4165-9a95-5407cfa89234","Type":"ContainerStarted","Data":"8668ea4d2b132965cdc72b105a70711b52c244a532c6f3e679cc707370c9a7e7"}
Sep 08 10:24:09.106412 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:09.106280    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:09.107378 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:09.107351    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv" event={"ID":"465015d6-c157-4a33-abe3-cb36c0ff17b8","Type":"ContainerStarted","Data":"051658f23ae609fb0a4ebaf9a12d0a1eb0befb9a32f420e55793e8acc77aa077"}
Sep 08 10:24:09.123291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:09.123244    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch" podStartSLOduration=1.123221344 podStartE2EDuration="1.123221344s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:24:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:24:09.121382052 +0000 UTC m=+1359.698252495" watchObservedRunningTime="2026-09-08 10:24:09.123221344 +0000 UTC m=+1359.700091785"
Sep 08 10:24:10.113309 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:10.113200    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv" event={"ID":"465015d6-c157-4a33-abe3-cb36c0ff17b8","Type":"ContainerStarted","Data":"7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa"}
Sep 08 10:24:10.132365 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:10.132318    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv" podStartSLOduration=1.976268795 podStartE2EDuration="3.132303328s" totalImagesPullingTime="1.156034533s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:24:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:24:10.130152421 +0000 UTC m=+1360.707022863" watchObservedRunningTime="2026-09-08 10:24:10.132303328 +0000 UTC m=+1360.709173769"
Sep 08 10:24:11.118591 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:11.118560    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:17.127564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:17.127530    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:24:20.115325 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:20.115297    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:24:37.355343 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.355312    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"]
Sep 08 10:24:37.358747 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.358730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.361407 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.361384    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-9e30f6\""
Sep 08 10:24:37.370875 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.370851    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"]
Sep 08 10:24:37.417911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.417882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.418013 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.417924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2b9gp\" (UniqueName: \"kubernetes.io/projected/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-kube-api-access-2b9gp\") pod \"payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.519032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.518983    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.519264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.519038    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2b9gp\" (UniqueName: \"kubernetes.io/projected/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-kube-api-access-2b9gp\") pod \"payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.519699 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.519680    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.528242 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.528194    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2b9gp\" (UniqueName: \"kubernetes.io/projected/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-kube-api-access-2b9gp\") pod \"payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.669145 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.669122    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:37.940259 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:37.940220    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"]
Sep 08 10:24:37.941834 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:24:37.941808    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9222ddf_c7de_4f8b_b203_8d35ef3cc214.slice/crio-8d6ecb919fdb4853361f39e8011a61e01888cd9d52162fa231ad58d559cbed7c WatchSource:0}: Error finding container 8d6ecb919fdb4853361f39e8011a61e01888cd9d52162fa231ad58d559cbed7c: Status 404 returned error can't find the container with id 8d6ecb919fdb4853361f39e8011a61e01888cd9d52162fa231ad58d559cbed7c
Sep 08 10:24:38.243420 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:38.243336    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v" event={"ID":"a9222ddf-c7de-4f8b-b203-8d35ef3cc214","Type":"ContainerStarted","Data":"155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f"}
Sep 08 10:24:38.243420 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:38.243386    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v" event={"ID":"a9222ddf-c7de-4f8b-b203-8d35ef3cc214","Type":"ContainerStarted","Data":"8d6ecb919fdb4853361f39e8011a61e01888cd9d52162fa231ad58d559cbed7c"}
Sep 08 10:24:38.243847 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:38.243443    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:38.263858 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:38.263816    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v" podStartSLOduration=1.263803013 podStartE2EDuration="1.263803013s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:24:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:24:38.261936234 +0000 UTC m=+1388.838806676" watchObservedRunningTime="2026-09-08 10:24:38.263803013 +0000 UTC m=+1388.840673454"
Sep 08 10:24:39.835013 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.834979    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"]
Sep 08 10:24:39.838794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.838772    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:39.841275 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.841254    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6e53c\"/\"openshift-service-ca.crt\""
Sep 08 10:24:39.842144 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.842125    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6e53c\"/\"default-dockercfg-spwd4\""
Sep 08 10:24:39.842242 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.842145    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6e53c\"/\"sub-test-model-d6e53c-kserve-self-signed-certs\""
Sep 08 10:24:39.842242 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.842172    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-d6e53c\"/\"kube-root-ca.crt\""
Sep 08 10:24:39.847210 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.847189    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"]
Sep 08 10:24:39.935898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.935873    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-model-cache\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:39.936026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.935903    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-home\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:39.936026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.935931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-tmp-dir\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:39.936026 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.936002    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-dshm\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:39.936144 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.936054    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03472afb-f705-43e6-97c5-4d3cc7660bb9-tls-certs\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:39.936144 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:39.936088    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz98w\" (UniqueName: \"kubernetes.io/projected/03472afb-f705-43e6-97c5-4d3cc7660bb9-kube-api-access-pz98w\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.036606 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036581    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-tmp-dir\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.036722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036619    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-dshm\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.036722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036641    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03472afb-f705-43e6-97c5-4d3cc7660bb9-tls-certs\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.036722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036668    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz98w\" (UniqueName: \"kubernetes.io/projected/03472afb-f705-43e6-97c5-4d3cc7660bb9-kube-api-access-pz98w\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.036895 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036782    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-model-cache\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.036895 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036815    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-home\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.037022 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.036998    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-tmp-dir\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.037105 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.037089    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-model-cache\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.037191 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.037167    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-home\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.038898 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.038877    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-dshm\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.039041 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.039022    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03472afb-f705-43e6-97c5-4d3cc7660bb9-tls-certs\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.044834 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.044817    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz98w\" (UniqueName: \"kubernetes.io/projected/03472afb-f705-43e6-97c5-4d3cc7660bb9-kube-api-access-pz98w\") pod \"sub-test-model-d6e53c-kserve-7c74d88755-ztwf4\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") " pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.148264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.148190    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:40.422738 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:40.422683    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"]
Sep 08 10:24:40.424973 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:24:40.424946    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03472afb_f705_43e6_97c5_4d3cc7660bb9.slice/crio-ff8ed5e3ec9c4b16d2ba3cbdd7764f9dcdc410e81478fdd90fc0c5af5a4fd0bb WatchSource:0}: Error finding container ff8ed5e3ec9c4b16d2ba3cbdd7764f9dcdc410e81478fdd90fc0c5af5a4fd0bb: Status 404 returned error can't find the container with id ff8ed5e3ec9c4b16d2ba3cbdd7764f9dcdc410e81478fdd90fc0c5af5a4fd0bb
Sep 08 10:24:41.258955 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:41.258918    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4" event={"ID":"03472afb-f705-43e6-97c5-4d3cc7660bb9","Type":"ContainerStarted","Data":"cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5"}
Sep 08 10:24:41.258955 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:41.258958    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4" event={"ID":"03472afb-f705-43e6-97c5-4d3cc7660bb9","Type":"ContainerStarted","Data":"ff8ed5e3ec9c4b16d2ba3cbdd7764f9dcdc410e81478fdd90fc0c5af5a4fd0bb"}
Sep 08 10:24:41.277719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:41.277669    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4" podStartSLOduration=2.277654978 podStartE2EDuration="2.277654978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:24:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:24:41.275990592 +0000 UTC m=+1391.852861034" watchObservedRunningTime="2026-09-08 10:24:41.277654978 +0000 UTC m=+1391.854525418"
Sep 08 10:24:49.250595 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:49.250567    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:24:50.149091 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:50.149053    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:50.149091 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:50.149095    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:50.161364 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:50.161345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:24:50.312670 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:24:50.312645    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:25:19.361573 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.361540    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"]
Sep 08 10:25:19.364032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.361758    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv" podUID="465015d6-c157-4a33-abe3-cb36c0ff17b8" containerName="maas-api" containerID="cri-o://7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa" gracePeriod=30
Sep 08 10:25:19.429032 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.429000    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"]
Sep 08 10:25:19.429308 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.429251    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch" podUID="4fdf1ce8-6e29-4165-9a95-5407cfa89234" containerName="payload-pre-processing" containerID="cri-o://0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1" gracePeriod=30
Sep 08 10:25:19.662540 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.662514    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:25:19.719159 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.719136    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:25:19.774200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.774170    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls\") pod \"465015d6-c157-4a33-abe3-cb36c0ff17b8\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") "
Sep 08 10:25:19.774357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.774218    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xp6tn\" (UniqueName: \"kubernetes.io/projected/465015d6-c157-4a33-abe3-cb36c0ff17b8-kube-api-access-xp6tn\") pod \"465015d6-c157-4a33-abe3-cb36c0ff17b8\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") "
Sep 08 10:25:19.774357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.774328    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465015d6-c157-4a33-abe3-cb36c0ff17b8-openshift-service-ca\") pod \"465015d6-c157-4a33-abe3-cb36c0ff17b8\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") "
Sep 08 10:25:19.774469 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.774382    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-metrics-certs\") pod \"465015d6-c157-4a33-abe3-cb36c0ff17b8\" (UID: \"465015d6-c157-4a33-abe3-cb36c0ff17b8\") "
Sep 08 10:25:19.774687 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.774653    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/465015d6-c157-4a33-abe3-cb36c0ff17b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "465015d6-c157-4a33-abe3-cb36c0ff17b8" (UID: "465015d6-c157-4a33-abe3-cb36c0ff17b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:25:19.776269 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.776220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "465015d6-c157-4a33-abe3-cb36c0ff17b8" (UID: "465015d6-c157-4a33-abe3-cb36c0ff17b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:25:19.776363 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.776293    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "465015d6-c157-4a33-abe3-cb36c0ff17b8" (UID: "465015d6-c157-4a33-abe3-cb36c0ff17b8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:25:19.776465 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.776449    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/465015d6-c157-4a33-abe3-cb36c0ff17b8-kube-api-access-xp6tn" (OuterVolumeSpecName: "kube-api-access-xp6tn") pod "465015d6-c157-4a33-abe3-cb36c0ff17b8" (UID: "465015d6-c157-4a33-abe3-cb36c0ff17b8"). InnerVolumeSpecName "kube-api-access-xp6tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:19.875377 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875349    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdf1ce8-6e29-4165-9a95-5407cfa89234-plugins-config-volume\") pod \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") "
Sep 08 10:25:19.875500 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875399    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-flfcn\" (UniqueName: \"kubernetes.io/projected/4fdf1ce8-6e29-4165-9a95-5407cfa89234-kube-api-access-flfcn\") pod \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\" (UID: \"4fdf1ce8-6e29-4165-9a95-5407cfa89234\") "
Sep 08 10:25:19.875640 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875623    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/465015d6-c157-4a33-abe3-cb36c0ff17b8-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:19.875686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875647    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:19.875686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875669    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/465015d6-c157-4a33-abe3-cb36c0ff17b8-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:19.875686 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875668    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fdf1ce8-6e29-4165-9a95-5407cfa89234-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4fdf1ce8-6e29-4165-9a95-5407cfa89234" (UID: "4fdf1ce8-6e29-4165-9a95-5407cfa89234"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:25:19.875797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.875681    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xp6tn\" (UniqueName: \"kubernetes.io/projected/465015d6-c157-4a33-abe3-cb36c0ff17b8-kube-api-access-xp6tn\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:19.877317 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.877297    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fdf1ce8-6e29-4165-9a95-5407cfa89234-kube-api-access-flfcn" (OuterVolumeSpecName: "kube-api-access-flfcn") pod "4fdf1ce8-6e29-4165-9a95-5407cfa89234" (UID: "4fdf1ce8-6e29-4165-9a95-5407cfa89234"). InnerVolumeSpecName "kube-api-access-flfcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:19.976490 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.976462    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-flfcn\" (UniqueName: \"kubernetes.io/projected/4fdf1ce8-6e29-4165-9a95-5407cfa89234-kube-api-access-flfcn\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:19.976490 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:19.976488    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fdf1ce8-6e29-4165-9a95-5407cfa89234-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:20.457684 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.457654    2582 generic.go:356] "Generic (PLEG): container finished" podID="465015d6-c157-4a33-abe3-cb36c0ff17b8" containerID="7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa" exitCode=0
Sep 08 10:25:20.458055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.457701    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"
Sep 08 10:25:20.458055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.457708    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv" event={"ID":"465015d6-c157-4a33-abe3-cb36c0ff17b8","Type":"ContainerDied","Data":"7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa"}
Sep 08 10:25:20.458055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.457767    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv" event={"ID":"465015d6-c157-4a33-abe3-cb36c0ff17b8","Type":"ContainerDied","Data":"051658f23ae609fb0a4ebaf9a12d0a1eb0befb9a32f420e55793e8acc77aa077"}
Sep 08 10:25:20.458055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.457797    2582 scope.go:117] "RemoveContainer" containerID="7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa"
Sep 08 10:25:20.459280 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.459260    2582 generic.go:356] "Generic (PLEG): container finished" podID="4fdf1ce8-6e29-4165-9a95-5407cfa89234" containerID="0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1" exitCode=0
Sep 08 10:25:20.459371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.459285    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch" event={"ID":"4fdf1ce8-6e29-4165-9a95-5407cfa89234","Type":"ContainerDied","Data":"0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1"}
Sep 08 10:25:20.459371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.459300    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"
Sep 08 10:25:20.459371 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.459348    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch" event={"ID":"4fdf1ce8-6e29-4165-9a95-5407cfa89234","Type":"ContainerDied","Data":"8668ea4d2b132965cdc72b105a70711b52c244a532c6f3e679cc707370c9a7e7"}
Sep 08 10:25:20.466569 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.466551    2582 scope.go:117] "RemoveContainer" containerID="7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa"
Sep 08 10:25:20.466892 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:25:20.466874    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa\": container with ID starting with 7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa not found: ID does not exist" containerID="7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa"
Sep 08 10:25:20.466966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.466900    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa"} err="failed to get container status \"7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa\": rpc error: code = NotFound desc = could not find container \"7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa\": container with ID starting with 7cae694acfb41b4e8a08abd4c9bcbdc69089d0fc4b531ff184e49c107d606cfa not found: ID does not exist"
Sep 08 10:25:20.466966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.466916    2582 scope.go:117] "RemoveContainer" containerID="0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1"
Sep 08 10:25:20.474314 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.474293    2582 scope.go:117] "RemoveContainer" containerID="0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1"
Sep 08 10:25:20.474749 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:25:20.474702    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1\": container with ID starting with 0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1 not found: ID does not exist" containerID="0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1"
Sep 08 10:25:20.474749 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.474736    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1"} err="failed to get container status \"0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1\": rpc error: code = NotFound desc = could not find container \"0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1\": container with ID starting with 0b1b2cdc855ced09711c2286bed71c3c8ba5f31413f8b5f5051cb8850fa846b1 not found: ID does not exist"
Sep 08 10:25:20.476805 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.476787    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"]
Sep 08 10:25:20.482896 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.482875    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-22af43-5b97768595-j8ddv"]
Sep 08 10:25:20.494011 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.493983    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"]
Sep 08 10:25:20.500547 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:20.500529    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-22af43-587c6fd75d-hfgch"]
Sep 08 10:25:21.909759 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:21.909725    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="465015d6-c157-4a33-abe3-cb36c0ff17b8" path="/var/lib/kubelet/pods/465015d6-c157-4a33-abe3-cb36c0ff17b8/volumes"
Sep 08 10:25:21.910128 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:21.910068    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fdf1ce8-6e29-4165-9a95-5407cfa89234" path="/var/lib/kubelet/pods/4fdf1ce8-6e29-4165-9a95-5407cfa89234/volumes"
Sep 08 10:25:30.049733 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:30.049662    2582 scope.go:117] "RemoveContainer" containerID="578ab8ef73116335f4a62aa24dd516e1c70a4ba0caa8e40dd1a8e9417624a667"
Sep 08 10:25:30.057132 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:30.057114    2582 scope.go:117] "RemoveContainer" containerID="feb4b524e41115dbed7d66a0ae9e6931f855766c0e695629ee26db8709750267"
Sep 08 10:25:39.177731 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:39.177698    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"]
Sep 08 10:25:41.952561 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:41.952338    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"]
Sep 08 10:25:41.953028 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:41.952578    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v" podUID="a9222ddf-c7de-4f8b-b203-8d35ef3cc214" containerName="payload-pre-processing" containerID="cri-o://155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f" gracePeriod=30
Sep 08 10:25:42.198979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.198956    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:25:42.269150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.269089    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-plugins-config-volume\") pod \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") "
Sep 08 10:25:42.269150 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.269141    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2b9gp\" (UniqueName: \"kubernetes.io/projected/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-kube-api-access-2b9gp\") pod \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\" (UID: \"a9222ddf-c7de-4f8b-b203-8d35ef3cc214\") "
Sep 08 10:25:42.269525 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.269500    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a9222ddf-c7de-4f8b-b203-8d35ef3cc214" (UID: "a9222ddf-c7de-4f8b-b203-8d35ef3cc214"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:25:42.271082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.271061    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-kube-api-access-2b9gp" (OuterVolumeSpecName: "kube-api-access-2b9gp") pod "a9222ddf-c7de-4f8b-b203-8d35ef3cc214" (UID: "a9222ddf-c7de-4f8b-b203-8d35ef3cc214"). InnerVolumeSpecName "kube-api-access-2b9gp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:42.370794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.370762    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2b9gp\" (UniqueName: \"kubernetes.io/projected/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-kube-api-access-2b9gp\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:42.370794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.370790    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9222ddf-c7de-4f8b-b203-8d35ef3cc214-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:42.566798 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.566714    2582 generic.go:356] "Generic (PLEG): container finished" podID="a9222ddf-c7de-4f8b-b203-8d35ef3cc214" containerID="155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f" exitCode=0
Sep 08 10:25:42.566798 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.566761    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"
Sep 08 10:25:42.566994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.566796    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v" event={"ID":"a9222ddf-c7de-4f8b-b203-8d35ef3cc214","Type":"ContainerDied","Data":"155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f"}
Sep 08 10:25:42.566994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.566841    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v" event={"ID":"a9222ddf-c7de-4f8b-b203-8d35ef3cc214","Type":"ContainerDied","Data":"8d6ecb919fdb4853361f39e8011a61e01888cd9d52162fa231ad58d559cbed7c"}
Sep 08 10:25:42.566994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.566863    2582 scope.go:117] "RemoveContainer" containerID="155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f"
Sep 08 10:25:42.575384 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.575367    2582 scope.go:117] "RemoveContainer" containerID="155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f"
Sep 08 10:25:42.575638 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:25:42.575620    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f\": container with ID starting with 155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f not found: ID does not exist" containerID="155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f"
Sep 08 10:25:42.575719 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.575650    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f"} err="failed to get container status \"155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f\": rpc error: code = NotFound desc = could not find container \"155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f\": container with ID starting with 155a28319f1e880703944ac1e62c5c5562ebbc2d5a4672156536fd4e63042c9f not found: ID does not exist"
Sep 08 10:25:42.588405 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.588383    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"]
Sep 08 10:25:42.591595 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:42.591577    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-9e30f6-799dffbdc4-wbj2v"]
Sep 08 10:25:43.910025 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:43.909990    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9222ddf-c7de-4f8b-b203-8d35ef3cc214" path="/var/lib/kubelet/pods/a9222ddf-c7de-4f8b-b203-8d35ef3cc214/volumes"
Sep 08 10:25:54.197885 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.197843    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4" podUID="03472afb-f705-43e6-97c5-4d3cc7660bb9" containerName="main" containerID="cri-o://cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5" gracePeriod=45
Sep 08 10:25:54.448600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.448523    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:25:54.568929 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.568904    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03472afb-f705-43e6-97c5-4d3cc7660bb9-tls-certs\") pod \"03472afb-f705-43e6-97c5-4d3cc7660bb9\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") "
Sep 08 10:25:54.569063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.568950    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-dshm\") pod \"03472afb-f705-43e6-97c5-4d3cc7660bb9\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") "
Sep 08 10:25:54.569063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.568971    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-model-cache\") pod \"03472afb-f705-43e6-97c5-4d3cc7660bb9\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") "
Sep 08 10:25:54.569179 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569158    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pz98w\" (UniqueName: \"kubernetes.io/projected/03472afb-f705-43e6-97c5-4d3cc7660bb9-kube-api-access-pz98w\") pod \"03472afb-f705-43e6-97c5-4d3cc7660bb9\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") "
Sep 08 10:25:54.569264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569224    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-home\") pod \"03472afb-f705-43e6-97c5-4d3cc7660bb9\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") "
Sep 08 10:25:54.569357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569218    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-model-cache" (OuterVolumeSpecName: "model-cache") pod "03472afb-f705-43e6-97c5-4d3cc7660bb9" (UID: "03472afb-f705-43e6-97c5-4d3cc7660bb9"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:25:54.569357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569308    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-tmp-dir\") pod \"03472afb-f705-43e6-97c5-4d3cc7660bb9\" (UID: \"03472afb-f705-43e6-97c5-4d3cc7660bb9\") "
Sep 08 10:25:54.569470 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569451    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-home" (OuterVolumeSpecName: "home") pod "03472afb-f705-43e6-97c5-4d3cc7660bb9" (UID: "03472afb-f705-43e6-97c5-4d3cc7660bb9"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:25:54.569515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569497    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03472afb-f705-43e6-97c5-4d3cc7660bb9" (UID: "03472afb-f705-43e6-97c5-4d3cc7660bb9"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:25:54.569693 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569675    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-tmp-dir\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:54.569769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569697    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-model-cache\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:54.569769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.569708    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-home\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:54.571281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.571253    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-dshm" (OuterVolumeSpecName: "dshm") pod "03472afb-f705-43e6-97c5-4d3cc7660bb9" (UID: "03472afb-f705-43e6-97c5-4d3cc7660bb9"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:25:54.571281 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.571258    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03472afb-f705-43e6-97c5-4d3cc7660bb9-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03472afb-f705-43e6-97c5-4d3cc7660bb9" (UID: "03472afb-f705-43e6-97c5-4d3cc7660bb9"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:25:54.571417 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.571299    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03472afb-f705-43e6-97c5-4d3cc7660bb9-kube-api-access-pz98w" (OuterVolumeSpecName: "kube-api-access-pz98w") pod "03472afb-f705-43e6-97c5-4d3cc7660bb9" (UID: "03472afb-f705-43e6-97c5-4d3cc7660bb9"). InnerVolumeSpecName "kube-api-access-pz98w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:54.625423 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.625394    2582 generic.go:356] "Generic (PLEG): container finished" podID="03472afb-f705-43e6-97c5-4d3cc7660bb9" containerID="cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5" exitCode=0
Sep 08 10:25:54.625541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.625436    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"
Sep 08 10:25:54.625541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.625490    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4" event={"ID":"03472afb-f705-43e6-97c5-4d3cc7660bb9","Type":"ContainerDied","Data":"cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5"}
Sep 08 10:25:54.625541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.625530    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4" event={"ID":"03472afb-f705-43e6-97c5-4d3cc7660bb9","Type":"ContainerDied","Data":"ff8ed5e3ec9c4b16d2ba3cbdd7764f9dcdc410e81478fdd90fc0c5af5a4fd0bb"}
Sep 08 10:25:54.625663 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.625548    2582 scope.go:117] "RemoveContainer" containerID="cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5"
Sep 08 10:25:54.633753 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.633738    2582 scope.go:117] "RemoveContainer" containerID="cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5"
Sep 08 10:25:54.634009 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:25:54.633988    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5\": container with ID starting with cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5 not found: ID does not exist" containerID="cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5"
Sep 08 10:25:54.634064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.634017    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5"} err="failed to get container status \"cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5\": rpc error: code = NotFound desc = could not find container \"cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5\": container with ID starting with cfce5c2d1cb46ed9efa69b6375b8094a7a1388f74ca34414eca7f8f67aade4f5 not found: ID does not exist"
Sep 08 10:25:54.647874 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.647850    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"]
Sep 08 10:25:54.654238 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.654202    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-d6e53c/sub-test-model-d6e53c-kserve-7c74d88755-ztwf4"]
Sep 08 10:25:54.670904 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.670886    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03472afb-f705-43e6-97c5-4d3cc7660bb9-tls-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:54.670904 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.670904    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03472afb-f705-43e6-97c5-4d3cc7660bb9-dshm\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:54.671000 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:54.670913    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pz98w\" (UniqueName: \"kubernetes.io/projected/03472afb-f705-43e6-97c5-4d3cc7660bb9-kube-api-access-pz98w\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:55.909948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:55.909913    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03472afb-f705-43e6-97c5-4d3cc7660bb9" path="/var/lib/kubelet/pods/03472afb-f705-43e6-97c5-4d3cc7660bb9/volumes"
Sep 08 10:25:59.515416 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.515376    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"]
Sep 08 10:25:59.515814 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.515613    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" podUID="c4c9ab3d-0b25-4812-bd52-2e491f72c489" containerName="maas-api" containerID="cri-o://8953d7d2fca52508190d4637da64ba6ae267c132eeac1ce6ee2e16dfc2e9ea94" gracePeriod=30
Sep 08 10:25:59.650876 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.650845    2582 generic.go:356] "Generic (PLEG): container finished" podID="c4c9ab3d-0b25-4812-bd52-2e491f72c489" containerID="8953d7d2fca52508190d4637da64ba6ae267c132eeac1ce6ee2e16dfc2e9ea94" exitCode=0
Sep 08 10:25:59.651037 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.650912    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" event={"ID":"c4c9ab3d-0b25-4812-bd52-2e491f72c489","Type":"ContainerDied","Data":"8953d7d2fca52508190d4637da64ba6ae267c132eeac1ce6ee2e16dfc2e9ea94"}
Sep 08 10:25:59.756810 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.756787    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:25:59.916402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.916369    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c9ab3d-0b25-4812-bd52-2e491f72c489-openshift-service-ca\") pod \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") "
Sep 08 10:25:59.916609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.916437    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q27jv\" (UniqueName: \"kubernetes.io/projected/c4c9ab3d-0b25-4812-bd52-2e491f72c489-kube-api-access-q27jv\") pod \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") "
Sep 08 10:25:59.916678 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.916630    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-metrics-certs\") pod \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") "
Sep 08 10:25:59.916740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.916705    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls\") pod \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\" (UID: \"c4c9ab3d-0b25-4812-bd52-2e491f72c489\") "
Sep 08 10:25:59.917141 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.916894    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4c9ab3d-0b25-4812-bd52-2e491f72c489-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c4c9ab3d-0b25-4812-bd52-2e491f72c489" (UID: "c4c9ab3d-0b25-4812-bd52-2e491f72c489"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:25:59.917141 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.917055    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4c9ab3d-0b25-4812-bd52-2e491f72c489-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:25:59.918928 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.918883    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c4c9ab3d-0b25-4812-bd52-2e491f72c489" (UID: "c4c9ab3d-0b25-4812-bd52-2e491f72c489"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:25:59.919115 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.919093    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4c9ab3d-0b25-4812-bd52-2e491f72c489-kube-api-access-q27jv" (OuterVolumeSpecName: "kube-api-access-q27jv") pod "c4c9ab3d-0b25-4812-bd52-2e491f72c489" (UID: "c4c9ab3d-0b25-4812-bd52-2e491f72c489"). InnerVolumeSpecName "kube-api-access-q27jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:25:59.919290 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:25:59.919269    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c4c9ab3d-0b25-4812-bd52-2e491f72c489" (UID: "c4c9ab3d-0b25-4812-bd52-2e491f72c489"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:26:00.017661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.017638    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:00.017661 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.017661    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q27jv\" (UniqueName: \"kubernetes.io/projected/c4c9ab3d-0b25-4812-bd52-2e491f72c489-kube-api-access-q27jv\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:00.017794 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.017670    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4c9ab3d-0b25-4812-bd52-2e491f72c489-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:00.657539 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.657504    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v" event={"ID":"c4c9ab3d-0b25-4812-bd52-2e491f72c489","Type":"ContainerDied","Data":"30ecb15c3d08567b1ae2fe6c8909a4233441d44e06ab585c4e8aa47e11eec727"}
Sep 08 10:26:00.657953 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.657519    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"
Sep 08 10:26:00.657953 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.657626    2582 scope.go:117] "RemoveContainer" containerID="8953d7d2fca52508190d4637da64ba6ae267c132eeac1ce6ee2e16dfc2e9ea94"
Sep 08 10:26:00.680769 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.680745    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"]
Sep 08 10:26:00.685932 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:00.685911    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-af58b2-755b8d49f8-s8d9v"]
Sep 08 10:26:01.909368 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:01.909336    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4c9ab3d-0b25-4812-bd52-2e491f72c489" path="/var/lib/kubelet/pods/c4c9ab3d-0b25-4812-bd52-2e491f72c489/volumes"
Sep 08 10:26:17.546607 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.546572    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"]
Sep 08 10:26:17.547129 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.546793    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg" podUID="7414839f-9f00-4681-87a1-12484860f674" containerName="payload-pre-processing" containerID="cri-o://c304f5404c8345de4028d5a2828673e80d5bfbb424e1c7f56feda895834532b6" gracePeriod=30
Sep 08 10:26:17.756521 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.756485    2582 generic.go:356] "Generic (PLEG): container finished" podID="7414839f-9f00-4681-87a1-12484860f674" containerID="c304f5404c8345de4028d5a2828673e80d5bfbb424e1c7f56feda895834532b6" exitCode=0
Sep 08 10:26:17.756657 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.756552    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg" event={"ID":"7414839f-9f00-4681-87a1-12484860f674","Type":"ContainerDied","Data":"c304f5404c8345de4028d5a2828673e80d5bfbb424e1c7f56feda895834532b6"}
Sep 08 10:26:17.799313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.799251    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:26:17.962907 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.962880    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7x2b\" (UniqueName: \"kubernetes.io/projected/7414839f-9f00-4681-87a1-12484860f674-kube-api-access-c7x2b\") pod \"7414839f-9f00-4681-87a1-12484860f674\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") "
Sep 08 10:26:17.962907 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.962911    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7414839f-9f00-4681-87a1-12484860f674-plugins-config-volume\") pod \"7414839f-9f00-4681-87a1-12484860f674\" (UID: \"7414839f-9f00-4681-87a1-12484860f674\") "
Sep 08 10:26:17.963357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.963332    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7414839f-9f00-4681-87a1-12484860f674-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7414839f-9f00-4681-87a1-12484860f674" (UID: "7414839f-9f00-4681-87a1-12484860f674"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:26:17.964960 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:17.964940    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7414839f-9f00-4681-87a1-12484860f674-kube-api-access-c7x2b" (OuterVolumeSpecName: "kube-api-access-c7x2b") pod "7414839f-9f00-4681-87a1-12484860f674" (UID: "7414839f-9f00-4681-87a1-12484860f674"). InnerVolumeSpecName "kube-api-access-c7x2b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:26:18.063885 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.063813    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7x2b\" (UniqueName: \"kubernetes.io/projected/7414839f-9f00-4681-87a1-12484860f674-kube-api-access-c7x2b\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:18.063885 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.063837    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7414839f-9f00-4681-87a1-12484860f674-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:18.762492 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.762461    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"
Sep 08 10:26:18.762492 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.762483    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg" event={"ID":"7414839f-9f00-4681-87a1-12484860f674","Type":"ContainerDied","Data":"8825f0e1d834e9eaa95bdb792f089133b5a323cac22176fb67d990d503588cb6"}
Sep 08 10:26:18.762941 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.762552    2582 scope.go:117] "RemoveContainer" containerID="c304f5404c8345de4028d5a2828673e80d5bfbb424e1c7f56feda895834532b6"
Sep 08 10:26:18.784460 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.784439    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"]
Sep 08 10:26:18.788551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:18.788528    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-37ed05-6c785d479d-d8cpg"]
Sep 08 10:26:19.910055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:19.910023    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7414839f-9f00-4681-87a1-12484860f674" path="/var/lib/kubelet/pods/7414839f-9f00-4681-87a1-12484860f674/volumes"
Sep 08 10:26:24.688172 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:24.688137    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"]
Sep 08 10:26:24.688692 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:24.688383    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" containerID="cri-o://438d186942bb99beb0cd6eadc9cbc12afc4aad5d525ddfb91b84927794e9544d" gracePeriod=30
Sep 08 10:26:25.630415 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:25.630367    2582 patch_prober.go:28] interesting pod/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 10:26:25.630582 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:25.630433    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 10:26:29.820602 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.820571    2582 generic.go:356] "Generic (PLEG): container finished" podID="efc3f280-2623-4c25-8eec-87008c695972" containerID="438d186942bb99beb0cd6eadc9cbc12afc4aad5d525ddfb91b84927794e9544d" exitCode=0
Sep 08 10:26:29.820925 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.820613    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" event={"ID":"efc3f280-2623-4c25-8eec-87008c695972","Type":"ContainerDied","Data":"438d186942bb99beb0cd6eadc9cbc12afc4aad5d525ddfb91b84927794e9544d"}
Sep 08 10:26:29.820925 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.820661    2582 scope.go:117] "RemoveContainer" containerID="cab5774bf23684592766018c7314896d022b6485fda6152dbf776a27fe2a63e5"
Sep 08 10:26:29.931340 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.931303    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:26:29.954117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954044    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-socket\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954117 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954108    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-certs\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954329 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954167    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efc3f280-2623-4c25-8eec-87008c695972-istiod-ca-cert\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954329 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954200    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-credential-socket\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954329 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954274    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-data\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954329 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954307    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5pks\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-kube-api-access-s5pks\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954552 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954333    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:29.954552 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954360    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-envoy\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954552 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954394    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-istio-token\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954552 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954425    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efc3f280-2623-4c25-8eec-87008c695972-istio-podinfo\") pod \"efc3f280-2623-4c25-8eec-87008c695972\" (UID: \"efc3f280-2623-4c25-8eec-87008c695972\") "
Sep 08 10:26:29.954763 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954721    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-data" (OuterVolumeSpecName: "istio-data") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:29.954822 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954758    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:29.955013 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.954987    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:29.955467 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.955137    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:29.955924 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.955889    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efc3f280-2623-4c25-8eec-87008c695972-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:26:29.957825 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.957802    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-istio-token" (OuterVolumeSpecName: "istio-token") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:26:29.957938 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.957892    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:26:29.957938 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.957900    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/efc3f280-2623-4c25-8eec-87008c695972-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:26:29.957938 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:29.957908    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-kube-api-access-s5pks" (OuterVolumeSpecName: "kube-api-access-s5pks") pod "efc3f280-2623-4c25-8eec-87008c695972" (UID: "efc3f280-2623-4c25-8eec-87008c695972"). InnerVolumeSpecName "kube-api-access-s5pks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:26:30.055151 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055124    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055151 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055148    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055157    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5pks\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-kube-api-access-s5pks\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055166    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055174    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/efc3f280-2623-4c25-8eec-87008c695972-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055182    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/efc3f280-2623-4c25-8eec-87008c695972-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055189    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/efc3f280-2623-4c25-8eec-87008c695972-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.055313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.055196    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/efc3f280-2623-4c25-8eec-87008c695972-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:26:30.084020 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.083993    2582 scope.go:117] "RemoveContainer" containerID="438d186942bb99beb0cd6eadc9cbc12afc4aad5d525ddfb91b84927794e9544d"
Sep 08 10:26:30.824512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.824480    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"
Sep 08 10:26:30.825083 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.824473    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq" event={"ID":"efc3f280-2623-4c25-8eec-87008c695972","Type":"ContainerDied","Data":"8002831076c0bee8bb312068d7dff993440c4d0f1c1a4f7eb587722253a55bfb"}
Sep 08 10:26:30.859156 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.859127    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"]
Sep 08 10:26:30.863665 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:30.863635    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-37ed05-openshift-default-96dc747b8-4m2hq"]
Sep 08 10:26:31.909751 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:26:31.909719    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efc3f280-2623-4c25-8eec-87008c695972" path="/var/lib/kubelet/pods/efc3f280-2623-4c25-8eec-87008c695972/volumes"
Sep 08 10:27:08.583776 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.583742    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"]
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584052    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7414839f-9f00-4681-87a1-12484860f674" containerName="payload-pre-processing"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584063    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="7414839f-9f00-4681-87a1-12484860f674" containerName="payload-pre-processing"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584072    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="465015d6-c157-4a33-abe3-cb36c0ff17b8" containerName="maas-api"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584079    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="465015d6-c157-4a33-abe3-cb36c0ff17b8" containerName="maas-api"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584087    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9222ddf-c7de-4f8b-b203-8d35ef3cc214" containerName="payload-pre-processing"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584093    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9222ddf-c7de-4f8b-b203-8d35ef3cc214" containerName="payload-pre-processing"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584106    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fdf1ce8-6e29-4165-9a95-5407cfa89234" containerName="payload-pre-processing"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584110    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fdf1ce8-6e29-4165-9a95-5407cfa89234" containerName="payload-pre-processing"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584118    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03472afb-f705-43e6-97c5-4d3cc7660bb9" containerName="main"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584123    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="03472afb-f705-43e6-97c5-4d3cc7660bb9" containerName="main"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584134    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4c9ab3d-0b25-4812-bd52-2e491f72c489" containerName="maas-api"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584138    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4c9ab3d-0b25-4812-bd52-2e491f72c489" containerName="maas-api"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584145    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584150    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584157    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy"
Sep 08 10:27:08.584180 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584161    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584206    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4c9ab3d-0b25-4812-bd52-2e491f72c489" containerName="maas-api"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584214    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9222ddf-c7de-4f8b-b203-8d35ef3cc214" containerName="payload-pre-processing"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584220    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="465015d6-c157-4a33-abe3-cb36c0ff17b8" containerName="maas-api"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584239    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584245    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="7414839f-9f00-4681-87a1-12484860f674" containerName="payload-pre-processing"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584253    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fdf1ce8-6e29-4165-9a95-5407cfa89234" containerName="payload-pre-processing"
Sep 08 10:27:08.584781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.584257    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="03472afb-f705-43e6-97c5-4d3cc7660bb9" containerName="main"
Sep 08 10:27:08.587347 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.587329    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.589738 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.589715    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-a0d0ba-serving-cert\""
Sep 08 10:27:08.598966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.598942    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"]
Sep 08 10:27:08.751304 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.751269    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed674db9-1316-4063-ab1e-ab2938428e10-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.751462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.751312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9slq2\" (UniqueName: \"kubernetes.io/projected/ed674db9-1316-4063-ab1e-ab2938428e10-kube-api-access-9slq2\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.751462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.751338    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.751462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.751360    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-metrics-certs\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.852461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.852383    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed674db9-1316-4063-ab1e-ab2938428e10-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.852461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.852422    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9slq2\" (UniqueName: \"kubernetes.io/projected/ed674db9-1316-4063-ab1e-ab2938428e10-kube-api-access-9slq2\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.852461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.852439    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.852461 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.852461    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-metrics-certs\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.853099 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.853073    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed674db9-1316-4063-ab1e-ab2938428e10-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.854932 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.854907    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-metrics-certs\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.855097 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.855074    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-maas-api-tls\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.863454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.863431    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9slq2\" (UniqueName: \"kubernetes.io/projected/ed674db9-1316-4063-ab1e-ab2938428e10-kube-api-access-9slq2\") pod \"maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:08.899249 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:08.899217    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:09.173789 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.173762    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"]
Sep 08 10:27:09.176070 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:27:09.176045    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded674db9_1316_4063_ab1e_ab2938428e10.slice/crio-15bffd2b5e33c4f24a6001cefa126a63820be69e2a6a4109c3c872b2f1656b57 WatchSource:0}: Error finding container 15bffd2b5e33c4f24a6001cefa126a63820be69e2a6a4109c3c872b2f1656b57: Status 404 returned error can't find the container with id 15bffd2b5e33c4f24a6001cefa126a63820be69e2a6a4109c3c872b2f1656b57
Sep 08 10:27:09.177330 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.177312    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:27:09.341181 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.341147    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"]
Sep 08 10:27:09.341572 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.341558    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="efc3f280-2623-4c25-8eec-87008c695972" containerName="istio-proxy"
Sep 08 10:27:09.345710 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.345696    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.348098 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.348076    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-a0d0ba\""
Sep 08 10:27:09.348252 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.348144    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-a0d0ba-dockercfg-7gnwp\""
Sep 08 10:27:09.354682 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.354574    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"]
Sep 08 10:27:09.368313 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.368291    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"]
Sep 08 10:27:09.371643 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.371624    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.379676 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.379655    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"]
Sep 08 10:27:09.457845 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.457751    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b688ac-8550-48ba-8ed9-68f3d3e042f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.457845 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.457802    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pbqp\" (UniqueName: \"kubernetes.io/projected/84b688ac-8550-48ba-8ed9-68f3d3e042f7-kube-api-access-7pbqp\") pod \"payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.458063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.457850    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zfvh\" (UniqueName: \"kubernetes.io/projected/91339fc8-e311-477c-891f-d93a6e88e974-kube-api-access-5zfvh\") pod \"payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.458063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.457924    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91339fc8-e311-477c-891f-d93a6e88e974-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.558814 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.558788    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91339fc8-e311-477c-891f-d93a6e88e974-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.558980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.558888    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b688ac-8550-48ba-8ed9-68f3d3e042f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.558980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.558936    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pbqp\" (UniqueName: \"kubernetes.io/projected/84b688ac-8550-48ba-8ed9-68f3d3e042f7-kube-api-access-7pbqp\") pod \"payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.558980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.558971    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zfvh\" (UniqueName: \"kubernetes.io/projected/91339fc8-e311-477c-891f-d93a6e88e974-kube-api-access-5zfvh\") pod \"payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.559526 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.559506    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91339fc8-e311-477c-891f-d93a6e88e974-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.559636 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.559617    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b688ac-8550-48ba-8ed9-68f3d3e042f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.567008 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.566979    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zfvh\" (UniqueName: \"kubernetes.io/projected/91339fc8-e311-477c-891f-d93a6e88e974-kube-api-access-5zfvh\") pod \"payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.567116 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.567067    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pbqp\" (UniqueName: \"kubernetes.io/projected/84b688ac-8550-48ba-8ed9-68f3d3e042f7-kube-api-access-7pbqp\") pod \"payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.657330 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.657298    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:09.683057 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.683033    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:09.929061 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.928748    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"]
Sep 08 10:27:09.931335 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:27:09.931309    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84b688ac_8550_48ba_8ed9_68f3d3e042f7.slice/crio-06967fb605574043558ce0477655ca98eb74dbb8edafcb36035b1ce5c39e80ac WatchSource:0}: Error finding container 06967fb605574043558ce0477655ca98eb74dbb8edafcb36035b1ce5c39e80ac: Status 404 returned error can't find the container with id 06967fb605574043558ce0477655ca98eb74dbb8edafcb36035b1ce5c39e80ac
Sep 08 10:27:09.960423 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:09.960404    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"]
Sep 08 10:27:09.962262 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:27:09.962219    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91339fc8_e311_477c_891f_d93a6e88e974.slice/crio-8fd570c457b75660e2226e76344b03b5666a706068225b656eb65ed8cebcbb4f WatchSource:0}: Error finding container 8fd570c457b75660e2226e76344b03b5666a706068225b656eb65ed8cebcbb4f: Status 404 returned error can't find the container with id 8fd570c457b75660e2226e76344b03b5666a706068225b656eb65ed8cebcbb4f
Sep 08 10:27:10.007458 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:10.007425    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf" event={"ID":"91339fc8-e311-477c-891f-d93a6e88e974","Type":"ContainerStarted","Data":"8fd570c457b75660e2226e76344b03b5666a706068225b656eb65ed8cebcbb4f"}
Sep 08 10:27:10.009068 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:10.009040    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6" event={"ID":"84b688ac-8550-48ba-8ed9-68f3d3e042f7","Type":"ContainerStarted","Data":"b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380"}
Sep 08 10:27:10.009165 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:10.009092    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6" event={"ID":"84b688ac-8550-48ba-8ed9-68f3d3e042f7","Type":"ContainerStarted","Data":"06967fb605574043558ce0477655ca98eb74dbb8edafcb36035b1ce5c39e80ac"}
Sep 08 10:27:10.009259 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:10.009160    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:10.010213 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:10.010181    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm" event={"ID":"ed674db9-1316-4063-ab1e-ab2938428e10","Type":"ContainerStarted","Data":"15bffd2b5e33c4f24a6001cefa126a63820be69e2a6a4109c3c872b2f1656b57"}
Sep 08 10:27:10.027357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:10.027303    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6" podStartSLOduration=1.027287995 podStartE2EDuration="1.027287995s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:27:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:27:10.02540644 +0000 UTC m=+1540.602276882" watchObservedRunningTime="2026-09-08 10:27:10.027287995 +0000 UTC m=+1540.604158495"
Sep 08 10:27:11.016302 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:11.016261    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm" event={"ID":"ed674db9-1316-4063-ab1e-ab2938428e10","Type":"ContainerStarted","Data":"c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0"}
Sep 08 10:27:11.016747 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:11.016325    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:11.017951 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:11.017922    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf" event={"ID":"91339fc8-e311-477c-891f-d93a6e88e974","Type":"ContainerStarted","Data":"24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f"}
Sep 08 10:27:11.035380 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:11.035334    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm" podStartSLOduration=2.161698251 podStartE2EDuration="3.035318509s" totalImagesPullingTime="873.620258ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:27:11.033714312 +0000 UTC m=+1541.610584752" watchObservedRunningTime="2026-09-08 10:27:11.035318509 +0000 UTC m=+1541.612188949"
Sep 08 10:27:11.050877 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:11.050835    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf" podStartSLOduration=2.050820678 podStartE2EDuration="2.050820678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:27:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:27:11.049492698 +0000 UTC m=+1541.626363141" watchObservedRunningTime="2026-09-08 10:27:11.050820678 +0000 UTC m=+1541.627691119"
Sep 08 10:27:12.030379 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:12.030349    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:27:17.036332 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:17.036307    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:27:21.019860 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:21.019827    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:27:23.036936 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:27:23.036906    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:28:54.992780 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:54.992692    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf_91339fc8-e311-477c-891f-d93a6e88e974/payload-processing/0.log"
Sep 08 10:28:55.780635 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.780603    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"]
Sep 08 10:28:55.784107 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.784087    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.786584 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.786567    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-56bb3c-openshift-default-dockercfg-dfbnj\""
Sep 08 10:28:55.794706 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.794682    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"]
Sep 08 10:28:55.899637 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.899568    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-socket\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.899866 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.899837    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-data\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.899948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.899927    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-credential-socket\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.899994 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.899962    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-token\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.900042 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.900005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-certs\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.900042 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.900022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.900127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.900089    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-envoy\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.900127 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.900113    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-podinfo\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:55.900204 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:55.900136    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htfjg\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-kube-api-access-htfjg\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.000838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000802    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-token\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000865    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-certs\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000880    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000904    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-envoy\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000922    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-podinfo\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000952    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htfjg\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-kube-api-access-htfjg\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.000980    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-socket\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001052    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-data\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001098    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-credential-socket\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001357 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001345    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-certs\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001748 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001438    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-credential-socket\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001748 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001497    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-socket\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001748 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001674    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-data\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.001748 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.001736    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istiod-ca-cert\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.003823 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.003796    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-envoy\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.004004 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.003986    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-podinfo\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.009416 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.009393    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-token\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.010441 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.010422    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htfjg\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-kube-api-access-htfjg\") pod \"e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") " pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.095141 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.095054    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:56.377305 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.377223    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"]
Sep 08 10:28:56.379539 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:28:56.379511    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68acb3c1_cdae_4d0b_b6f7_c2c9057ea79a.slice/crio-70b2e24ef09b38e275a6061e1eac3b536f3f3696c66547b7ccffe05786f42250 WatchSource:0}: Error finding container 70b2e24ef09b38e275a6061e1eac3b536f3f3696c66547b7ccffe05786f42250: Status 404 returned error can't find the container with id 70b2e24ef09b38e275a6061e1eac3b536f3f3696c66547b7ccffe05786f42250
Sep 08 10:28:56.381781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.381743    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:28:56.381893 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.381820    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:28:56.381893 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.381887    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:28:56.502876 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.502832    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" event={"ID":"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a","Type":"ContainerStarted","Data":"9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"}
Sep 08 10:28:56.503025 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.502905    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" event={"ID":"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a","Type":"ContainerStarted","Data":"70b2e24ef09b38e275a6061e1eac3b536f3f3696c66547b7ccffe05786f42250"}
Sep 08 10:28:56.528776 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:56.528719    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podStartSLOduration=1.528698 podStartE2EDuration="1.528698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:28:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:28:56.527059118 +0000 UTC m=+1647.103929551" watchObservedRunningTime="2026-09-08 10:28:56.528698 +0000 UTC m=+1647.105568443"
Sep 08 10:28:57.095515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:57.095485    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:57.100409 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:57.100387    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:57.507837 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:57.507806    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:28:57.509247 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:28:57.509214    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:00.569980 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.569944    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"]
Sep 08 10:29:00.573403 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.573387    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.577851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.577814    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-56bb3c\""
Sep 08 10:29:00.577851 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.577844    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-56bb3c-dockercfg-v5g52\""
Sep 08 10:29:00.586423 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.586402    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"]
Sep 08 10:29:00.643914 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.643882    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bgxt\" (UniqueName: \"kubernetes.io/projected/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-kube-api-access-5bgxt\") pod \"payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.644085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.644051    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.745328 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.745284    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bgxt\" (UniqueName: \"kubernetes.io/projected/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-kube-api-access-5bgxt\") pod \"payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.745531 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.745429    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.746077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.746054    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.754338 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.754310    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bgxt\" (UniqueName: \"kubernetes.io/projected/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-kube-api-access-5bgxt\") pod \"payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:00.883777 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:00.883720    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:01.160659 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:01.160631    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"]
Sep 08 10:29:01.162658 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:29:01.162632    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e1d24e7_ccac_47af_8d7d_0767bb4b50ae.slice/crio-e1df950e6c0e2ce4f3ed50294c6db0933465cdd89ef1eea28c8f155287715b0a WatchSource:0}: Error finding container e1df950e6c0e2ce4f3ed50294c6db0933465cdd89ef1eea28c8f155287715b0a: Status 404 returned error can't find the container with id e1df950e6c0e2ce4f3ed50294c6db0933465cdd89ef1eea28c8f155287715b0a
Sep 08 10:29:01.527188 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:01.527146    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989" event={"ID":"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae","Type":"ContainerStarted","Data":"33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e"}
Sep 08 10:29:01.527388 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:01.527200    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989" event={"ID":"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae","Type":"ContainerStarted","Data":"e1df950e6c0e2ce4f3ed50294c6db0933465cdd89ef1eea28c8f155287715b0a"}
Sep 08 10:29:01.527388 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:01.527345    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:01.544211 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:01.544157    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989" podStartSLOduration=1.544141983 podStartE2EDuration="1.544141983s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:29:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:29:01.543925966 +0000 UTC m=+1652.120796409" watchObservedRunningTime="2026-09-08 10:29:01.544141983 +0000 UTC m=+1652.121012424"
Sep 08 10:29:12.534300 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:12.534261    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:18.611022 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:18.610985    2582 generic.go:356] "Generic (PLEG): container finished" podID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerID="9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f" exitCode=0
Sep 08 10:29:18.611575 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:18.611066    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" event={"ID":"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a","Type":"ContainerDied","Data":"9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"}
Sep 08 10:29:18.611676 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:18.611576    2582 scope.go:117] "RemoveContainer" containerID="9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"
Sep 08 10:29:18.612736 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:18.612705    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:29:18.612800 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:18.612776    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:29:18.612836 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:18.612810    2582 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 10:29:19.620715 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:19.620678    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" event={"ID":"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a","Type":"ContainerStarted","Data":"34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c"}
Sep 08 10:29:20.096302 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:20.096264    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:20.096514 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:20.096412    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 08 10:29:20.096514 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:20.096461    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 08 10:29:21.095654 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:21.095613    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 08 10:29:21.096130 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:21.095675    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 08 10:29:22.095476 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:22.095436    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 08 10:29:22.095691 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:22.095505    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 08 10:29:23.095427 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:23.095391    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 08 10:29:23.095826 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:23.095794    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 08 10:29:24.095530 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:24.095487    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Sep 08 10:29:24.095729 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:24.095550    2582 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Sep 08 10:29:25.274749 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:25.274701    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:25.275304 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:25.275222    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:25.278886 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:25.278865    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:30.249990 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.249949    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"]
Sep 08 10:29:30.250469 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.250165    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989" podUID="4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" containerName="payload-pre-processing" containerID="cri-o://33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e" gracePeriod=30
Sep 08 10:29:30.495864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.495839    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:30.505327 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.505263    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bgxt\" (UniqueName: \"kubernetes.io/projected/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-kube-api-access-5bgxt\") pod \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") "
Sep 08 10:29:30.507320 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.507291    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-kube-api-access-5bgxt" (OuterVolumeSpecName: "kube-api-access-5bgxt") pod "4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" (UID: "4e1d24e7-ccac-47af-8d7d-0767bb4b50ae"). InnerVolumeSpecName "kube-api-access-5bgxt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:29:30.606421 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.606391    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-plugins-config-volume\") pod \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\" (UID: \"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae\") "
Sep 08 10:29:30.606600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.606572    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bgxt\" (UniqueName: \"kubernetes.io/projected/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-kube-api-access-5bgxt\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:30.606937 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.606907    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" (UID: "4e1d24e7-ccac-47af-8d7d-0767bb4b50ae"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:29:30.670855 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.670819    2582 generic.go:356] "Generic (PLEG): container finished" podID="4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" containerID="33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e" exitCode=0
Sep 08 10:29:30.671073 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.670861    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"
Sep 08 10:29:30.671073 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.670882    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989" event={"ID":"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae","Type":"ContainerDied","Data":"33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e"}
Sep 08 10:29:30.671073 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.670931    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989" event={"ID":"4e1d24e7-ccac-47af-8d7d-0767bb4b50ae","Type":"ContainerDied","Data":"e1df950e6c0e2ce4f3ed50294c6db0933465cdd89ef1eea28c8f155287715b0a"}
Sep 08 10:29:30.671073 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.670955    2582 scope.go:117] "RemoveContainer" containerID="33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e"
Sep 08 10:29:30.679932 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.679917    2582 scope.go:117] "RemoveContainer" containerID="33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e"
Sep 08 10:29:30.680155 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:29:30.680137    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e\": container with ID starting with 33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e not found: ID does not exist" containerID="33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e"
Sep 08 10:29:30.680208 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.680164    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e"} err="failed to get container status \"33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e\": rpc error: code = NotFound desc = could not find container \"33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e\": container with ID starting with 33ab7af8e35422f1a7d24697d3fbae1ac73b34811ad85d239d5578e18a689d5e not found: ID does not exist"
Sep 08 10:29:30.695034 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.695014    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"]
Sep 08 10:29:30.698930 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.698909    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-56bb3c-65f565d498-7n989"]
Sep 08 10:29:30.707344 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:30.707327    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:31.909375 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:31.909343    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" path="/var/lib/kubelet/pods/4e1d24e7-ccac-47af-8d7d-0767bb4b50ae/volumes"
Sep 08 10:29:36.908899 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:36.908863    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"]
Sep 08 10:29:36.909475 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:36.909095    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" containerID="cri-o://34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c" gracePeriod=30
Sep 08 10:29:40.277722 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:40.277689    2582 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 10:29:40.278078 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:40.277747    2582 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 10:29:42.158055 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.158034    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:42.198564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198509    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-token\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.198564 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198550    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istiod-ca-cert\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.198757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198585    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-data\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.198757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198631    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-certs\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.198757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198654    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-envoy\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.198757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198687    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-socket\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.198757 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198709    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htfjg\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-kube-api-access-htfjg\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.199040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198762    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-credential-socket\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.199040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198785    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-podinfo\") pod \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\" (UID: \"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a\") "
Sep 08 10:29:42.199040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198927    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:29:42.199040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198952    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:29:42.199040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.198964    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:29:42.199291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.199039    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-data" (OuterVolumeSpecName: "istio-data") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:29:42.199291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.199135    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:29:42.199291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.199193    2582 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istiod-ca-cert\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.199291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.199214    2582 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-data\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.199291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.199244    2582 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.199291 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.199258    2582 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-workload-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.200907 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.200875    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-kube-api-access-htfjg" (OuterVolumeSpecName: "kube-api-access-htfjg") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "kube-api-access-htfjg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:29:42.201151 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.201133    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:29:42.201264 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.201220    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-token" (OuterVolumeSpecName: "istio-token") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:29:42.201390 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.201367    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" (UID: "68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 10:29:42.300047 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.300015    2582 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-credential-socket\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.300047 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.300045    2582 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-podinfo\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.300220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.300055    2582 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-token\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.300220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.300063    2582 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-istio-envoy\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.300220 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.300071    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htfjg\" (UniqueName: \"kubernetes.io/projected/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a-kube-api-access-htfjg\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:42.732453 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.732415    2582 generic.go:356] "Generic (PLEG): container finished" podID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerID="34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c" exitCode=0
Sep 08 10:29:42.732680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.732464    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" event={"ID":"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a","Type":"ContainerDied","Data":"34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c"}
Sep 08 10:29:42.732680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.732507    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf" event={"ID":"68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a","Type":"ContainerDied","Data":"70b2e24ef09b38e275a6061e1eac3b536f3f3696c66547b7ccffe05786f42250"}
Sep 08 10:29:42.732680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.732530    2582 scope.go:117] "RemoveContainer" containerID="34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c"
Sep 08 10:29:42.732680 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.732471    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"
Sep 08 10:29:42.741702 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.741687    2582 scope.go:117] "RemoveContainer" containerID="9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"
Sep 08 10:29:42.749172 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.749156    2582 scope.go:117] "RemoveContainer" containerID="34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c"
Sep 08 10:29:42.749445 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:29:42.749426    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c\": container with ID starting with 34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c not found: ID does not exist" containerID="34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c"
Sep 08 10:29:42.749526 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.749457    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c"} err="failed to get container status \"34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c\": rpc error: code = NotFound desc = could not find container \"34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c\": container with ID starting with 34a4aa645343bf38d81f0ae80dd431da8fbf139a24c233952ae05e56c6ce512c not found: ID does not exist"
Sep 08 10:29:42.749526 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.749480    2582 scope.go:117] "RemoveContainer" containerID="9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"
Sep 08 10:29:42.749736 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:29:42.749720    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f\": container with ID starting with 9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f not found: ID does not exist" containerID="9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"
Sep 08 10:29:42.749788 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.749744    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f"} err="failed to get container status \"9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f\": rpc error: code = NotFound desc = could not find container \"9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f\": container with ID starting with 9e0738523a79ad4c7f9934fc464605354398b2c170c8796ea3e51e448850e96f not found: ID does not exist"
Sep 08 10:29:42.754476 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.754454    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"]
Sep 08 10:29:42.758450 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:42.758430    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-56bb3c-openshift-default-75f8d9dd98-nspbf"]
Sep 08 10:29:43.909359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:43.909324    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" path="/var/lib/kubelet/pods/68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a/volumes"
Sep 08 10:29:56.115080 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.114997    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"]
Sep 08 10:29:56.115676 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.115336    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm" podUID="ed674db9-1316-4063-ab1e-ab2938428e10" containerName="maas-api" containerID="cri-o://c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0" gracePeriod=30
Sep 08 10:29:56.170075 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.170044    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"]
Sep 08 10:29:56.170342 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.170312    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf" podUID="91339fc8-e311-477c-891f-d93a6e88e974" containerName="payload-processing" containerID="cri-o://24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f" gracePeriod=30
Sep 08 10:29:56.179347 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.179300    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"]
Sep 08 10:29:56.184338 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.182605    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6" podUID="84b688ac-8550-48ba-8ed9-68f3d3e042f7" containerName="payload-pre-processing" containerID="cri-o://b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380" gracePeriod=30
Sep 08 10:29:56.470910 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.470880    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:29:56.474573 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.474547    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:29:56.477766 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.477747    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:29:56.510433 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.510409    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5zfvh\" (UniqueName: \"kubernetes.io/projected/91339fc8-e311-477c-891f-d93a6e88e974-kube-api-access-5zfvh\") pod \"91339fc8-e311-477c-891f-d93a6e88e974\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") "
Sep 08 10:29:56.510568 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.510443    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91339fc8-e311-477c-891f-d93a6e88e974-plugins-config-volume\") pod \"91339fc8-e311-477c-891f-d93a6e88e974\" (UID: \"91339fc8-e311-477c-891f-d93a6e88e974\") "
Sep 08 10:29:56.510822 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.510793    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91339fc8-e311-477c-891f-d93a6e88e974-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91339fc8-e311-477c-891f-d93a6e88e974" (UID: "91339fc8-e311-477c-891f-d93a6e88e974"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:29:56.512547 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.512523    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91339fc8-e311-477c-891f-d93a6e88e974-kube-api-access-5zfvh" (OuterVolumeSpecName: "kube-api-access-5zfvh") pod "91339fc8-e311-477c-891f-d93a6e88e974" (UID: "91339fc8-e311-477c-891f-d93a6e88e974"). InnerVolumeSpecName "kube-api-access-5zfvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:29:56.611200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611174    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed674db9-1316-4063-ab1e-ab2938428e10-openshift-service-ca\") pod \"ed674db9-1316-4063-ab1e-ab2938428e10\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") "
Sep 08 10:29:56.611334 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611221    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-metrics-certs\") pod \"ed674db9-1316-4063-ab1e-ab2938428e10\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") "
Sep 08 10:29:56.611334 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611272    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-maas-api-tls\") pod \"ed674db9-1316-4063-ab1e-ab2938428e10\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") "
Sep 08 10:29:56.611334 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611309    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pbqp\" (UniqueName: \"kubernetes.io/projected/84b688ac-8550-48ba-8ed9-68f3d3e042f7-kube-api-access-7pbqp\") pod \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") "
Sep 08 10:29:56.611334 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611326    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9slq2\" (UniqueName: \"kubernetes.io/projected/ed674db9-1316-4063-ab1e-ab2938428e10-kube-api-access-9slq2\") pod \"ed674db9-1316-4063-ab1e-ab2938428e10\" (UID: \"ed674db9-1316-4063-ab1e-ab2938428e10\") "
Sep 08 10:29:56.611544 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611352    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b688ac-8550-48ba-8ed9-68f3d3e042f7-plugins-config-volume\") pod \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\" (UID: \"84b688ac-8550-48ba-8ed9-68f3d3e042f7\") "
Sep 08 10:29:56.611605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611541    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed674db9-1316-4063-ab1e-ab2938428e10-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed674db9-1316-4063-ab1e-ab2938428e10" (UID: "ed674db9-1316-4063-ab1e-ab2938428e10"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:29:56.611605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611570    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5zfvh\" (UniqueName: \"kubernetes.io/projected/91339fc8-e311-477c-891f-d93a6e88e974-kube-api-access-5zfvh\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.611605 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611591    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91339fc8-e311-477c-891f-d93a6e88e974-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.611838 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.611819    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/84b688ac-8550-48ba-8ed9-68f3d3e042f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "84b688ac-8550-48ba-8ed9-68f3d3e042f7" (UID: "84b688ac-8550-48ba-8ed9-68f3d3e042f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:29:56.613359 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.613335    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed674db9-1316-4063-ab1e-ab2938428e10" (UID: "ed674db9-1316-4063-ab1e-ab2938428e10"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:29:56.613454 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.613427    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed674db9-1316-4063-ab1e-ab2938428e10-kube-api-access-9slq2" (OuterVolumeSpecName: "kube-api-access-9slq2") pod "ed674db9-1316-4063-ab1e-ab2938428e10" (UID: "ed674db9-1316-4063-ab1e-ab2938428e10"). InnerVolumeSpecName "kube-api-access-9slq2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:29:56.613699 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.613683    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ed674db9-1316-4063-ab1e-ab2938428e10" (UID: "ed674db9-1316-4063-ab1e-ab2938428e10"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:29:56.613742 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.613696    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/84b688ac-8550-48ba-8ed9-68f3d3e042f7-kube-api-access-7pbqp" (OuterVolumeSpecName: "kube-api-access-7pbqp") pod "84b688ac-8550-48ba-8ed9-68f3d3e042f7" (UID: "84b688ac-8550-48ba-8ed9-68f3d3e042f7"). InnerVolumeSpecName "kube-api-access-7pbqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:29:56.712077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.712054    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pbqp\" (UniqueName: \"kubernetes.io/projected/84b688ac-8550-48ba-8ed9-68f3d3e042f7-kube-api-access-7pbqp\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.712077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.712075    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9slq2\" (UniqueName: \"kubernetes.io/projected/ed674db9-1316-4063-ab1e-ab2938428e10-kube-api-access-9slq2\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.712215 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.712086    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/84b688ac-8550-48ba-8ed9-68f3d3e042f7-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.712215 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.712094    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed674db9-1316-4063-ab1e-ab2938428e10-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.712215 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.712104    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.712215 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.712111    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed674db9-1316-4063-ab1e-ab2938428e10-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:29:56.805533 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.805507    2582 generic.go:356] "Generic (PLEG): container finished" podID="84b688ac-8550-48ba-8ed9-68f3d3e042f7" containerID="b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380" exitCode=0
Sep 08 10:29:56.805662 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.805558    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"
Sep 08 10:29:56.805662 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.805595    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6" event={"ID":"84b688ac-8550-48ba-8ed9-68f3d3e042f7","Type":"ContainerDied","Data":"b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380"}
Sep 08 10:29:56.805662 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.805643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6" event={"ID":"84b688ac-8550-48ba-8ed9-68f3d3e042f7","Type":"ContainerDied","Data":"06967fb605574043558ce0477655ca98eb74dbb8edafcb36035b1ce5c39e80ac"}
Sep 08 10:29:56.805833 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.805667    2582 scope.go:117] "RemoveContainer" containerID="b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380"
Sep 08 10:29:56.807051 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.807021    2582 generic.go:356] "Generic (PLEG): container finished" podID="ed674db9-1316-4063-ab1e-ab2938428e10" containerID="c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0" exitCode=0
Sep 08 10:29:56.807159 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.807058    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm" event={"ID":"ed674db9-1316-4063-ab1e-ab2938428e10","Type":"ContainerDied","Data":"c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0"}
Sep 08 10:29:56.807159 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.807099    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm" event={"ID":"ed674db9-1316-4063-ab1e-ab2938428e10","Type":"ContainerDied","Data":"15bffd2b5e33c4f24a6001cefa126a63820be69e2a6a4109c3c872b2f1656b57"}
Sep 08 10:29:56.807159 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.807065    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"
Sep 08 10:29:56.808624 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.808599    2582 generic.go:356] "Generic (PLEG): container finished" podID="91339fc8-e311-477c-891f-d93a6e88e974" containerID="24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f" exitCode=0
Sep 08 10:29:56.808738 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.808661    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"
Sep 08 10:29:56.808738 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.808692    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf" event={"ID":"91339fc8-e311-477c-891f-d93a6e88e974","Type":"ContainerDied","Data":"24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f"}
Sep 08 10:29:56.808850 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.808749    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf" event={"ID":"91339fc8-e311-477c-891f-d93a6e88e974","Type":"ContainerDied","Data":"8fd570c457b75660e2226e76344b03b5666a706068225b656eb65ed8cebcbb4f"}
Sep 08 10:29:56.814135 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.814115    2582 scope.go:117] "RemoveContainer" containerID="b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380"
Sep 08 10:29:56.814417 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:29:56.814397    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380\": container with ID starting with b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380 not found: ID does not exist" containerID="b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380"
Sep 08 10:29:56.814506 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.814423    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380"} err="failed to get container status \"b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380\": rpc error: code = NotFound desc = could not find container \"b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380\": container with ID starting with b30ca1c04a8c219e5c0036fe1d3ee6885d09f6d8fa400603d8ba8ffc05ac7380 not found: ID does not exist"
Sep 08 10:29:56.814506 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.814439    2582 scope.go:117] "RemoveContainer" containerID="c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0"
Sep 08 10:29:56.824780 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.824765    2582 scope.go:117] "RemoveContainer" containerID="c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0"
Sep 08 10:29:56.825026 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:29:56.825009    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0\": container with ID starting with c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0 not found: ID does not exist" containerID="c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0"
Sep 08 10:29:56.825090 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.825030    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0"} err="failed to get container status \"c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0\": rpc error: code = NotFound desc = could not find container \"c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0\": container with ID starting with c79ed2d0cc65d93475b4327be61894f6d5acb376475da7ab131db836ffe80eb0 not found: ID does not exist"
Sep 08 10:29:56.825090 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.825044    2582 scope.go:117] "RemoveContainer" containerID="24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f"
Sep 08 10:29:56.833100 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.833084    2582 scope.go:117] "RemoveContainer" containerID="24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f"
Sep 08 10:29:56.833290 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.833269    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"]
Sep 08 10:29:56.833427 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:29:56.833316    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f\": container with ID starting with 24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f not found: ID does not exist" containerID="24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f"
Sep 08 10:29:56.833427 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.833344    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f"} err="failed to get container status \"24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f\": rpc error: code = NotFound desc = could not find container \"24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f\": container with ID starting with 24784cb8517a4844526ed46371616e34308080f0ecacf6859ae610ed46e1463f not found: ID does not exist"
Sep 08 10:29:56.835652 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.835634    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-a0d0ba-b79bb9dd6-8ztjm"]
Sep 08 10:29:56.847074 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.847051    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"]
Sep 08 10:29:56.850750 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.850729    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-a0d0ba-7d856f68b9-lr7lf"]
Sep 08 10:29:56.860403 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.860384    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"]
Sep 08 10:29:56.865146 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:56.865127    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-a0d0ba-7f98749c5d-txtt6"]
Sep 08 10:29:57.909445 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:57.909407    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="84b688ac-8550-48ba-8ed9-68f3d3e042f7" path="/var/lib/kubelet/pods/84b688ac-8550-48ba-8ed9-68f3d3e042f7/volumes"
Sep 08 10:29:57.909948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:57.909924    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91339fc8-e311-477c-891f-d93a6e88e974" path="/var/lib/kubelet/pods/91339fc8-e311-477c-891f-d93a6e88e974/volumes"
Sep 08 10:29:57.910362 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:29:57.910342    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed674db9-1316-4063-ab1e-ab2938428e10" path="/var/lib/kubelet/pods/ed674db9-1316-4063-ab1e-ab2938428e10/volumes"
Sep 08 10:30:00.141966 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.141936    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"]
Sep 08 10:30:00.142475 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142454    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91339fc8-e311-477c-891f-d93a6e88e974" containerName="payload-processing"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142479    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="91339fc8-e311-477c-891f-d93a6e88e974" containerName="payload-processing"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142497    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142507    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142519    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="84b688ac-8550-48ba-8ed9-68f3d3e042f7" containerName="payload-pre-processing"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142527    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="84b688ac-8550-48ba-8ed9-68f3d3e042f7" containerName="payload-pre-processing"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142542    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed674db9-1316-4063-ab1e-ab2938428e10" containerName="maas-api"
Sep 08 10:30:00.142558 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142551    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed674db9-1316-4063-ab1e-ab2938428e10" containerName="maas-api"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142561    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" containerName="payload-pre-processing"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142569    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" containerName="payload-pre-processing"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142671    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e1d24e7-ccac-47af-8d7d-0767bb4b50ae" containerName="payload-pre-processing"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142685    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="84b688ac-8550-48ba-8ed9-68f3d3e042f7" containerName="payload-pre-processing"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142697    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed674db9-1316-4063-ab1e-ab2938428e10" containerName="maas-api"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142707    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="91339fc8-e311-477c-891f-d93a6e88e974" containerName="payload-processing"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142718    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy"
Sep 08 10:30:00.142900 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.142727    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy"
Sep 08 10:30:00.154995 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.153028    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"]
Sep 08 10:30:00.154995 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.153115    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"
Sep 08 10:30:00.154995 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.153508    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy"
Sep 08 10:30:00.154995 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.153525    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="68acb3c1-cdae-4d0b-b6f7-c2c9057ea79a" containerName="istio-proxy"
Sep 08 10:30:00.156067 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.155896    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-q7pww\""
Sep 08 10:30:00.157048 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.157021    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"]
Sep 08 10:30:00.157245 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.157114    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"
Sep 08 10:30:00.158343 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.158317    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"]
Sep 08 10:30:00.165716 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.165697    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"
Sep 08 10:30:00.173746 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.173730    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"
Sep 08 10:30:00.441440 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.441349    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"]
Sep 08 10:30:00.443880 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:30:00.443853    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1aefae8_9dc0_4b43_8ceb_2f18f1762f94.slice/crio-4064f3da09f96d8ca3f2f43f44f66aefeeebc254b46319b7c8eb6ab82f05b5d3 WatchSource:0}: Error finding container 4064f3da09f96d8ca3f2f43f44f66aefeeebc254b46319b7c8eb6ab82f05b5d3: Status 404 returned error can't find the container with id 4064f3da09f96d8ca3f2f43f44f66aefeeebc254b46319b7c8eb6ab82f05b5d3
Sep 08 10:30:00.456692 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.456669    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"]
Sep 08 10:30:00.458521 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:30:00.458498    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15c608db_1857_43bb_8dd3_4e2cd35fa4f9.slice/crio-4c9ac852648f19a51b41e929cea10ee5b3818a0d6bc04a6aa049c4b46bbbcf40 WatchSource:0}: Error finding container 4c9ac852648f19a51b41e929cea10ee5b3818a0d6bc04a6aa049c4b46bbbcf40: Status 404 returned error can't find the container with id 4c9ac852648f19a51b41e929cea10ee5b3818a0d6bc04a6aa049c4b46bbbcf40
Sep 08 10:30:00.832888 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.832857    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2" event={"ID":"15c608db-1857-43bb-8dd3-4e2cd35fa4f9","Type":"ContainerStarted","Data":"4bd85e5c55dcd0826ec4cada2f71f64b52b5d205f5e8d2da64fb5adef01ea5b6"}
Sep 08 10:30:00.833033 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.832920    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2" event={"ID":"15c608db-1857-43bb-8dd3-4e2cd35fa4f9","Type":"ContainerStarted","Data":"4c9ac852648f19a51b41e929cea10ee5b3818a0d6bc04a6aa049c4b46bbbcf40"}
Sep 08 10:30:00.834304 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.834285    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm" event={"ID":"c1aefae8-9dc0-4b43-8ceb-2f18f1762f94","Type":"ContainerStarted","Data":"47c47d0b2d9f318385fe513d79d773b440d54eaf934e751231e6758d862ff421"}
Sep 08 10:30:00.834394 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.834325    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm" event={"ID":"c1aefae8-9dc0-4b43-8ceb-2f18f1762f94","Type":"ContainerStarted","Data":"4064f3da09f96d8ca3f2f43f44f66aefeeebc254b46319b7c8eb6ab82f05b5d3"}
Sep 08 10:30:00.849321 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.849283    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2" podStartSLOduration=0.849269738 podStartE2EDuration="849.269738ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:30:00.847277812 +0000 UTC m=+1711.424148254" watchObservedRunningTime="2026-09-08 10:30:00.849269738 +0000 UTC m=+1711.426140218"
Sep 08 10:30:00.861094 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:00.861055    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm" podStartSLOduration=0.861041922 podStartE2EDuration="861.041922ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:30:00.859978401 +0000 UTC m=+1711.436848842" watchObservedRunningTime="2026-09-08 10:30:00.861041922 +0000 UTC m=+1711.437912363"
Sep 08 10:30:01.841633 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:01.841599    2582 generic.go:356] "Generic (PLEG): container finished" podID="c1aefae8-9dc0-4b43-8ceb-2f18f1762f94" containerID="47c47d0b2d9f318385fe513d79d773b440d54eaf934e751231e6758d862ff421" exitCode=0
Sep 08 10:30:01.842082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:01.841687    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm" event={"ID":"c1aefae8-9dc0-4b43-8ceb-2f18f1762f94","Type":"ContainerDied","Data":"47c47d0b2d9f318385fe513d79d773b440d54eaf934e751231e6758d862ff421"}
Sep 08 10:30:01.843037 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:01.843015    2582 generic.go:356] "Generic (PLEG): container finished" podID="15c608db-1857-43bb-8dd3-4e2cd35fa4f9" containerID="4bd85e5c55dcd0826ec4cada2f71f64b52b5d205f5e8d2da64fb5adef01ea5b6" exitCode=0
Sep 08 10:30:01.843140 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:01.843057    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2" event={"ID":"15c608db-1857-43bb-8dd3-4e2cd35fa4f9","Type":"ContainerDied","Data":"4bd85e5c55dcd0826ec4cada2f71f64b52b5d205f5e8d2da64fb5adef01ea5b6"}
Sep 08 10:30:02.985693 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:02.985672    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"
Sep 08 10:30:03.014290 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.014269    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"
Sep 08 10:30:03.857295 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.857269    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"
Sep 08 10:30:03.857465 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.857296    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2" event={"ID":"15c608db-1857-43bb-8dd3-4e2cd35fa4f9","Type":"ContainerDied","Data":"4c9ac852648f19a51b41e929cea10ee5b3818a0d6bc04a6aa049c4b46bbbcf40"}
Sep 08 10:30:03.857465 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.857344    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c9ac852648f19a51b41e929cea10ee5b3818a0d6bc04a6aa049c4b46bbbcf40"
Sep 08 10:30:03.858665 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.858643    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm" event={"ID":"c1aefae8-9dc0-4b43-8ceb-2f18f1762f94","Type":"ContainerDied","Data":"4064f3da09f96d8ca3f2f43f44f66aefeeebc254b46319b7c8eb6ab82f05b5d3"}
Sep 08 10:30:03.858765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.858677    2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4064f3da09f96d8ca3f2f43f44f66aefeeebc254b46319b7c8eb6ab82f05b5d3"
Sep 08 10:30:03.858765 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:03.858683    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"
Sep 08 10:30:55.754472 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:55.754434    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"]
Sep 08 10:30:55.756591 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:55.756565    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-86902f-29814390-gqdvm"]
Sep 08 10:30:55.910023 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:30:55.909992    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1aefae8-9dc0-4b43-8ceb-2f18f1762f94" path="/var/lib/kubelet/pods/c1aefae8-9dc0-4b43-8ceb-2f18f1762f94/volumes"
Sep 08 10:31:13.458787 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.458751    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"]
Sep 08 10:31:13.459290 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.458994    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs" podUID="1f9edd88-0e0d-4ac1-8041-330fe95c8f51" containerName="payload-processing" containerID="cri-o://130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1" gracePeriod=30
Sep 08 10:31:13.704713 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.704684    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:31:13.814635 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.814562    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-plugins-config-volume\") pod \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") "
Sep 08 10:31:13.814635 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.814612    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dbwrz\" (UniqueName: \"kubernetes.io/projected/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-kube-api-access-dbwrz\") pod \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\" (UID: \"1f9edd88-0e0d-4ac1-8041-330fe95c8f51\") "
Sep 08 10:31:13.814917 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.814893    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1f9edd88-0e0d-4ac1-8041-330fe95c8f51" (UID: "1f9edd88-0e0d-4ac1-8041-330fe95c8f51"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:31:13.816648 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.816623    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-kube-api-access-dbwrz" (OuterVolumeSpecName: "kube-api-access-dbwrz") pod "1f9edd88-0e0d-4ac1-8041-330fe95c8f51" (UID: "1f9edd88-0e0d-4ac1-8041-330fe95c8f51"). InnerVolumeSpecName "kube-api-access-dbwrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:31:13.915158 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.915127    2582 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-plugins-config-volume\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:31:13.915158 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:13.915147    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dbwrz\" (UniqueName: \"kubernetes.io/projected/1f9edd88-0e0d-4ac1-8041-330fe95c8f51-kube-api-access-dbwrz\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:31:14.168832 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.168800    2582 generic.go:356] "Generic (PLEG): container finished" podID="1f9edd88-0e0d-4ac1-8041-330fe95c8f51" containerID="130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1" exitCode=0
Sep 08 10:31:14.169002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.168846    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"
Sep 08 10:31:14.169002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.168889    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs" event={"ID":"1f9edd88-0e0d-4ac1-8041-330fe95c8f51","Type":"ContainerDied","Data":"130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1"}
Sep 08 10:31:14.169002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.168955    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs" event={"ID":"1f9edd88-0e0d-4ac1-8041-330fe95c8f51","Type":"ContainerDied","Data":"53b9bc3ed3d60f12a3798ea809c49a045284cc4c7ac6e2e48f9a8456550605d4"}
Sep 08 10:31:14.169002 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.168988    2582 scope.go:117] "RemoveContainer" containerID="130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1"
Sep 08 10:31:14.176855 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.176838    2582 scope.go:117] "RemoveContainer" containerID="130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1"
Sep 08 10:31:14.177125 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:31:14.177105    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1\": container with ID starting with 130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1 not found: ID does not exist" containerID="130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1"
Sep 08 10:31:14.177201 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.177136    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1"} err="failed to get container status \"130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1\": rpc error: code = NotFound desc = could not find container \"130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1\": container with ID starting with 130fc2f87850ff28f2ec0cc7fa6b727ab8a2cb6e25cf5a6e6457846e636ca5a1 not found: ID does not exist"
Sep 08 10:31:14.198377 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.198338    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"]
Sep 08 10:31:14.211464 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:14.211441    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-71a7a1-586b7b6cc5-sj5zs"]
Sep 08 10:31:15.910063 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:15.910020    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f9edd88-0e0d-4ac1-8041-330fe95c8f51" path="/var/lib/kubelet/pods/1f9edd88-0e0d-4ac1-8041-330fe95c8f51/volumes"
Sep 08 10:31:31.214951 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.214913    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"]
Sep 08 10:31:31.215361 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.215172    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" podUID="3c01553c-99be-48f6-a7d4-8ddc2d748a98" containerName="maas-api" containerID="cri-o://54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c" gracePeriod=30
Sep 08 10:31:31.234038 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.234011    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"]
Sep 08 10:31:31.236600 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.236576    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-d6e53c-29814390-fh7p2"]
Sep 08 10:31:31.454056 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.454028    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:31:31.558526 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.558456    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-metrics-certs\") pod \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") "
Sep 08 10:31:31.558526 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.558510    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c01553c-99be-48f6-a7d4-8ddc2d748a98-openshift-service-ca\") pod \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") "
Sep 08 10:31:31.558725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.558552    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls\") pod \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") "
Sep 08 10:31:31.558725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.558632    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g687p\" (UniqueName: \"kubernetes.io/projected/3c01553c-99be-48f6-a7d4-8ddc2d748a98-kube-api-access-g687p\") pod \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\" (UID: \"3c01553c-99be-48f6-a7d4-8ddc2d748a98\") "
Sep 08 10:31:31.558896 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.558873    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3c01553c-99be-48f6-a7d4-8ddc2d748a98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3c01553c-99be-48f6-a7d4-8ddc2d748a98" (UID: "3c01553c-99be-48f6-a7d4-8ddc2d748a98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:31:31.560781 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.560753    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3c01553c-99be-48f6-a7d4-8ddc2d748a98" (UID: "3c01553c-99be-48f6-a7d4-8ddc2d748a98"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:31:31.560930 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.560902    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3c01553c-99be-48f6-a7d4-8ddc2d748a98" (UID: "3c01553c-99be-48f6-a7d4-8ddc2d748a98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:31:31.560979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.560953    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c01553c-99be-48f6-a7d4-8ddc2d748a98-kube-api-access-g687p" (OuterVolumeSpecName: "kube-api-access-g687p") pod "3c01553c-99be-48f6-a7d4-8ddc2d748a98" (UID: "3c01553c-99be-48f6-a7d4-8ddc2d748a98"). InnerVolumeSpecName "kube-api-access-g687p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:31:31.660257 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.660209    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g687p\" (UniqueName: \"kubernetes.io/projected/3c01553c-99be-48f6-a7d4-8ddc2d748a98-kube-api-access-g687p\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:31:31.660257 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.660252    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:31:31.660425 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.660265    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3c01553c-99be-48f6-a7d4-8ddc2d748a98-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:31:31.660425 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.660278    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3c01553c-99be-48f6-a7d4-8ddc2d748a98-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:31:31.909716 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:31.909626    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15c608db-1857-43bb-8dd3-4e2cd35fa4f9" path="/var/lib/kubelet/pods/15c608db-1857-43bb-8dd3-4e2cd35fa4f9/volumes"
Sep 08 10:31:32.254178 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.254144    2582 generic.go:356] "Generic (PLEG): container finished" podID="3c01553c-99be-48f6-a7d4-8ddc2d748a98" containerID="54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c" exitCode=0
Sep 08 10:31:32.254619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.254183    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" event={"ID":"3c01553c-99be-48f6-a7d4-8ddc2d748a98","Type":"ContainerDied","Data":"54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c"}
Sep 08 10:31:32.254619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.254190    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"
Sep 08 10:31:32.254619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.254258    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc" event={"ID":"3c01553c-99be-48f6-a7d4-8ddc2d748a98","Type":"ContainerDied","Data":"23621e4a6ccae21cc077f8428aaa8563895202a7d14b64167e2121f668885fc4"}
Sep 08 10:31:32.254619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.254291    2582 scope.go:117] "RemoveContainer" containerID="54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c"
Sep 08 10:31:32.262920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.262902    2582 scope.go:117] "RemoveContainer" containerID="54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c"
Sep 08 10:31:32.263186 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:31:32.263169    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c\": container with ID starting with 54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c not found: ID does not exist" containerID="54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c"
Sep 08 10:31:32.263276 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.263196    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c"} err="failed to get container status \"54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c\": rpc error: code = NotFound desc = could not find container \"54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c\": container with ID starting with 54007b63c6683975201047b9c88ba9c85e6ecc85a5b85e4dc35f91d00a68a37c not found: ID does not exist"
Sep 08 10:31:32.271930 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.271911    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"]
Sep 08 10:31:32.274112 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:32.274092    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-d6e53c-5767f9886b-b4ksc"]
Sep 08 10:31:33.909238 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:31:33.909192    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3c01553c-99be-48f6-a7d4-8ddc2d748a98" path="/var/lib/kubelet/pods/3c01553c-99be-48f6-a7d4-8ddc2d748a98/volumes"
Sep 08 10:36:30.202366 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:30.202338    2582 scope.go:117] "RemoveContainer" containerID="47c47d0b2d9f318385fe513d79d773b440d54eaf934e751231e6758d862ff421"
Sep 08 10:36:30.210085 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:30.210063    2582 scope.go:117] "RemoveContainer" containerID="4bd85e5c55dcd0826ec4cada2f71f64b52b5d205f5e8d2da64fb5adef01ea5b6"
Sep 08 10:36:31.951157 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951128    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"]
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951444    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1aefae8-9dc0-4b43-8ceb-2f18f1762f94" containerName="cleanup"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951457    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1aefae8-9dc0-4b43-8ceb-2f18f1762f94" containerName="cleanup"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951467    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9edd88-0e0d-4ac1-8041-330fe95c8f51" containerName="payload-processing"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951472    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9edd88-0e0d-4ac1-8041-330fe95c8f51" containerName="payload-processing"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951480    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15c608db-1857-43bb-8dd3-4e2cd35fa4f9" containerName="cleanup"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951486    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="15c608db-1857-43bb-8dd3-4e2cd35fa4f9" containerName="cleanup"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951499    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c01553c-99be-48f6-a7d4-8ddc2d748a98" containerName="maas-api"
Sep 08 10:36:31.951534 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951504    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c01553c-99be-48f6-a7d4-8ddc2d748a98" containerName="maas-api"
Sep 08 10:36:31.951801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951559    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="15c608db-1857-43bb-8dd3-4e2cd35fa4f9" containerName="cleanup"
Sep 08 10:36:31.951801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951566    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1aefae8-9dc0-4b43-8ceb-2f18f1762f94" containerName="cleanup"
Sep 08 10:36:31.951801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951573    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f9edd88-0e0d-4ac1-8041-330fe95c8f51" containerName="payload-processing"
Sep 08 10:36:31.951801 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.951581    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c01553c-99be-48f6-a7d4-8ddc2d748a98" containerName="maas-api"
Sep 08 10:36:31.955828 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.955804    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:31.958095 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.958075    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-fce34d90-kserve-self-signed-certs\""
Sep 08 10:36:31.962537 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:31.962516    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"]
Sep 08 10:36:32.068203 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.068167    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-home\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.068203 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.068209    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-dshm\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.068420 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.068245    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-tmp-dir\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.068420 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.068351    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqpd4\" (UniqueName: \"kubernetes.io/projected/21e86c1a-538d-44fe-9d0a-f01afa574dff-kube-api-access-qqpd4\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.068420 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.068409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-model-cache\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.068518 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.068458    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e86c1a-538d-44fe-9d0a-f01afa574dff-tls-certs\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.168879 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.168843    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-home\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.168879 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.168886    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-dshm\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169079 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.168907    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-tmp-dir\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169079 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.168962    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqpd4\" (UniqueName: \"kubernetes.io/projected/21e86c1a-538d-44fe-9d0a-f01afa574dff-kube-api-access-qqpd4\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169079 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.169018    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-model-cache\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169079 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.169054    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e86c1a-538d-44fe-9d0a-f01afa574dff-tls-certs\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169437 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.169404    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-home\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169437 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.169421    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-tmp-dir\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.169644 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.169509    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-model-cache\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.171155 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.171131    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-dshm\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.171491 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.171474    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e86c1a-538d-44fe-9d0a-f01afa574dff-tls-certs\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.177380 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.177357    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqpd4\" (UniqueName: \"kubernetes.io/projected/21e86c1a-538d-44fe-9d0a-f01afa574dff-kube-api-access-qqpd4\") pod \"e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") " pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.265656 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.265599    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:32.534738 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.534659    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"]
Sep 08 10:36:32.537607 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:36:32.537577    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod21e86c1a_538d_44fe_9d0a_f01afa574dff.slice/crio-239c4c02def55d07e4fdf0e189c8dcee0b03ff1d41c7016e633e800f06159094 WatchSource:0}: Error finding container 239c4c02def55d07e4fdf0e189c8dcee0b03ff1d41c7016e633e800f06159094: Status 404 returned error can't find the container with id 239c4c02def55d07e4fdf0e189c8dcee0b03ff1d41c7016e633e800f06159094
Sep 08 10:36:32.571053 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:32.571031    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t" event={"ID":"21e86c1a-538d-44fe-9d0a-f01afa574dff","Type":"ContainerStarted","Data":"239c4c02def55d07e4fdf0e189c8dcee0b03ff1d41c7016e633e800f06159094"}
Sep 08 10:36:33.576740 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:33.576705    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t" event={"ID":"21e86c1a-538d-44fe-9d0a-f01afa574dff","Type":"ContainerStarted","Data":"73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3"}
Sep 08 10:36:33.592743 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:33.592696    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t" podStartSLOduration=2.59268096 podStartE2EDuration="2.59268096s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:36:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:36:33.592475736 +0000 UTC m=+2104.169346189" watchObservedRunningTime="2026-09-08 10:36:33.59268096 +0000 UTC m=+2104.169551400"
Sep 08 10:36:42.266713 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:42.266672    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:42.267256 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:42.266728    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:42.279257 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:42.279213    2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:36:42.626310 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:36:42.626216    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:37:01.745314 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:01.745276    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"]
Sep 08 10:37:16.764592 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:16.764531    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t" podUID="21e86c1a-538d-44fe-9d0a-f01afa574dff" containerName="main" containerID="cri-o://73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3" gracePeriod=45
Sep 08 10:37:17.004476 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.004453    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:37:17.114784 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114718    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-tmp-dir\") pod \"21e86c1a-538d-44fe-9d0a-f01afa574dff\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") "
Sep 08 10:37:17.114911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114797    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-dshm\") pod \"21e86c1a-538d-44fe-9d0a-f01afa574dff\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") "
Sep 08 10:37:17.114911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114849    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-model-cache\") pod \"21e86c1a-538d-44fe-9d0a-f01afa574dff\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") "
Sep 08 10:37:17.114911 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114897    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqpd4\" (UniqueName: \"kubernetes.io/projected/21e86c1a-538d-44fe-9d0a-f01afa574dff-kube-api-access-qqpd4\") pod \"21e86c1a-538d-44fe-9d0a-f01afa574dff\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") "
Sep 08 10:37:17.115082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114936    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e86c1a-538d-44fe-9d0a-f01afa574dff-tls-certs\") pod \"21e86c1a-538d-44fe-9d0a-f01afa574dff\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") "
Sep 08 10:37:17.115082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114948    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "21e86c1a-538d-44fe-9d0a-f01afa574dff" (UID: "21e86c1a-538d-44fe-9d0a-f01afa574dff"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:37:17.115082 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.114962    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-home\") pod \"21e86c1a-538d-44fe-9d0a-f01afa574dff\" (UID: \"21e86c1a-538d-44fe-9d0a-f01afa574dff\") "
Sep 08 10:37:17.115270 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.115116    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-model-cache" (OuterVolumeSpecName: "model-cache") pod "21e86c1a-538d-44fe-9d0a-f01afa574dff" (UID: "21e86c1a-538d-44fe-9d0a-f01afa574dff"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:37:17.115270 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.115197    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-home" (OuterVolumeSpecName: "home") pod "21e86c1a-538d-44fe-9d0a-f01afa574dff" (UID: "21e86c1a-538d-44fe-9d0a-f01afa574dff"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:37:17.115382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.115339    2582 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-model-cache\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:17.115382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.115356    2582 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-home\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:17.115382 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.115370    2582 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-tmp-dir\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:17.116780 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.116760    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-dshm" (OuterVolumeSpecName: "dshm") pod "21e86c1a-538d-44fe-9d0a-f01afa574dff" (UID: "21e86c1a-538d-44fe-9d0a-f01afa574dff"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 10:37:17.116928 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.116904    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/21e86c1a-538d-44fe-9d0a-f01afa574dff-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "21e86c1a-538d-44fe-9d0a-f01afa574dff" (UID: "21e86c1a-538d-44fe-9d0a-f01afa574dff"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:17.116997 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.116908    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e86c1a-538d-44fe-9d0a-f01afa574dff-kube-api-access-qqpd4" (OuterVolumeSpecName: "kube-api-access-qqpd4") pod "21e86c1a-538d-44fe-9d0a-f01afa574dff" (UID: "21e86c1a-538d-44fe-9d0a-f01afa574dff"). InnerVolumeSpecName "kube-api-access-qqpd4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:37:17.216515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.216493    2582 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/21e86c1a-538d-44fe-9d0a-f01afa574dff-dshm\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:17.216515 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.216513    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqpd4\" (UniqueName: \"kubernetes.io/projected/21e86c1a-538d-44fe-9d0a-f01afa574dff-kube-api-access-qqpd4\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:17.216639 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.216524    2582 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/21e86c1a-538d-44fe-9d0a-f01afa574dff-tls-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:17.767143 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.767110    2582 generic.go:356] "Generic (PLEG): container finished" podID="21e86c1a-538d-44fe-9d0a-f01afa574dff" containerID="73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3" exitCode=0
Sep 08 10:37:17.767551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.767153    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"
Sep 08 10:37:17.767551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.767194    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t" event={"ID":"21e86c1a-538d-44fe-9d0a-f01afa574dff","Type":"ContainerDied","Data":"73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3"}
Sep 08 10:37:17.767551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.767246    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t" event={"ID":"21e86c1a-538d-44fe-9d0a-f01afa574dff","Type":"ContainerDied","Data":"239c4c02def55d07e4fdf0e189c8dcee0b03ff1d41c7016e633e800f06159094"}
Sep 08 10:37:17.767551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.767266    2582 scope.go:117] "RemoveContainer" containerID="73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3"
Sep 08 10:37:17.776316 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.776299    2582 scope.go:117] "RemoveContainer" containerID="73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3"
Sep 08 10:37:17.776567 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:37:17.776547    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3\": container with ID starting with 73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3 not found: ID does not exist" containerID="73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3"
Sep 08 10:37:17.776632 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.776579    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3"} err="failed to get container status \"73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3\": rpc error: code = NotFound desc = could not find container \"73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3\": container with ID starting with 73cc9b267ac8d4db4d71a77b915e94ee8db5c0a4594647de814666e3bdd626d3 not found: ID does not exist"
Sep 08 10:37:17.787808 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.787784    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"]
Sep 08 10:37:17.791512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.791493    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-fce34d90-kserve-7897d747f9-m5z2t"]
Sep 08 10:37:17.911037 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:17.911015    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21e86c1a-538d-44fe-9d0a-f01afa574dff" path="/var/lib/kubelet/pods/21e86c1a-538d-44fe-9d0a-f01afa574dff/volumes"
Sep 08 10:37:18.836442 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.836413    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"]
Sep 08 10:37:18.836892 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.836855    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e86c1a-538d-44fe-9d0a-f01afa574dff" containerName="main"
Sep 08 10:37:18.836892 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.836873    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e86c1a-538d-44fe-9d0a-f01afa574dff" containerName="main"
Sep 08 10:37:18.837010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.836978    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e86c1a-538d-44fe-9d0a-f01afa574dff" containerName="main"
Sep 08 10:37:18.841200 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.841179    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:18.845016 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.844996    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w6wth\""
Sep 08 10:37:18.845124 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.845016    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 10:37:18.845124 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.845047    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 10:37:18.849283 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.849264    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"]
Sep 08 10:37:18.929135 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.929092    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c819149-94ef-4be7-8859-25aa74952095-openshift-service-ca\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:18.929288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.929151    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-metrics-certs\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:18.929288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.929218    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-maas-api-tls\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:18.929421 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:18.929354    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gj9d\" (UniqueName: \"kubernetes.io/projected/0c819149-94ef-4be7-8859-25aa74952095-kube-api-access-2gj9d\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.029797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.029771    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c819149-94ef-4be7-8859-25aa74952095-openshift-service-ca\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.029952 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.029812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-metrics-certs\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.029952 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.029839    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-maas-api-tls\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.029952 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.029915    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gj9d\" (UniqueName: \"kubernetes.io/projected/0c819149-94ef-4be7-8859-25aa74952095-kube-api-access-2gj9d\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.030462 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.030439    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c819149-94ef-4be7-8859-25aa74952095-openshift-service-ca\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.032027 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.032006    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-maas-api-tls\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.032177 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.032160    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-metrics-certs\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.037324 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.037301    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gj9d\" (UniqueName: \"kubernetes.io/projected/0c819149-94ef-4be7-8859-25aa74952095-kube-api-access-2gj9d\") pod \"maas-api-787f6cbf7b-xz77g\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") " pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.152908 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.152807    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:19.424897 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.424873    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"]
Sep 08 10:37:19.427130 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:37:19.427091    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c819149_94ef_4be7_8859_25aa74952095.slice/crio-0123224abc6b823d983f5c63ac80b4c118b1865a87803f065b7035c1b12daf6b WatchSource:0}: Error finding container 0123224abc6b823d983f5c63ac80b4c118b1865a87803f065b7035c1b12daf6b: Status 404 returned error can't find the container with id 0123224abc6b823d983f5c63ac80b4c118b1865a87803f065b7035c1b12daf6b
Sep 08 10:37:19.428504 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.428486    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 10:37:19.781152 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:19.781079    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g" event={"ID":"0c819149-94ef-4be7-8859-25aa74952095","Type":"ContainerStarted","Data":"0123224abc6b823d983f5c63ac80b4c118b1865a87803f065b7035c1b12daf6b"}
Sep 08 10:37:20.786288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:20.786251    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g" event={"ID":"0c819149-94ef-4be7-8859-25aa74952095","Type":"ContainerStarted","Data":"b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8"}
Sep 08 10:37:20.786658 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:20.786320    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:20.803906 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:20.803862    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g" podStartSLOduration=1.8973056590000001 podStartE2EDuration="2.803834932s" totalImagesPullingTime="906.529273ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:37:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:37:20.803210249 +0000 UTC m=+2151.380080693" watchObservedRunningTime="2026-09-08 10:37:20.803834932 +0000 UTC m=+2151.380705374"
Sep 08 10:37:26.186245 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.186141    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"]
Sep 08 10:37:26.186685 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.186388    2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g" podUID="0c819149-94ef-4be7-8859-25aa74952095" containerName="maas-api" containerID="cri-o://b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8" gracePeriod=30
Sep 08 10:37:26.191528 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.191450    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:26.219627 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.219597    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"]
Sep 08 10:37:26.222720 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.222700    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.237654 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.237622    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"]
Sep 08 10:37:26.383821 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.383784    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/984d44eb-8bc6-447e-90de-8867a745d854-openshift-service-ca\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.383821 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.383822    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/984d44eb-8bc6-447e-90de-8867a745d854-maas-api-tls\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.384046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.383916    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnxnf\" (UniqueName: \"kubernetes.io/projected/984d44eb-8bc6-447e-90de-8867a745d854-kube-api-access-jnxnf\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.384046 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.383950    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984d44eb-8bc6-447e-90de-8867a745d854-metrics-certs\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.430840 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.430820    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:26.485083 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.485025    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnxnf\" (UniqueName: \"kubernetes.io/projected/984d44eb-8bc6-447e-90de-8867a745d854-kube-api-access-jnxnf\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.485083 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.485058    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984d44eb-8bc6-447e-90de-8867a745d854-metrics-certs\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.485246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.485104    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/984d44eb-8bc6-447e-90de-8867a745d854-openshift-service-ca\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.485246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.485137    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/984d44eb-8bc6-447e-90de-8867a745d854-maas-api-tls\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.485786 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.485761    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/984d44eb-8bc6-447e-90de-8867a745d854-openshift-service-ca\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.487474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.487445    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/984d44eb-8bc6-447e-90de-8867a745d854-maas-api-tls\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.487474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.487463    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/984d44eb-8bc6-447e-90de-8867a745d854-metrics-certs\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.493864 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.493837    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnxnf\" (UniqueName: \"kubernetes.io/projected/984d44eb-8bc6-447e-90de-8867a745d854-kube-api-access-jnxnf\") pod \"maas-api-7cdb685b44-nn6bl\" (UID: \"984d44eb-8bc6-447e-90de-8867a745d854\") " pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.573762 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.573739    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:26.585818 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.585796    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-maas-api-tls\") pod \"0c819149-94ef-4be7-8859-25aa74952095\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") "
Sep 08 10:37:26.585941 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.585926    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gj9d\" (UniqueName: \"kubernetes.io/projected/0c819149-94ef-4be7-8859-25aa74952095-kube-api-access-2gj9d\") pod \"0c819149-94ef-4be7-8859-25aa74952095\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") "
Sep 08 10:37:26.585979 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.585965    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-metrics-certs\") pod \"0c819149-94ef-4be7-8859-25aa74952095\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") "
Sep 08 10:37:26.586028 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.586005    2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c819149-94ef-4be7-8859-25aa74952095-openshift-service-ca\") pod \"0c819149-94ef-4be7-8859-25aa74952095\" (UID: \"0c819149-94ef-4be7-8859-25aa74952095\") "
Sep 08 10:37:26.586398 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.586372    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c819149-94ef-4be7-8859-25aa74952095-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0c819149-94ef-4be7-8859-25aa74952095" (UID: "0c819149-94ef-4be7-8859-25aa74952095"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 10:37:26.587706 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.587676    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0c819149-94ef-4be7-8859-25aa74952095" (UID: "0c819149-94ef-4be7-8859-25aa74952095"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:26.588330 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.588307    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c819149-94ef-4be7-8859-25aa74952095-kube-api-access-2gj9d" (OuterVolumeSpecName: "kube-api-access-2gj9d") pod "0c819149-94ef-4be7-8859-25aa74952095" (UID: "0c819149-94ef-4be7-8859-25aa74952095"). InnerVolumeSpecName "kube-api-access-2gj9d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 10:37:26.588402 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.588309    2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0c819149-94ef-4be7-8859-25aa74952095" (UID: "0c819149-94ef-4be7-8859-25aa74952095"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 10:37:26.686797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.686766    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gj9d\" (UniqueName: \"kubernetes.io/projected/0c819149-94ef-4be7-8859-25aa74952095-kube-api-access-2gj9d\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:26.686797 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.686795    2582 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-metrics-certs\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:26.686948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.686806    2582 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0c819149-94ef-4be7-8859-25aa74952095-openshift-service-ca\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:26.686948 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.686815    2582 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0c819149-94ef-4be7-8859-25aa74952095-maas-api-tls\") on node \"ip-10-0-134-238.ec2.internal\" DevicePath \"\""
Sep 08 10:37:26.814010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.813946    2582 generic.go:356] "Generic (PLEG): container finished" podID="0c819149-94ef-4be7-8859-25aa74952095" containerID="b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8" exitCode=0
Sep 08 10:37:26.814010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.813980    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g" event={"ID":"0c819149-94ef-4be7-8859-25aa74952095","Type":"ContainerDied","Data":"b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8"}
Sep 08 10:37:26.814010 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.813999    2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"
Sep 08 10:37:26.814176 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.814043    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g" event={"ID":"0c819149-94ef-4be7-8859-25aa74952095","Type":"ContainerDied","Data":"0123224abc6b823d983f5c63ac80b4c118b1865a87803f065b7035c1b12daf6b"}
Sep 08 10:37:26.814176 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.814075    2582 scope.go:117] "RemoveContainer" containerID="b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8"
Sep 08 10:37:26.822474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.822430    2582 scope.go:117] "RemoveContainer" containerID="b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8"
Sep 08 10:37:26.822807 ip-10-0-134-238 kubenswrapper[2582]: E0908 10:37:26.822784    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8\": container with ID starting with b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8 not found: ID does not exist" containerID="b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8"
Sep 08 10:37:26.822891 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.822814    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8"} err="failed to get container status \"b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8\": rpc error: code = NotFound desc = could not find container \"b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8\": container with ID starting with b41e374d6da299060006e5199a1b6e99ed58dac3cf546d36e9e196bac06b86c8 not found: ID does not exist"
Sep 08 10:37:26.835999 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.835976    2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"]
Sep 08 10:37:26.839934 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.839915    2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-787f6cbf7b-xz77g"]
Sep 08 10:37:26.843255 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:26.843207    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"]
Sep 08 10:37:26.845176 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:37:26.845158    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod984d44eb_8bc6_447e_90de_8867a745d854.slice/crio-2932c39ce7b64cfcc0edfec400f3eb604c2e56f77025cdb46f2397cc2ee8fc4e WatchSource:0}: Error finding container 2932c39ce7b64cfcc0edfec400f3eb604c2e56f77025cdb46f2397cc2ee8fc4e: Status 404 returned error can't find the container with id 2932c39ce7b64cfcc0edfec400f3eb604c2e56f77025cdb46f2397cc2ee8fc4e
Sep 08 10:37:27.819761 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:27.819724    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl" event={"ID":"984d44eb-8bc6-447e-90de-8867a745d854","Type":"ContainerStarted","Data":"60958cb842734f8e21a903e01fdc5368ebcb2c6e4d825e18a9dfc7c19de450b6"}
Sep 08 10:37:27.820212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:27.819774    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl" event={"ID":"984d44eb-8bc6-447e-90de-8867a745d854","Type":"ContainerStarted","Data":"2932c39ce7b64cfcc0edfec400f3eb604c2e56f77025cdb46f2397cc2ee8fc4e"}
Sep 08 10:37:27.820212 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:27.819804    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:27.838153 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:27.838110    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl" podStartSLOduration=1.49513914 podStartE2EDuration="1.838096218s" totalImagesPullingTime="342.957078ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 10:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:37:27.836102962 +0000 UTC m=+2158.412973404" watchObservedRunningTime="2026-09-08 10:37:27.838096218 +0000 UTC m=+2158.414966659"
Sep 08 10:37:27.909195 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:27.909166    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c819149-94ef-4be7-8859-25aa74952095" path="/var/lib/kubelet/pods/0c819149-94ef-4be7-8859-25aa74952095/volumes"
Sep 08 10:37:33.829464 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:33.829434    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7cdb685b44-nn6bl"
Sep 08 10:37:57.121040 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:57.121009    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b6d9c7b-mcc2r_f950f3e5-307a-49ee-8eea-7462bd4f8927/copy-manifests/0.log"
Sep 08 10:37:57.133946 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:57.133920    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b6d9c7b-mcc2r_f950f3e5-307a-49ee-8eea-7462bd4f8927/manager/0.log"
Sep 08 10:37:57.710659 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:57.710631    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7cdb685b44-nn6bl_984d44eb-8bc6-447e-90de-8867a745d854/maas-api/0.log"
Sep 08 10:37:58.068896 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:58.068818    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-gd9zh_d04e2af6-dd9e-49f8-8a73-a58e8e7c0e10/postgres/0.log"
Sep 08 10:37:59.964415 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:37:59.964385    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh_6054a48a-1501-46f0-af6f-12d366da74e9/istio-proxy/0.log"
Sep 08 10:38:00.095770 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:00.095735    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5mfj_883d5193-2afb-4799-972a-e4bcb83b4818/discovery/0.log"
Sep 08 10:38:01.303441 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:01.303414    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-4h8gm_d67dec95-9790-45a7-9023-3d604ea42cbb/main/0.log"
Sep 08 10:38:01.545508 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:01.545482    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-mdv4q_61cbcb9e-fe5d-426e-bbab-4c02dc0ec265/main/0.log"
Sep 08 10:38:01.665694 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:01.665671    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fd7qcd_d704425f-9d98-4c3c-9d3a-a998eb33b489/main/0.log"
Sep 08 10:38:10.813512 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:10.813480    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h77q7_2ddb8591-faf6-4515-8ba1-25561d0ae449/global-pull-secret-syncer/0.log"
Sep 08 10:38:10.950290 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:10.950265    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f4gj7_49eeed69-95e9-45e7-9075-98e36c95819f/konnectivity-agent/0.log"
Sep 08 10:38:11.088337 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:11.088275    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-238.ec2.internal_385c83f897bbb0f00e8342d23450ac7c/haproxy/0.log"
Sep 08 10:38:17.618288 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:17.618254    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-54759f49b9-kb7kh_70bbb607-dfe6-4c44-9260-0b735dca4a36/metrics-server/0.log"
Sep 08 10:38:17.713246 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:17.713206    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jf7r_e5399135-2eb2-493c-9b83-1370f654b6bd/node-exporter/0.log"
Sep 08 10:38:17.738991 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:17.738967    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jf7r_e5399135-2eb2-493c-9b83-1370f654b6bd/kube-rbac-proxy/0.log"
Sep 08 10:38:17.770913 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:17.770892    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4jf7r_e5399135-2eb2-493c-9b83-1370f654b6bd/init-textfile/0.log"
Sep 08 10:38:17.995725 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:17.995702    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-29bdq_c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd/kube-rbac-proxy-main/0.log"
Sep 08 10:38:18.021920 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.021896    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-29bdq_c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd/kube-rbac-proxy-self/0.log"
Sep 08 10:38:18.044559 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.044538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-29bdq_c2f2f2f4-4c91-4ce8-9109-e8d8ab4d15dd/openshift-state-metrics/0.log"
Sep 08 10:38:18.318619 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.318547    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-78f599db79-5c6mq_8cdee483-6036-4baf-a83c-2f0ced2eece6/prometheus-operator-admission-webhook/0.log"
Sep 08 10:38:18.441541 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.441510    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bdb4b65d-hd7ln_3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b/thanos-query/0.log"
Sep 08 10:38:18.467354 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.467326    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bdb4b65d-hd7ln_3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b/kube-rbac-proxy-web/0.log"
Sep 08 10:38:18.493147 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.493132    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bdb4b65d-hd7ln_3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b/kube-rbac-proxy/0.log"
Sep 08 10:38:18.523565 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.523544    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bdb4b65d-hd7ln_3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b/prom-label-proxy/0.log"
Sep 08 10:38:18.550820 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.550796    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bdb4b65d-hd7ln_3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b/kube-rbac-proxy-rules/0.log"
Sep 08 10:38:18.575954 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:18.575900    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-86bdb4b65d-hd7ln_3e3cc946-cd3c-4cb1-b29e-07ec9e7bb11b/kube-rbac-proxy-metrics/0.log"
Sep 08 10:38:21.147064 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.147033    2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"]
Sep 08 10:38:21.147472 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.147390    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c819149-94ef-4be7-8859-25aa74952095" containerName="maas-api"
Sep 08 10:38:21.147472 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.147402    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c819149-94ef-4be7-8859-25aa74952095" containerName="maas-api"
Sep 08 10:38:21.147551 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.147475    2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c819149-94ef-4be7-8859-25aa74952095" containerName="maas-api"
Sep 08 10:38:21.150448 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.150428    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.152597 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.152577    2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q6fc7\"/\"default-dockercfg-hchl5\""
Sep 08 10:38:21.153859 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.153840    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6fc7\"/\"kube-root-ca.crt\""
Sep 08 10:38:21.153958 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.153856    2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6fc7\"/\"openshift-service-ca.crt\""
Sep 08 10:38:21.159352 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.159329    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"]
Sep 08 10:38:21.286581 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.286554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-lib-modules\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.286696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.286583    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hwl2\" (UniqueName: \"kubernetes.io/projected/fdc1bd61-134c-49b8-814a-c0073b057f49-kube-api-access-7hwl2\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.286696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.286640    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-proc\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.286696 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.286675    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-podres\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.286806 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.286729    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-sys\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.387842 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.387812    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-lib-modules\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.387967 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.387845    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hwl2\" (UniqueName: \"kubernetes.io/projected/fdc1bd61-134c-49b8-814a-c0073b057f49-kube-api-access-7hwl2\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.387967 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.387885    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-proc\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.387967 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.387923    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-podres\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.387967 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.387961    2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-sys\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.388182 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.388004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-lib-modules\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.388182 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.388004    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-proc\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.388182 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.388064    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-podres\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.388182 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.388053    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fdc1bd61-134c-49b8-814a-c0073b057f49-sys\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.397128 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.397081    2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hwl2\" (UniqueName: \"kubernetes.io/projected/fdc1bd61-134c-49b8-814a-c0073b057f49-kube-api-access-7hwl2\") pod \"perf-node-gather-daemonset-p99p5\" (UID: \"fdc1bd61-134c-49b8-814a-c0073b057f49\") " pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.461430 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.461396    2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:21.727894 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:21.727745    2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"]
Sep 08 10:38:21.732897 ip-10-0-134-238 kubenswrapper[2582]: W0908 10:38:21.732869    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podfdc1bd61_134c_49b8_814a_c0073b057f49.slice/crio-82493c0813fb13509c652ced295a70734207038fa5396a6f286e2cf9b2e7a891 WatchSource:0}: Error finding container 82493c0813fb13509c652ced295a70734207038fa5396a6f286e2cf9b2e7a891: Status 404 returned error can't find the container with id 82493c0813fb13509c652ced295a70734207038fa5396a6f286e2cf9b2e7a891
Sep 08 10:38:22.048474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:22.048382    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5" event={"ID":"fdc1bd61-134c-49b8-814a-c0073b057f49","Type":"ContainerStarted","Data":"f21515831db86c6c78fef8d4290d62a37f1c045d5ae5e2e5d028c6a9d137b460"}
Sep 08 10:38:22.048474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:22.048447    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:22.048474 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:22.048470    2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5" event={"ID":"fdc1bd61-134c-49b8-814a-c0073b057f49","Type":"ContainerStarted","Data":"82493c0813fb13509c652ced295a70734207038fa5396a6f286e2cf9b2e7a891"}
Sep 08 10:38:22.068872 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:22.068826    2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5" podStartSLOduration=1.068811525 podStartE2EDuration="1.068811525s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 10:38:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 10:38:22.067522081 +0000 UTC m=+2212.644392522" watchObservedRunningTime="2026-09-08 10:38:22.068811525 +0000 UTC m=+2212.645681998"
Sep 08 10:38:23.181033 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:23.181002    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vxh22_b014ffaf-631e-4b5a-b7f6-f8972f5b0350/dns/0.log"
Sep 08 10:38:23.203589 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:23.203566    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vxh22_b014ffaf-631e-4b5a-b7f6-f8972f5b0350/kube-rbac-proxy/0.log"
Sep 08 10:38:23.254303 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:23.254282    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-6rqzs_b836398d-00f0-4d38-9dc6-21c41faa914c/dns-node-resolver/0.log"
Sep 08 10:38:23.906494 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:23.906468    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wqszc_480b3071-c19a-4100-8b33-c1ea2c8f1345/node-ca/0.log"
Sep 08 10:38:24.880089 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:24.880060    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh_6054a48a-1501-46f0-af6f-12d366da74e9/istio-proxy/0.log"
Sep 08 10:38:25.175404 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:25.175376    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5mfj_883d5193-2afb-4799-972a-e4bcb83b4818/discovery/0.log"
Sep 08 10:38:26.283625 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:26.283593    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xkf7f_3cb472e7-9c97-4699-9d3e-a06d5e863f84/serve-healthcheck-canary/0.log"
Sep 08 10:38:26.887829 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:26.887803    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r4grg_18ac5029-1b88-48ad-b4dc-078e9b169ca9/kube-rbac-proxy/0.log"
Sep 08 10:38:26.914609 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:26.914588    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r4grg_18ac5029-1b88-48ad-b4dc-078e9b169ca9/exporter/0.log"
Sep 08 10:38:26.969397 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:26.969375    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-r4grg_18ac5029-1b88-48ad-b4dc-078e9b169ca9/extractor/0.log"
Sep 08 10:38:28.061107 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:28.061082    2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q6fc7/perf-node-gather-daemonset-p99p5"
Sep 08 10:38:29.915574 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:29.915538    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b6d9c7b-mcc2r_f950f3e5-307a-49ee-8eea-7462bd4f8927/manager/0.log"
Sep 08 10:38:29.935037 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:29.935015    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56b6d9c7b-mcc2r_f950f3e5-307a-49ee-8eea-7462bd4f8927/copy-manifests/0.log"
Sep 08 10:38:30.980355 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:30.980327    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh_6054a48a-1501-46f0-af6f-12d366da74e9/istio-proxy/0.log"
Sep 08 10:38:31.253728 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:31.253699    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5mfj_883d5193-2afb-4799-972a-e4bcb83b4818/discovery/0.log"
Sep 08 10:38:31.370862 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:31.370835    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-86bd4f8cd9-z4ssg_4bc310fc-1a5f-43b8-a8d0-46bfd25dabdb/manager/0.log"
Sep 08 10:38:31.403077 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:31.403055    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-bd2ck_02d6a740-d49c-4ee5-99c5-ea9517dc7e14/openshift-lws-operator/0.log"
Sep 08 10:38:33.071819 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:33.071789    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-d66cd8c7c-r64jh_6054a48a-1501-46f0-af6f-12d366da74e9/istio-proxy/0.log"
Sep 08 10:38:33.348182 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:33.348101    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-s5mfj_883d5193-2afb-4799-972a-e4bcb83b4818/discovery/0.log"
Sep 08 10:38:38.556423 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.556397    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/kube-multus-additional-cni-plugins/0.log"
Sep 08 10:38:38.581495 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.581474    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/egress-router-binary-copy/0.log"
Sep 08 10:38:38.615926 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.615906    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/cni-plugins/0.log"
Sep 08 10:38:38.646013 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.645991    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/bond-cni-plugin/0.log"
Sep 08 10:38:38.671037 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.671019    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/routeoverride-cni/0.log"
Sep 08 10:38:38.694199 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.694178    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/whereabouts-cni-bincopy/0.log"
Sep 08 10:38:38.717902 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.717885    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-x62rj_76973019-5f8b-42a5-81c3-721fe34b693e/whereabouts-cni/0.log"
Sep 08 10:38:38.758030 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.758005    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-kph8l_bfb27648-24f1-44be-94ce-c0de0d6ae96f/kube-multus/0.log"
Sep 08 10:38:38.827437 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.827351    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g8fbd_002fb92f-e88e-4750-afd4-9b718c3bb935/network-metrics-daemon/0.log"
Sep 08 10:38:38.850463 ip-10-0-134-238 kubenswrapper[2582]: I0908 10:38:38.850445    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g8fbd_002fb92f-e88e-4750-afd4-9b718c3bb935/kube-rbac-proxy/0.log"