Sep 06 12:17:38.061408 ip-10-0-130-145 systemd[1]: Starting Kubernetes Kubelet...
Sep 06 12:17:38.502253 ip-10-0-130-145 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 12:17:38.502253 ip-10-0-130-145 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 06 12:17:38.502253 ip-10-0-130-145 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 12:17:38.502253 ip-10-0-130-145 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 06 12:17:38.502253 ip-10-0-130-145 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 06 12:17:38.503228 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.503110    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 06 12:17:38.510124 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510109    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:38.510124 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510123    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510127    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510131    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510134    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510138    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510143    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510157    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510160    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510163    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510166    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510169    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510171    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510174    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510177    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510180    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510182    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510185    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510187    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510191    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:38.510202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510194    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510196    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510199    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510201    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510204    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510207    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510210    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510213    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510216    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510218    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510222    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510225    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510227    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510230    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510233    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510236    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510238    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510240    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510243    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510245    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:38.510678 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510248    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510250    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510253    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510256    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510258    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510261    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510263    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510266    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510268    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510271    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510273    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510276    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510278    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510280    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510284    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510286    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510289    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510292    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510294    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510297    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:38.511180 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510300    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510302    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510305    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510310    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510313    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510316    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510319    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510322    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510325    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510327    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510331    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510336    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510339    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510341    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510344    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510347    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510350    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510353    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510356    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:38.511665 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510358    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510361    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510363    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510366    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510368    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510370    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510373    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510376    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510379    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510382    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510384    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510387    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510389    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510392    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510394    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510397    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510399    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510402    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510404    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.510407    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:38.512113 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511073    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511079    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511082    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511085    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511088    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511091    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511093    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511096    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511099    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511102    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511105    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511107    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511110    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511113    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511115    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511118    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511120    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511123    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511126    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511129    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:38.512622 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511132    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511135    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511138    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511140    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511143    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511161    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511166    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511170    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511174    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511178    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511181    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511184    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511187    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511190    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511192    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511195    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511198    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511200    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511203    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511207    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:38.513162 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511212    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511215    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511219    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511222    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511224    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511227    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511230    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511233    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511235    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511238    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511240    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511244    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511247    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511250    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511252    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511255    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511257    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511260    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511262    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511265    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:38.513671 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511267    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511270    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511272    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511274    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511277    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511279    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511282    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511284    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511287    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511289    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511292    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511294    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511297    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511299    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511303    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511307    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511311    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511314    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511317    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:38.514165 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511320    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511323    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511326    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511329    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511334    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511338    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511340    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511343    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511346    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511349    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511352    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511354    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511357    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511359    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511362    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511365    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511367    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511369    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511372    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:38.514628 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511374    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511748    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511753    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511755    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511758    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511761    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511763    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511766    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511768    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511772    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511775    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511778    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511780    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511783    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511786    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511788    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511791    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511793    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511796    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511799    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:38.515094 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511801    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511804    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511807    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511809    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511812    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511814    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511817    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511819    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511822    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511824    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511827    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511829    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511832    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511834    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511838    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511841    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511844    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511846    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511849    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:38.515679 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511851    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511854    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511856    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511859    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511862    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511864    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511867    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511869    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511872    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511874    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511877    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511880    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511882    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511885    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511888    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511890    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511893    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511895    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511898    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511900    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:38.516156 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511903    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511906    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511910    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511913    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511916    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511920    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511924    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511926    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511929    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511932    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511935    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511937    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511940    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511943    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511947    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511951    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511955    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511958    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511978    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:38.516657 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511982    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511986    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511989    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511992    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511995    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.511998    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512001    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512003    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512006    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512009    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512011    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512014    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512016    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512019    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512021    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512024    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512027    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512029    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512031    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512034    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:38.517118 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512036    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512039    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512113    2578 flags.go:64] FLAG: --address="0.0.0.0"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512168    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512176    2578 flags.go:64] FLAG: --anonymous-auth="true"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512180    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512185    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512188    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512192    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512198    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512202    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512205    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512208    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512211    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512216    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512219    2578 flags.go:64] FLAG: --cgroup-root=""
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512222    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512226    2578 flags.go:64] FLAG: --client-ca-file=""
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512229    2578 flags.go:64] FLAG: --cloud-provider="external"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512231    2578 flags.go:64] FLAG: --cluster-dns="[]"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512239    2578 flags.go:64] FLAG: --cluster-domain=""
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512242    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512245    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512248    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 06 12:17:38.517625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512252    2578 flags.go:64] FLAG: --container-log-max-files="5"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512255    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512258    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512261    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512264    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512267    2578 flags.go:64] FLAG: --contention-profiling="false"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512270    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512274    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512277    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512280    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512283    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512287    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512290    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512292    2578 flags.go:64] FLAG: --enable-load-reader="false"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512295    2578 flags.go:64] FLAG: --enable-server="true"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512298    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512305    2578 flags.go:64] FLAG: --event-burst="100"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512309    2578 flags.go:64] FLAG: --event-qps="50"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512312    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512315    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512319    2578 flags.go:64] FLAG: --eviction-hard=""
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512322    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512326    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512329    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512332    2578 flags.go:64] FLAG: --eviction-soft=""
Sep 06 12:17:38.518203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512335    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512338    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512341    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512344    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512346    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512350    2578 flags.go:64] FLAG: --fail-swap-on="true"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512352    2578 flags.go:64] FLAG: --feature-gates=""
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512356    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512359    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512362    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512365    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512367    2578 flags.go:64] FLAG: --healthz-port="10248"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512370    2578 flags.go:64] FLAG: --help="false"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512373    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512376    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512379    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512382    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512385    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512388    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512391    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512394    2578 flags.go:64] FLAG: --image-service-endpoint=""
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512397    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512399    2578 flags.go:64] FLAG: --kube-api-burst="100"
Sep 06 12:17:38.518841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512402    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512407    2578 flags.go:64] FLAG: --kube-api-qps="50"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512409    2578 flags.go:64] FLAG: --kube-reserved=""
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512412    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512415    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512418    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512422    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512425    2578 flags.go:64] FLAG: --lock-file=""
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512428    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512431    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512434    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512439    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512442    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512444    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512447    2578 flags.go:64] FLAG: --logging-format="text"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512450    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512453    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512456    2578 flags.go:64] FLAG: --manifest-url=""
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512459    2578 flags.go:64] FLAG: --manifest-url-header=""
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512463    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512466    2578 flags.go:64] FLAG: --max-open-files="1000000"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512470    2578 flags.go:64] FLAG: --max-pods="110"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512473    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512476    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512478    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 06 12:17:38.519432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512481    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512484    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512487    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512490    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512497    2578 flags.go:64] FLAG: --node-status-max-images="50"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512500    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512503    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512506    2578 flags.go:64] FLAG: --pod-cidr=""
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512510    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512515    2578 flags.go:64] FLAG: --pod-manifest-path=""
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512518    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512521    2578 flags.go:64] FLAG: --pods-per-core="0"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512529    2578 flags.go:64] FLAG: --port="10250"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512532    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512537    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0847efa6feef68e08"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512540    2578 flags.go:64] FLAG: --qos-reserved=""
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512543    2578 flags.go:64] FLAG: --read-only-port="10255"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512545    2578 flags.go:64] FLAG: --register-node="true"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512548    2578 flags.go:64] FLAG: --register-with-taints=""
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512552    2578 flags.go:64] FLAG: --registry-burst="10"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512554    2578 flags.go:64] FLAG: --registry-qps="5"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512557    2578 flags.go:64] FLAG: --reserved-cpus=""
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512560    2578 flags.go:64] FLAG: --reserved-memory=""
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512564    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512566    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 06 12:17:38.520062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512569    2578 flags.go:64] FLAG: --rotate-certificates="false"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512572    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512574    2578 flags.go:64] FLAG: --runonce="false"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512577    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512580    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512584    2578 flags.go:64] FLAG: --seccomp-default="false"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512586    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512589    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512592    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512595    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512598    2578 flags.go:64] FLAG: --storage-driver-password="root"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512601    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512603    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512606    2578 flags.go:64] FLAG: --storage-driver-user="root"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512609    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512613    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512616    2578 flags.go:64] FLAG: --system-cgroups=""
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512618    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512631    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512634    2578 flags.go:64] FLAG: --tls-cert-file=""
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512643    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512650    2578 flags.go:64] FLAG: --tls-min-version=""
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512653    2578 flags.go:64] FLAG: --tls-private-key-file=""
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512655    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512658    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 06 12:17:38.520692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512661    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512664    2578 flags.go:64] FLAG: --v="2"
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512668    2578 flags.go:64] FLAG: --version="false"
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512671    2578 flags.go:64] FLAG: --vmodule=""
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512675    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.512678    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512801    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512804    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512807    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512810    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512812    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512815    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512818    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512820    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512822    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512825    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512828    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512830    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512833    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512835    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512838    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:38.521397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512840    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512845    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512847    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512850    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512852    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512854    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512857    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512860    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512863    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512866    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512868    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512871    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512874    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512876    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512878    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512883    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512886    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512889    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512892    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512895    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:38.521936 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512898    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512901    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512904    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512906    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512910    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512914    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512917    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512920    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512923    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512925    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512928    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512930    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512933    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512936    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512939    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512941    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512944    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512947    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512949    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512952    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:38.522477 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512955    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512957    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512960    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512962    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512965    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512967    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512969    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512972    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512974    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512977    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512979    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512982    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512984    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512987    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512991    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512994    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512996    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.512999    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513002    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:38.522947 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513005    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513007    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513010    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513012    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513015    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513017    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513021    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513024    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513027    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513029    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513032    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513034    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513037    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513039    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513043    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513045    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513048    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513050    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513053    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513055    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:38.523412 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513058    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513060    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513063    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513065    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.513068    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.513882    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.523639    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.523770    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.523785    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.523790    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523855    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523859    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523862    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523866    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:38.523896 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523870    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523873    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523876    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523879    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523882    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523885    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523888    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523890    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523893    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523896    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523899    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523902    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523905    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523907    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523910    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523913    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523915    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523918    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523920    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523923    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:38.524264 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523926    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523928    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523931    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523933    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523935    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523943    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523946    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523949    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523952    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523954    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523957    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523959    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523962    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523966    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523970    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523974    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523977    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523980    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523982    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:38.524735 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523986    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523989    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523993    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523996    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.523998    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524001    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524004    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524007    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524009    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524012    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524014    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524017    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524020    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524022    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524025    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524028    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524030    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524033    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524035    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524043    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:38.525243 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524046    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524049    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524051    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524054    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524056    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524059    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524061    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524064    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524067    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524070    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524073    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524075    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524077    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524080    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524082    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524085    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524087    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524090    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524092    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524095    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:38.525778 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524098    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524100    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524103    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524105    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524108    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524110    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524113    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524115    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524118    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524120    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524122    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524125    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524133    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524136    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524138    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:38.526286 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524140    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.524160    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524323    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524328    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524333    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524338    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524341    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524343    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524347    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524349    2578 feature_gate.go:328] unrecognized feature gate: Example
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524352    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524354    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524357    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524361    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524365    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 06 12:17:38.526649 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524367    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524371    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524373    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524377    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524380    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524383    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524386    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524389    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524392    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524394    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524397    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524400    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524403    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524406    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524408    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524420    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524423    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524426    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524428    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 06 12:17:38.527010 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524431    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524433    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524436    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524439    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524442    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524446    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524449    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524452    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524455    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524457    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524460    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524463    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524465    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524468    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524470    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524473    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524475    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524477    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524480    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 06 12:17:38.527529 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524483    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524485    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524488    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524490    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524493    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524495    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524498    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524500    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524503    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524505    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524514    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524516    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524519    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524521    2578 feature_gate.go:328] unrecognized feature gate: Example2
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524524    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524527    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524530    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524532    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524535    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524537    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 06 12:17:38.527993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524540    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524543    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524545    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524548    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524550    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524553    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524555    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524557    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524560    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524562    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524565    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524567    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524570    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524573    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524575    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524578    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524580    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524583    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524586    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524588    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 06 12:17:38.528506 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524590    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524593    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524595    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524604    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524606    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524609    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524611    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:38.524614    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.524619    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.524733    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.527235    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.528344    2578 server.go:1019] "Starting client certificate rotation"
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.528453    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 12:17:38.528981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.528489    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 06 12:17:38.531420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.531407    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 12:17:38.534961 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.534939    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 06 12:17:38.546773 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.546754    2578 log.go:25] "Validated CRI v1 runtime API"
Sep 06 12:17:38.550206 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.550190    2578 log.go:25] "Validated CRI v1 image API"
Sep 06 12:17:38.550991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.550969    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 06 12:17:38.555218 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.555200    2578 fs.go:135] Filesystem UUIDs: map[4eb69b33-d324-4694-9358-dd49622ae6f3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 8661d899-9dae-4a41-b8c4-b407c63e0895:/dev/nvme0n1p4]
Sep 06 12:17:38.555294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.555217    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 06 12:17:38.559252 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.559237    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 12:17:38.560419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.560311    2578 manager.go:216] Machine: {Timestamp:2026-09-06 12:17:38.558915311 +0000 UTC m=+0.372339381 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3077619 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ee19539877d856ba584e5173d37b2 SystemUUID:ec2ee195-3987-7d85-6ba5-84e5173d37b2 BootID:d8bc4f54-5eaf-43f9-980d-c4f5ac53985d Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:1f:d7:40:cd:bb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:1f:d7:40:cd:bb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c6:31:95:c5:5e:6e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 06 12:17:38.560419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.560418    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 06 12:17:38.560523 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.560513    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 06 12:17:38.564271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.564239    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 06 12:17:38.564420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.564274    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-145.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 06 12:17:38.565270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.565252    2578 topology_manager.go:138] "Creating topology manager with none policy"
Sep 06 12:17:38.565270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.565273    2578 container_manager_linux.go:309] "Creating device plugin manager"
Sep 06 12:17:38.565345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.565280    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 12:17:38.565345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.565299    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 06 12:17:38.567220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.567210    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 06 12:17:38.571910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.571898    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 12:17:38.572032 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572022    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 06 12:17:38.572069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572050    2578 kubelet.go:486] "Attempting to sync node with API server"
Sep 06 12:17:38.572069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572059    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 06 12:17:38.572069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572068    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 06 12:17:38.572163 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572078    2578 kubelet.go:398] "Adding apiserver pod source"
Sep 06 12:17:38.572163 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572086    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 06 12:17:38.572570 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572558    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 12:17:38.572620 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.572582    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 06 12:17:38.575055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.575026    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 06 12:17:38.578203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578186    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 06 12:17:38.578254 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578219    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 06 12:17:38.578429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578420    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 06 12:17:38.578459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578435    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 06 12:17:38.578459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578441    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 06 12:17:38.578459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578447    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 06 12:17:38.578459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578454    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 06 12:17:38.578459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.578459    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 06 12:17:38.579058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.579045    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 06 12:17:38.579091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.579061    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 06 12:17:38.579091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.579081    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 06 12:17:38.579091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.579090    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 06 12:17:38.579183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.579102    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 06 12:17:38.579183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.579114    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 06 12:17:38.580068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.580056    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 06 12:17:38.580068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.580069    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 06 12:17:38.580996 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.580959    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 06 12:17:38.581269 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.581215    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 06 12:17:38.583911 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.583894    2578 server.go:1268] "Started kubelet"
Sep 06 12:17:38.585306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.585287    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-145.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 06 12:17:38.585669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.585649    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 06 12:17:38.585925 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.585888    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 06 12:17:38.585997 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.585978    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 06 12:17:38.586101 ip-10-0-130-145 systemd[1]: Started Kubernetes Kubelet.
Sep 06 12:17:38.587404 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.587383    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 06 12:17:38.589082 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.589065    2578 server.go:310] "Adding debug handlers to kubelet server"
Sep 06 12:17:38.590683 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.590641    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 06 12:17:38.594348 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.594328    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 06 12:17:38.594348 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.594341    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 06 12:17:38.594493 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.594459    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:38.595064 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595044    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 06 12:17:38.595064 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595056    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 06 12:17:38.595243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595076    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 06 12:17:38.595243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595194    2578 factory.go:55] Registering systemd factory
Sep 06 12:17:38.595243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595226    2578 factory.go:223] Registration of the systemd container factory successfully
Sep 06 12:17:38.595243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595204    2578 reconstruct.go:97] "Volume reconstruction finished"
Sep 06 12:17:38.595427 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595256    2578 reconciler.go:29] "Reconciler: start to sync state"
Sep 06 12:17:38.595474 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595448    2578 factory.go:153] Registering CRI-O factory
Sep 06 12:17:38.595474 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595462    2578 factory.go:223] Registration of the crio container factory successfully
Sep 06 12:17:38.595561 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595514    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 06 12:17:38.595561 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595531    2578 factory.go:103] Registering Raw factory
Sep 06 12:17:38.595561 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595546    2578 manager.go:1196] Started watching for new ooms in manager
Sep 06 12:17:38.595767 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.594557    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-145.ec2.internal.18d2ba7f73ad6f84  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-145.ec2.internal,UID:ip-10-0-130-145.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-145.ec2.internal,},FirstTimestamp:2026-09-06 12:17:38.583867268 +0000 UTC m=+0.397291337,LastTimestamp:2026-09-06 12:17:38.583867268 +0000 UTC m=+0.397291337,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-145.ec2.internal,}"
Sep 06 12:17:38.596005 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.595990    2578 manager.go:349] Starting recovery of all containers
Sep 06 12:17:38.601880 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.601857    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmpwf"
Sep 06 12:17:38.604539 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.604455    2578 manager.go:354] Recovery completed
Sep 06 12:17:38.607080 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.607052    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 06 12:17:38.607080 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.607062    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-145.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 06 12:17:38.609274 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.609259    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tmpwf"
Sep 06 12:17:38.611278 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.611264    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.613671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.613653    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.613756 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.613682    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.613756 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.613692    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.614209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614193    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 06 12:17:38.614209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614203    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.614364 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614207    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 06 12:17:38.614364 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614267    2578 state_mem.go:36] "Initialized new in-memory state store"
Sep 06 12:17:38.614928 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614911    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.614995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614942    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.614995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.614953    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.616348 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.616332    2578 policy_none.go:49] "None policy: Start"
Sep 06 12:17:38.616436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.616353    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 06 12:17:38.616436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.616367    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 06 12:17:38.618472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.618457    2578 policy_none.go:47] "Start"
Sep 06 12:17:38.642734 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.642719    2578 manager.go:337] "Starting Device Plugin manager"
Sep 06 12:17:38.642819 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.642757    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 06 12:17:38.642819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.642767    2578 server.go:87] "Starting device plugin registration server"
Sep 06 12:17:38.643037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.643026    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 06 12:17:38.643105 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.643038    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 06 12:17:38.643306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.643234    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 06 12:17:38.643306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.643290    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 06 12:17:38.643306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.643296    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 06 12:17:38.644062 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.644043    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 06 12:17:38.644132 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.644092    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:38.660256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.660236    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 06 12:17:38.661363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.661346    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 06 12:17:38.661418 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.661402    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 06 12:17:38.661462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.661426    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 06 12:17:38.661523 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.661468    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 06 12:17:38.663345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.663325    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:38.743310 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.743288    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.744111 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.744096    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.744194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.744126    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.744194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.744141    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.744194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.744181    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.753886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.753820    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.753886 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.753842    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-145.ec2.internal\": node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:38.761548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.761529    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"]
Sep 06 12:17:38.761627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.761596    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.763068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.763053    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.763133 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.763078    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.763133 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.763088    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.765269 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765257    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.765383 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.765423 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765398    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.765938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765924    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.765986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765949    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.765986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765963    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.766060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.765925    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.766060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.766021    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.766060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.766037    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.768167 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.768154    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.768211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.768177    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 06 12:17:38.768792 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.768779    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientMemory"
Sep 06 12:17:38.768847 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.768802    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasNoDiskPressure"
Sep 06 12:17:38.768847 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.768811    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeHasSufficientPID"
Sep 06 12:17:38.775913 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.775898    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:38.796252 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.796232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b5e2d385d443f3d2b79ba92216b4d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal\" (UID: \"00b5e2d385d443f3d2b79ba92216b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.796319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.796260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6bfc877ce1180e84a3ed63c00e0e76f9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-145.ec2.internal\" (UID: \"6bfc877ce1180e84a3ed63c00e0e76f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.796319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.796275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00b5e2d385d443f3d2b79ba92216b4d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal\" (UID: \"00b5e2d385d443f3d2b79ba92216b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.801697 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.801680    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-145.ec2.internal\" not found" node="ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.805886 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.805871    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-145.ec2.internal\" not found" node="ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.876955 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.876941    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:38.897286 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.897261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00b5e2d385d443f3d2b79ba92216b4d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal\" (UID: \"00b5e2d385d443f3d2b79ba92216b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.897370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.897293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b5e2d385d443f3d2b79ba92216b4d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal\" (UID: \"00b5e2d385d443f3d2b79ba92216b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.897370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.897309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6bfc877ce1180e84a3ed63c00e0e76f9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-145.ec2.internal\" (UID: \"6bfc877ce1180e84a3ed63c00e0e76f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.897370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.897352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6bfc877ce1180e84a3ed63c00e0e76f9-config\") pod \"kube-apiserver-proxy-ip-10-0-130-145.ec2.internal\" (UID: \"6bfc877ce1180e84a3ed63c00e0e76f9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.897370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.897354    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/00b5e2d385d443f3d2b79ba92216b4d7-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal\" (UID: \"00b5e2d385d443f3d2b79ba92216b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.897512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:38.897377    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/00b5e2d385d443f3d2b79ba92216b4d7-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal\" (UID: \"00b5e2d385d443f3d2b79ba92216b4d7\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:38.977444 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:38.977421    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.078222 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:39.078136    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.105595 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.105572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:39.109450 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.109419    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:39.178776 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:39.178751    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.279298 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:39.279278    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.380262 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:39.380196    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.486687 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:39.486651    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.528579 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.528557    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 06 12:17:39.528963 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.528714    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 06 12:17:39.565060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.565036    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:39.587206 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:39.587179    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-145.ec2.internal\" not found"
Sep 06 12:17:39.612852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.612817    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-05 12:12:39 +0000 UTC" deadline="2028-04-23 02:34:59.445158791 +0000 UTC"
Sep 06 12:17:39.612926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.612865    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14270h17m19.832316226s"
Sep 06 12:17:39.638197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.638118    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:39.695127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.695107    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:39.712281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.712262    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 12:17:39.713433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.713418    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal"
Sep 06 12:17:39.723118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.723096    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 06 12:17:39.937926 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:39.937748    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b5e2d385d443f3d2b79ba92216b4d7.slice/crio-82908dff2d05ac4207d3ee6de6447f7903725fd8cd1149689d9625ae6fffce31 WatchSource:0}: Error finding container 82908dff2d05ac4207d3ee6de6447f7903725fd8cd1149689d9625ae6fffce31: Status 404 returned error can't find the container with id 82908dff2d05ac4207d3ee6de6447f7903725fd8cd1149689d9625ae6fffce31
Sep 06 12:17:39.942260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.942235    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:17:39.959480 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:39.959460    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:40.573702 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.573666    2578 apiserver.go:52] "Watching apiserver"
Sep 06 12:17:40.582313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.582101    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 06 12:17:40.582630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.582604    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-p9t9n","openshift-multus/multus-7zrwz","openshift-multus/multus-additional-cni-plugins-tchzz","openshift-network-diagnostics/network-check-target-56gx2","openshift-network-operator/iptables-alerter-qcjqw","kube-system/global-pull-secret-syncer-547dz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk","openshift-cluster-node-tuning-operator/tuned-ck9gp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal","openshift-multus/network-metrics-daemon-ffnwb","openshift-ovn-kubernetes/ovnkube-node-2mcdg","kube-system/konnectivity-agent-sgkzn","kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal","openshift-dns/node-resolver-qxrmg"]
Sep 06 12:17:40.585454 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.585429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.587913 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.587886    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 06 12:17:40.587913 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.587907    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-zmqzk\""
Sep 06 12:17:40.588259 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.588217    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.588343 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.588258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.588584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.588566    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.590687 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.590666    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.591482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.591459    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.591674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.591639    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 06 12:17:40.591823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.591716    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 06 12:17:40.591823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.591809    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 06 12:17:40.591956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.591896    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.592092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.592073    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hb8r8\""
Sep 06 12:17:40.592629 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.592606    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 06 12:17:40.593017 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.592995    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 06 12:17:40.593115 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.593061    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-twztj\""
Sep 06 12:17:40.593221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.593202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:40.593316 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.593279    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:40.593460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.593441    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 06 12:17:40.593682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.593661    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 06 12:17:40.595040 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.594856    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.595040 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.594977    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 06 12:17:40.595595 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.595479    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.596251 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.595814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.598623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.598601    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.598719 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.598608    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 06 12:17:40.598779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.598728    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.599318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.599260    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-m46lq\""
Sep 06 12:17:40.599412 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.599267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.599496 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.599451    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:40.602513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.602014    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.604730 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.604401    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.604730 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.604562    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.605613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.604996    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.605613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.605450    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-2gx9q\""
Sep 06 12:17:40.607055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.606990    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 06 12:17:40.609408 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609528 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609528 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609483    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609528 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovnkube-config\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609714 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzwzw\" (UniqueName: \"kubernetes.io/projected/c115dc27-265a-43ce-b886-bcbb5f407a8b-kube-api-access-qzwzw\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609714 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609632    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.609714 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-systemd\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609714 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-ovn\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609948 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-cni-bin\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609948 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609861    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-cni-netd\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.609948 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-system-cni-dir\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.609948 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.610142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:40.610142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.609981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-sys-fs\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.610142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gl4k\" (UniqueName: \"kubernetes.io/projected/74f3c38a-81ae-4048-9cc0-dd725c0dee46-kube-api-access-9gl4k\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.610142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-run-netns\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.610456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-etc-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.610456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.610456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610360    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-host-slash\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.610456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lskb\" (UniqueName: \"kubernetes.io/projected/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-kube-api-access-7lskb\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.610677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.610677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-socket-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.610677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-registration-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.610677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610652    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-var-lib-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.610886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-cnibin\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.610886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-iptables-alerter-script\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.610988 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.611044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.610994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-env-overrides\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611025    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhvzt\" (UniqueName: \"kubernetes.io/projected/503c81f2-ce8e-4b66-bd05-843066e0308c-kube-api-access-dhvzt\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.611159 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-device-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.611239 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-kubelet\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611239 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611201    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-systemd-units\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovnkube-script-lib\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.611465 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-slash\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611522 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-node-log\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611576 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611531    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-log-socket\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.611576 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.611553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.613166 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.612504    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.613166 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.612660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:40.613166 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.612778    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:40.615986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.613973    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rt5dn\""
Sep 06 12:17:40.615986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.615400    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 06 12:17:40.616305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.616178    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-xdm6x\""
Sep 06 12:17:40.616305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.616239    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 06 12:17:40.620343 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.620320    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 06 12:17:40.620481 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.620461    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.622819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.622530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.623533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.623357    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.623533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.623420    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 06 12:17:40.623710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.623569    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.624059 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.623880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-n4sc5\""
Sep 06 12:17:40.624774 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.624755    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-r6nr6\""
Sep 06 12:17:40.625550 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.625198    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 06 12:17:40.625550 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.625458    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 06 12:17:40.629631 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.629440    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmhf4"
Sep 06 12:17:40.638248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.637819    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cmhf4"
Sep 06 12:17:40.670345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.669725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal" event={"ID":"6bfc877ce1180e84a3ed63c00e0e76f9","Type":"ContainerStarted","Data":"f7a9ff3e5292cda4c9a40cea41648344b52e863ceec457692f295a6df5a489c2"}
Sep 06 12:17:40.673029 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.672867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal" event={"ID":"00b5e2d385d443f3d2b79ba92216b4d7","Type":"ContainerStarted","Data":"82908dff2d05ac4207d3ee6de6447f7903725fd8cd1149689d9625ae6fffce31"}
Sep 06 12:17:40.696240 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.696203    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 06 12:17:40.712183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.712183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-host-slash\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.712183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lskb\" (UniqueName: \"kubernetes.io/projected/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-kube-api-access-7lskb\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.712428 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712291    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.712428 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712330    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-sys\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.712623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-lib-modules\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.712623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-cni-bin\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.712623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-registration-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.712623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-cnibin\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.712623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-kubernetes\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-cnibin\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-host-slash\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-netns\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712743    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-registration-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712757    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-cnibin\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54aa5f32-f784-42ad-a18e-ceb438edf790-hosts-file\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.712890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.712887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/511dbd99-611b-4839-8f80-84edaf706c81-dbus\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-system-cni-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-env-overrides\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysconfig\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59896d24-e5ae-4a36-acc4-ba2c934ac026-cni-binary-copy\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-socket-dir-parent\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-conf-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-device-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.713305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-systemd-units\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713310    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713337    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-systemd\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7be14974-ac07-4061-bc78-a18adc94bef3-tmp\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-hostroot\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-slash\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-node-log\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-log-socket\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-modprobe-d\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713694    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovnkube-config\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysctl-d\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713765    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-ovn\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-env-overrides\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.713915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-cni-netd\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xcxb\" (UniqueName: \"kubernetes.io/projected/cbef0fcf-3628-4500-bb73-3af52c312c80-kube-api-access-4xcxb\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6mwr\" (UniqueName: \"kubernetes.io/projected/54aa5f32-f784-42ad-a18e-ceb438edf790-kube-api-access-f6mwr\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.713992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-sys-fs\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-run-ovn-kubernetes\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gl4k\" (UniqueName: \"kubernetes.io/projected/74f3c38a-81ae-4048-9cc0-dd725c0dee46-kube-api-access-9gl4k\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-run-netns\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-ovn\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-etc-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ccdz\" (UniqueName: \"kubernetes.io/projected/7be14974-ac07-4061-bc78-a18adc94bef3-kube-api-access-5ccdz\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-k8s-cni-cncf-io\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714174    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-daemon-config\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f2966f7-6de1-4f24-8c25-6cb02f10280d-serviceca\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.714788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714318    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-socket-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-var-lib-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714412    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-iptables-alerter-script\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714440    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysctl-conf\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-host\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-kubelet\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54aa5f32-f784-42ad-a18e-ceb438edf790-tmp-dir\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhvzt\" (UniqueName: \"kubernetes.io/projected/503c81f2-ce8e-4b66-bd05-843066e0308c-kube-api-access-dhvzt\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d557548-48e4-4b8b-9972-e21bfc1ce33f-agent-certs\") pod \"konnectivity-agent-sgkzn\" (UID: \"8d557548-48e4-4b8b-9972-e21bfc1ce33f\") " pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-cni-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714642    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2skb6\" (UniqueName: \"kubernetes.io/projected/59896d24-e5ae-4a36-acc4-ba2c934ac026-kube-api-access-2skb6\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-kubelet\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovnkube-script-lib\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714103    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-cni-netd\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-kubelet\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.715571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-device-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.714959    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-systemd-units\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-socket-dir\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-var-lib-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovnkube-config\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/511dbd99-611b-4839-8f80-84edaf706c81-kubelet-config\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715154    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-var-lib-kubelet\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715181    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-sys-fs\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d557548-48e4-4b8b-9972-e21bfc1ce33f-konnectivity-ca\") pod \"konnectivity-agent-sgkzn\" (UID: \"8d557548-48e4-4b8b-9972-e21bfc1ce33f\") " pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-cni-multus\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715283    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-run\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7z6l\" (UniqueName: \"kubernetes.io/projected/7f2966f7-6de1-4f24-8c25-6cb02f10280d-kube-api-access-q7z6l\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzwzw\" (UniqueName: \"kubernetes.io/projected/c115dc27-265a-43ce-b886-bcbb5f407a8b-kube-api-access-qzwzw\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.716605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-multus-certs\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-etc-kubernetes\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f2966f7-6de1-4f24-8c25-6cb02f10280d-host\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7be14974-ac07-4061-bc78-a18adc94bef3-etc-tuned\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715516    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-systemd\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-cni-bin\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/74f3c38a-81ae-4048-9cc0-dd725c0dee46-etc-selinux\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-etc-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-openvswitch\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-cni-bin\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-run-systemd\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-iptables-alerter-script\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-node-log\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715785    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-slash\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715853    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-host-run-netns\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-system-cni-dir\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/c115dc27-265a-43ce-b886-bcbb5f407a8b-log-socket\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.717493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.715914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:40.718323 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.716149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/503c81f2-ce8e-4b66-bd05-843066e0308c-cni-binary-copy\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.718323 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.716197    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/503c81f2-ce8e-4b66-bd05-843066e0308c-system-cni-dir\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.718323 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.716417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovnkube-script-lib\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.722612 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.722097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/c115dc27-265a-43ce-b886-bcbb5f407a8b-ovn-node-metrics-cert\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.722612 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.722109    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:40.722612 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.722129    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:40.722612 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.722145    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:40.722612 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.722244    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:41.222219595 +0000 UTC m=+3.035643676 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:40.723699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.723639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lskb\" (UniqueName: \"kubernetes.io/projected/79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46-kube-api-access-7lskb\") pod \"iptables-alerter-qcjqw\" (UID: \"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46\") " pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.731478 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.731398    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhvzt\" (UniqueName: \"kubernetes.io/projected/503c81f2-ce8e-4b66-bd05-843066e0308c-kube-api-access-dhvzt\") pod \"multus-additional-cni-plugins-tchzz\" (UID: \"503c81f2-ce8e-4b66-bd05-843066e0308c\") " pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.731478 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.731434    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gl4k\" (UniqueName: \"kubernetes.io/projected/74f3c38a-81ae-4048-9cc0-dd725c0dee46-kube-api-access-9gl4k\") pod \"aws-ebs-csi-driver-node-cpbxk\" (UID: \"74f3c38a-81ae-4048-9cc0-dd725c0dee46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.732090 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.732051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzwzw\" (UniqueName: \"kubernetes.io/projected/c115dc27-265a-43ce-b886-bcbb5f407a8b-kube-api-access-qzwzw\") pod \"ovnkube-node-2mcdg\" (UID: \"c115dc27-265a-43ce-b886-bcbb5f407a8b\") " pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.817361 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-multus-certs\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817361 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-etc-kubernetes\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f2966f7-6de1-4f24-8c25-6cb02f10280d-host\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817402    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7be14974-ac07-4061-bc78-a18adc94bef3-etc-tuned\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-sys\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-lib-modules\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-cni-bin\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-multus-certs\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-kubernetes\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-cnibin\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-netns\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54aa5f32-f784-42ad-a18e-ceb438edf790-hosts-file\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-kubernetes\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/511dbd99-611b-4839-8f80-84edaf706c81-dbus\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817708    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-system-cni-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817761    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysconfig\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59896d24-e5ae-4a36-acc4-ba2c934ac026-cni-binary-copy\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-socket-dir-parent\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-conf-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-systemd\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7be14974-ac07-4061-bc78-a18adc94bef3-tmp\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-hostroot\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-modprobe-d\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.817991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysctl-d\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xcxb\" (UniqueName: \"kubernetes.io/projected/cbef0fcf-3628-4500-bb73-3af52c312c80-kube-api-access-4xcxb\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6mwr\" (UniqueName: \"kubernetes.io/projected/54aa5f32-f784-42ad-a18e-ceb438edf790-kube-api-access-f6mwr\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ccdz\" (UniqueName: \"kubernetes.io/projected/7be14974-ac07-4061-bc78-a18adc94bef3-kube-api-access-5ccdz\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-k8s-cni-cncf-io\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-daemon-config\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818152    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f2966f7-6de1-4f24-8c25-6cb02f10280d-serviceca\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysctl-conf\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818206    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-host\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-kubelet\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54aa5f32-f784-42ad-a18e-ceb438edf790-tmp-dir\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d557548-48e4-4b8b-9972-e21bfc1ce33f-agent-certs\") pod \"konnectivity-agent-sgkzn\" (UID: \"8d557548-48e4-4b8b-9972-e21bfc1ce33f\") " pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818359    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-cni-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818395    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2skb6\" (UniqueName: \"kubernetes.io/projected/59896d24-e5ae-4a36-acc4-ba2c934ac026-kube-api-access-2skb6\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/511dbd99-611b-4839-8f80-84edaf706c81-kubelet-config\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-var-lib-kubelet\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d557548-48e4-4b8b-9972-e21bfc1ce33f-konnectivity-ca\") pod \"konnectivity-agent-sgkzn\" (UID: \"8d557548-48e4-4b8b-9972-e21bfc1ce33f\") " pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-cni-multus\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.818789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-run\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7z6l\" (UniqueName: \"kubernetes.io/projected/7f2966f7-6de1-4f24-8c25-6cb02f10280d-kube-api-access-q7z6l\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59896d24-e5ae-4a36-acc4-ba2c934ac026-cni-binary-copy\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-netns\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/54aa5f32-f784-42ad-a18e-ceb438edf790-hosts-file\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818894    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/511dbd99-611b-4839-8f80-84edaf706c81-dbus\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817475    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7f2966f7-6de1-4f24-8c25-6cb02f10280d-host\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-socket-dir-parent\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.818925    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-system-cni-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.818972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-conf-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.819013    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:41.318998284 +0000 UTC m=+3.132422366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.819012    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-host\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:40.819050    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:41.319043261 +0000 UTC m=+3.132467319 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-sys\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819067    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-kubelet\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.819809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysctl-conf\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysconfig\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-modprobe-d\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-run-k8s-cni-cncf-io\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-systemd\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.817508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-etc-kubernetes\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-lib-modules\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-etc-sysctl-d\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-cni-bin\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/511dbd99-611b-4839-8f80-84edaf706c81-kubelet-config\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-host-var-lib-cni-multus\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819830    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-cni-dir\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/7f2966f7-6de1-4f24-8c25-6cb02f10280d-serviceca\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-var-lib-kubelet\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7be14974-ac07-4061-bc78-a18adc94bef3-run\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819974    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-cnibin\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819981    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54aa5f32-f784-42ad-a18e-ceb438edf790-tmp-dir\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.819994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/59896d24-e5ae-4a36-acc4-ba2c934ac026-hostroot\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.820688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.820299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8d557548-48e4-4b8b-9972-e21bfc1ce33f-konnectivity-ca\") pod \"konnectivity-agent-sgkzn\" (UID: \"8d557548-48e4-4b8b-9972-e21bfc1ce33f\") " pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.821578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.820567    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/59896d24-e5ae-4a36-acc4-ba2c934ac026-multus-daemon-config\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.822684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.822660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7be14974-ac07-4061-bc78-a18adc94bef3-etc-tuned\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.822792 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.822714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7be14974-ac07-4061-bc78-a18adc94bef3-tmp\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.831411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.831343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7z6l\" (UniqueName: \"kubernetes.io/projected/7f2966f7-6de1-4f24-8c25-6cb02f10280d-kube-api-access-q7z6l\") pod \"node-ca-p9t9n\" (UID: \"7f2966f7-6de1-4f24-8c25-6cb02f10280d\") " pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.832760 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.831979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8d557548-48e4-4b8b-9972-e21bfc1ce33f-agent-certs\") pod \"konnectivity-agent-sgkzn\" (UID: \"8d557548-48e4-4b8b-9972-e21bfc1ce33f\") " pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.834896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.834872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2skb6\" (UniqueName: \"kubernetes.io/projected/59896d24-e5ae-4a36-acc4-ba2c934ac026-kube-api-access-2skb6\") pod \"multus-7zrwz\" (UID: \"59896d24-e5ae-4a36-acc4-ba2c934ac026\") " pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.835466 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.835439    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6mwr\" (UniqueName: \"kubernetes.io/projected/54aa5f32-f784-42ad-a18e-ceb438edf790-kube-api-access-f6mwr\") pod \"node-resolver-qxrmg\" (UID: \"54aa5f32-f784-42ad-a18e-ceb438edf790\") " pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.836729 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.836706    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xcxb\" (UniqueName: \"kubernetes.io/projected/cbef0fcf-3628-4500-bb73-3af52c312c80-kube-api-access-4xcxb\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:40.837584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.837562    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ccdz\" (UniqueName: \"kubernetes.io/projected/7be14974-ac07-4061-bc78-a18adc94bef3-kube-api-access-5ccdz\") pod \"tuned-ck9gp\" (UID: \"7be14974-ac07-4061-bc78-a18adc94bef3\") " pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.877821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.877643    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 06 12:17:40.901411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.901384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk"
Sep 06 12:17:40.911950 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.911928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:17:40.924817 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.924792    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tchzz"
Sep 06 12:17:40.929376 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.929339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc115dc27_265a_43ce_b886_bcbb5f407a8b.slice/crio-f98a34966b30c2000145fb768838ec40ff8c4525fb35ff616b3bd2a0e442c901 WatchSource:0}: Error finding container f98a34966b30c2000145fb768838ec40ff8c4525fb35ff616b3bd2a0e442c901: Status 404 returned error can't find the container with id f98a34966b30c2000145fb768838ec40ff8c4525fb35ff616b3bd2a0e442c901
Sep 06 12:17:40.933586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.933490    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qcjqw"
Sep 06 12:17:40.936940 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.936914    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod503c81f2_ce8e_4b66_bd05_843066e0308c.slice/crio-9c1ce5a5bf456fa7df30c5e1cfbef9d3fcf152bd522c957dd16e60fc52f6ec56 WatchSource:0}: Error finding container 9c1ce5a5bf456fa7df30c5e1cfbef9d3fcf152bd522c957dd16e60fc52f6ec56: Status 404 returned error can't find the container with id 9c1ce5a5bf456fa7df30c5e1cfbef9d3fcf152bd522c957dd16e60fc52f6ec56
Sep 06 12:17:40.943590 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.943568    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-ck9gp"
Sep 06 12:17:40.944426 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.944402    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79ec4f92_6d3d_4bce_917f_1cc4dbdd9a46.slice/crio-cfa01e09b3727e33198d121bdc9f8e6c8b1fe4736e1bfc8c0625c944fb79043d WatchSource:0}: Error finding container cfa01e09b3727e33198d121bdc9f8e6c8b1fe4736e1bfc8c0625c944fb79043d: Status 404 returned error can't find the container with id cfa01e09b3727e33198d121bdc9f8e6c8b1fe4736e1bfc8c0625c944fb79043d
Sep 06 12:17:40.952496 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.952473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:17:40.953380 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.953353    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7be14974_ac07_4061_bc78_a18adc94bef3.slice/crio-3a94c0a4e95beaf59ae3e71f73312519ea364d2f53d284bda2845279fd3b213b WatchSource:0}: Error finding container 3a94c0a4e95beaf59ae3e71f73312519ea364d2f53d284bda2845279fd3b213b: Status 404 returned error can't find the container with id 3a94c0a4e95beaf59ae3e71f73312519ea364d2f53d284bda2845279fd3b213b
Sep 06 12:17:40.961534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.961320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7zrwz"
Sep 06 12:17:40.963475 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.963449    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d557548_48e4_4b8b_9972_e21bfc1ce33f.slice/crio-f13a35fa4982148ecc502c98da9e98a6ba1834ff287f7f16aa5a0d4deea12c4b WatchSource:0}: Error finding container f13a35fa4982148ecc502c98da9e98a6ba1834ff287f7f16aa5a0d4deea12c4b: Status 404 returned error can't find the container with id f13a35fa4982148ecc502c98da9e98a6ba1834ff287f7f16aa5a0d4deea12c4b
Sep 06 12:17:40.970043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.970022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-p9t9n"
Sep 06 12:17:40.971675 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.971648    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59896d24_e5ae_4a36_acc4_ba2c934ac026.slice/crio-292ff2b373afb18ca739430bb5e850776f6c5299ce13aac0f99201e2ea567cb2 WatchSource:0}: Error finding container 292ff2b373afb18ca739430bb5e850776f6c5299ce13aac0f99201e2ea567cb2: Status 404 returned error can't find the container with id 292ff2b373afb18ca739430bb5e850776f6c5299ce13aac0f99201e2ea567cb2
Sep 06 12:17:40.977226 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:40.977205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qxrmg"
Sep 06 12:17:40.980593 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.980572    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f2966f7_6de1_4f24_8c25_6cb02f10280d.slice/crio-79b4554fc3360a1ebc673ead1cd6eccfa0d8dbda60a93eb9b5955a38b27352e6 WatchSource:0}: Error finding container 79b4554fc3360a1ebc673ead1cd6eccfa0d8dbda60a93eb9b5955a38b27352e6: Status 404 returned error can't find the container with id 79b4554fc3360a1ebc673ead1cd6eccfa0d8dbda60a93eb9b5955a38b27352e6
Sep 06 12:17:40.989049 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:17:40.989027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54aa5f32_f784_42ad_a18e_ceb438edf790.slice/crio-5d3c9eff036c6a2d7a785bfa7c4ae9bdb900a6702d885b27f5e98efae6ef4d7a WatchSource:0}: Error finding container 5d3c9eff036c6a2d7a785bfa7c4ae9bdb900a6702d885b27f5e98efae6ef4d7a: Status 404 returned error can't find the container with id 5d3c9eff036c6a2d7a785bfa7c4ae9bdb900a6702d885b27f5e98efae6ef4d7a
Sep 06 12:17:41.322202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.322086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:41.322202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.322142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322273    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322303    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322316    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.322353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322277    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322379    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:42.322355913 +0000 UTC m=+4.135779994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322457    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:42.322437593 +0000 UTC m=+4.135861656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:41.322489 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322462    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:41.322812 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.322523    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:42.322507762 +0000 UTC m=+4.135931838 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:41.641721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.641570    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 12:12:41 +0000 UTC" deadline="2028-03-31 12:56:52.654119218 +0000 UTC"
Sep 06 12:17:41.641721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.641623    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13728h39m11.012514671s"
Sep 06 12:17:41.662363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.662318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:41.662363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.662345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:41.662570 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.662457    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:41.671329 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:41.662589    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:41.678981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.678871    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qxrmg" event={"ID":"54aa5f32-f784-42ad-a18e-ceb438edf790","Type":"ContainerStarted","Data":"5d3c9eff036c6a2d7a785bfa7c4ae9bdb900a6702d885b27f5e98efae6ef4d7a"}
Sep 06 12:17:41.680432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.680370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ck9gp" event={"ID":"7be14974-ac07-4061-bc78-a18adc94bef3","Type":"ContainerStarted","Data":"3a94c0a4e95beaf59ae3e71f73312519ea364d2f53d284bda2845279fd3b213b"}
Sep 06 12:17:41.682013 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.681940    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qcjqw" event={"ID":"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46","Type":"ContainerStarted","Data":"cfa01e09b3727e33198d121bdc9f8e6c8b1fe4736e1bfc8c0625c944fb79043d"}
Sep 06 12:17:41.685144 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.685074    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerStarted","Data":"9c1ce5a5bf456fa7df30c5e1cfbef9d3fcf152bd522c957dd16e60fc52f6ec56"}
Sep 06 12:17:41.686965 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.686888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p9t9n" event={"ID":"7f2966f7-6de1-4f24-8c25-6cb02f10280d","Type":"ContainerStarted","Data":"79b4554fc3360a1ebc673ead1cd6eccfa0d8dbda60a93eb9b5955a38b27352e6"}
Sep 06 12:17:41.689564 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.689484    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7zrwz" event={"ID":"59896d24-e5ae-4a36-acc4-ba2c934ac026","Type":"ContainerStarted","Data":"292ff2b373afb18ca739430bb5e850776f6c5299ce13aac0f99201e2ea567cb2"}
Sep 06 12:17:41.692021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.691946    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgkzn" event={"ID":"8d557548-48e4-4b8b-9972-e21bfc1ce33f","Type":"ContainerStarted","Data":"f13a35fa4982148ecc502c98da9e98a6ba1834ff287f7f16aa5a0d4deea12c4b"}
Sep 06 12:17:41.694502 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.694385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"f98a34966b30c2000145fb768838ec40ff8c4525fb35ff616b3bd2a0e442c901"}
Sep 06 12:17:41.697217 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:41.697189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk" event={"ID":"74f3c38a-81ae-4048-9cc0-dd725c0dee46","Type":"ContainerStarted","Data":"87c7b420f70c0c1c11336ea989a838d025f596b737fc4879d37cd1855c978be6"}
Sep 06 12:17:42.330852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:42.330808    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:42.331048 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:42.330925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:42.331048 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:42.330966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:42.331161 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331113    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:42.331214 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331178    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:44.331158964 +0000 UTC m=+6.144583038 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:42.331656 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331633    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:42.331740 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331668    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:42.331740 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331682    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:42.331740 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331733    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:44.331715617 +0000 UTC m=+6.145139681 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:42.331907 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331798    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:42.331907 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.331831    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:44.331819409 +0000 UTC m=+6.145243484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:42.641951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:42.641799    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-05 12:12:41 +0000 UTC" deadline="2028-05-13 04:47:43.422135509 +0000 UTC"
Sep 06 12:17:42.641951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:42.641860    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14752h30m0.780279781s"
Sep 06 12:17:42.664660 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:42.664059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:42.664660 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:42.664204    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:43.663292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:43.662590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:43.663292 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:43.662723    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:43.663292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:43.663131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:43.663292 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:43.663250    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:43.726777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:43.725985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal" event={"ID":"00b5e2d385d443f3d2b79ba92216b4d7","Type":"ContainerStarted","Data":"92386f53fd6c6ccdf4b5bbcf7316731554687a5e1bb8f9279cbafe3f6594a602"}
Sep 06 12:17:43.737316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:43.736807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal" event={"ID":"6bfc877ce1180e84a3ed63c00e0e76f9","Type":"ContainerStarted","Data":"997912252b430d84792f4e3da549081b8de21a86493b1cdca74e0773f6a4b527"}
Sep 06 12:17:43.756035 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:43.755736    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-145.ec2.internal" podStartSLOduration=3.755714281 podStartE2EDuration="3.755714281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:17:43.755036614 +0000 UTC m=+5.568460698" watchObservedRunningTime="2026-09-06 12:17:43.755714281 +0000 UTC m=+5.569138365"
Sep 06 12:17:44.345777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:44.345736    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:44.345976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:44.345794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:44.345976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:44.345831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:44.346092 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.345986    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:44.346092 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346048    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:48.346029684 +0000 UTC m=+10.159453761 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:44.346756 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346499    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:44.346756 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346523    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:44.346756 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346535    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:44.346756 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346586    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:48.346571189 +0000 UTC m=+10.159995263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:44.346756 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346647    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:44.346756 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.346685    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:48.346669923 +0000 UTC m=+10.160093997 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:44.663407 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:44.663324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:44.663906 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:44.663474    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:45.661964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:45.661722    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:45.661964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:45.661778    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:45.661964 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:45.661871    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:45.661964 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:45.661967    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:46.665886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:46.665835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:46.666402 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:46.665978    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:47.662680 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:47.662325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:47.662857 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:47.662710    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:47.663077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:47.662376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:47.663220 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:47.663169    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:47.751853 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:47.751264    2578 generic.go:356] "Generic (PLEG): container finished" podID="00b5e2d385d443f3d2b79ba92216b4d7" containerID="92386f53fd6c6ccdf4b5bbcf7316731554687a5e1bb8f9279cbafe3f6594a602" exitCode=0
Sep 06 12:17:47.751853 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:47.751316    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal" event={"ID":"00b5e2d385d443f3d2b79ba92216b4d7","Type":"ContainerDied","Data":"92386f53fd6c6ccdf4b5bbcf7316731554687a5e1bb8f9279cbafe3f6594a602"}
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:48.378566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:48.378622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:48.378659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.378827    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.378893    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:56.378871956 +0000 UTC m=+18.192296042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.379341    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.379367    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.379381    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.379394    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.379432    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:56.379414502 +0000 UTC m=+18.192838568 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:48.379462 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.379465    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:17:56.379443252 +0000 UTC m=+18.192867314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:48.663261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:48.663032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:48.663261 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:48.663179    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:49.661735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:49.661697    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:49.662240 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:49.661945    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:49.662677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:49.662651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:49.662806 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:49.662747    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:50.665477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:50.665447    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:50.665960 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:50.665581    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:51.662067 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:51.662028    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:51.662273 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:51.662046    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:51.662273 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:51.662176    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:51.662273 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:51.662244    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:52.662752 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:52.662677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:52.663186 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:52.662819    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:53.662682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:53.662646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:53.662871 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:53.662758    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:53.662871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:53.662827    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:53.663252 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:53.662935    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:54.662615 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:54.662581    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:54.662799 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:54.662720    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:55.662023 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:55.661997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:55.662358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:55.661997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:55.662358 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:55.662082    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:55.662358 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:55.662174    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:56.441770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:56.441735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:56.441770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:56.441776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:56.441966 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:56.441810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:56.441966 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.441941    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:17:56.441966 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.441950    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:56.442057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.441972    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:17:56.442057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.441984    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:56.442057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.441943    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:56.442057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.442014    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:12.441996067 +0000 UTC m=+34.255420139 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:17:56.442057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.442032    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:12.442022484 +0000 UTC m=+34.255446553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:17:56.442057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.442048    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:12.44203927 +0000 UTC m=+34.255463336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:17:56.662547 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:56.662520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:56.662941 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:56.662645    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:57.662022 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:57.661989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:57.662193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:57.662032    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:57.662193 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:57.662106    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:57.662302 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:57.662261    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:17:58.662768 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:58.662736    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:17:58.663231 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:58.662867    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:17:59.662537 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:59.662517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:17:59.662617 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:17:59.662516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:17:59.662694 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:59.662601    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:17:59.662694 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:17:59.662679    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:00.662567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.662243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:00.662697 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:00.662648    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:00.777722 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.777690    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal" event={"ID":"00b5e2d385d443f3d2b79ba92216b4d7","Type":"ContainerStarted","Data":"50fcbcf097fe0888d7af7f943c0b4f7165e3de65ed8bfd92a754a88e2ffd2fe9"}
Sep 06 12:18:00.779414 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.779384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-p9t9n" event={"ID":"7f2966f7-6de1-4f24-8c25-6cb02f10280d","Type":"ContainerStarted","Data":"5533a808e9316463197b9ee4563bd6dd95db9fe940a9e9311b5450d2fd80163f"}
Sep 06 12:18:00.781108 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.781078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7zrwz" event={"ID":"59896d24-e5ae-4a36-acc4-ba2c934ac026","Type":"ContainerStarted","Data":"02aacea5f340ad014ac572f8e4a563c2c2b768c98e0df89dfbb3e9b6baa04405"}
Sep 06 12:18:00.782890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.782864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-sgkzn" event={"ID":"8d557548-48e4-4b8b-9972-e21bfc1ce33f","Type":"ContainerStarted","Data":"267b9ed0c1bb10e1b27e7e0ede20b45aecb8983c6a8789f2903f826d7bb26de1"}
Sep 06 12:18:00.786192 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.786169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"4a88d287aefaf153e3cb69a43074855c7298c68fa9617c297017497ecfe1ed0d"}
Sep 06 12:18:00.786289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.786236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"0a36ec06cd6756d3577e4b5bfcc3545174b754b277c3221accf8528094453475"}
Sep 06 12:18:00.786289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.786286    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"1ec66bd76f64d29c14075bd24e7b1eebb9d3f37fedee8ca288e51f2f441337ab"}
Sep 06 12:18:00.786392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.786326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"ce6b84a233433e4bca15c87075be85f130dd61335f7a66cb227ba0748b20eb00"}
Sep 06 12:18:00.786392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.786359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"26f2e6de88d0a22f72e4e2b2307aae1fb3e97e909eec184b65301148a8755d95"}
Sep 06 12:18:00.786483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.786406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"a1148c177447c121ec873b7523af9efd52c4d64ba71fd0a3d3625d76afa89d17"}
Sep 06 12:18:00.787753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.787731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk" event={"ID":"74f3c38a-81ae-4048-9cc0-dd725c0dee46","Type":"ContainerStarted","Data":"19e27d78ce71e9e35dc074f89c96f3a365f794fa506b93f3cd918341ad6ea93f"}
Sep 06 12:18:00.789256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.789233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qxrmg" event={"ID":"54aa5f32-f784-42ad-a18e-ceb438edf790","Type":"ContainerStarted","Data":"6b8000e9ee9c84fb0f7f5de80cbf6344c20f88e54cd352a7c2a3cd26bee1c060"}
Sep 06 12:18:00.790866 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.790842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-ck9gp" event={"ID":"7be14974-ac07-4061-bc78-a18adc94bef3","Type":"ContainerStarted","Data":"66cf4d3f228ad0c3952059d5d93e4c42c9fb0be0ca968134ff6b44bfd8d3653b"}
Sep 06 12:18:00.792316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.792262    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-145.ec2.internal" podStartSLOduration=20.792245777 podStartE2EDuration="20.792245777s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:00.791733287 +0000 UTC m=+22.605157366" watchObservedRunningTime="2026-09-06 12:18:00.792245777 +0000 UTC m=+22.605669859"
Sep 06 12:18:00.792748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.792724    2578 generic.go:356] "Generic (PLEG): container finished" podID="503c81f2-ce8e-4b66-bd05-843066e0308c" containerID="2904ff409fe26507b9e4bb92f760fb2c8f5d55702f09fdafb5eeffda55a177d6" exitCode=0
Sep 06 12:18:00.792851 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.792758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerDied","Data":"2904ff409fe26507b9e4bb92f760fb2c8f5d55702f09fdafb5eeffda55a177d6"}
Sep 06 12:18:00.804805 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.804767    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-sgkzn" podStartSLOduration=3.121383612 podStartE2EDuration="21.804756768s" totalImagesPullingTime="18.683373156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:00.804619401 +0000 UTC m=+22.618043481" watchObservedRunningTime="2026-09-06 12:18:00.804756768 +0000 UTC m=+22.618180846"
Sep 06 12:18:00.818026 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.817990    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qxrmg" podStartSLOduration=6.2593391480000005 podStartE2EDuration="20.817980853s" totalImagesPullingTime="14.558641705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:00.81785651 +0000 UTC m=+22.631280589" watchObservedRunningTime="2026-09-06 12:18:00.817980853 +0000 UTC m=+22.631404932"
Sep 06 12:18:00.833319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.833277    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-ck9gp" podStartSLOduration=3.119964076 podStartE2EDuration="21.833266356s" totalImagesPullingTime="18.71330228s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:00.832713925 +0000 UTC m=+22.646138005" watchObservedRunningTime="2026-09-06 12:18:00.833266356 +0000 UTC m=+22.646690435"
Sep 06 12:18:00.848548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.848518    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-7zrwz" podStartSLOduration=3.0403029520000002 podStartE2EDuration="21.848507264s" totalImagesPullingTime="18.808204312s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:00.848238336 +0000 UTC m=+22.661662414" watchObservedRunningTime="2026-09-06 12:18:00.848507264 +0000 UTC m=+22.661931342"
Sep 06 12:18:00.895963 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:00.895925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-p9t9n" podStartSLOduration=3.214002243 podStartE2EDuration="21.895913222s" totalImagesPullingTime="18.681910979s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:00.867476722 +0000 UTC m=+22.680900801" watchObservedRunningTime="2026-09-06 12:18:00.895913222 +0000 UTC m=+22.709337302"
Sep 06 12:18:01.162880 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.162851    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 06 12:18:01.657571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.657469    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-06T12:18:01.162868561Z","UUID":"75439630-3f47-4b65-a327-c56d7f7702c7","Handler":null,"Name":"","Endpoint":""}
Sep 06 12:18:01.659131 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.659100    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 06 12:18:01.659131 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.659130    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 06 12:18:01.662181 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.662157    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:01.662305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.662166    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:01.662305 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:01.662255    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:18:01.662392 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:01.662341    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:01.797588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.797555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk" event={"ID":"74f3c38a-81ae-4048-9cc0-dd725c0dee46","Type":"ContainerStarted","Data":"d960a471ecc8ef60b278fed1ea12af97255977519943b66a8a2d1c15cd09e6e3"}
Sep 06 12:18:01.799725 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.799655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qcjqw" event={"ID":"79ec4f92-6d3d-4bce-917f-1cc4dbdd9a46","Type":"ContainerStarted","Data":"d4f41619ce8d7d0d1040a065cc6cae92c92a07ff28b32d41c97b329825c37858"}
Sep 06 12:18:01.815510 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:01.815462    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qcjqw" podStartSLOduration=4.113326946 podStartE2EDuration="22.815444565s" totalImagesPullingTime="18.702117619s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:01.814940378 +0000 UTC m=+23.628364457" watchObservedRunningTime="2026-09-06 12:18:01.815444565 +0000 UTC m=+23.628868644"
Sep 06 12:18:02.662574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:02.662509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:02.662706 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:02.662609    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:02.805847 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:02.805807    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"5005565f811e3bcb2c49810342e5ffc91ca3feb2d0521bc8f2a2596b5ad28a21"}
Sep 06 12:18:02.809263 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:02.809220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk" event={"ID":"74f3c38a-81ae-4048-9cc0-dd725c0dee46","Type":"ContainerStarted","Data":"fbec53dd0a4fd61fc5a3a4948d17f00ed90e08f5cd51ed9d5e276775c7444d65"}
Sep 06 12:18:02.828427 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:02.828386    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-cpbxk" podStartSLOduration=3.025012257 podStartE2EDuration="23.828374069s" totalImagesPullingTime="20.803361812s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:02.827938547 +0000 UTC m=+24.641362637" watchObservedRunningTime="2026-09-06 12:18:02.828374069 +0000 UTC m=+24.641798148"
Sep 06 12:18:03.662579 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:03.662549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:03.662731 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:03.662552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:03.662731 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:03.662657    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:03.662814 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:03.662760    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:18:03.743190 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:03.743160    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:18:03.743891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:03.743874    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:18:03.811790 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:03.811738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:18:03.812190 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:03.812106    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-sgkzn"
Sep 06 12:18:04.661956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:04.661926    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:04.662132 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:04.662074    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:05.662091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:05.661909    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:05.662781 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:05.661965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:05.662781 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:05.662174    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:18:05.662781 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:05.662236    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:05.819896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:05.819816    2578 generic.go:356] "Generic (PLEG): container finished" podID="503c81f2-ce8e-4b66-bd05-843066e0308c" containerID="bd9d5b47ffbf9a9e05f97f45d61ccf08a9852a2a1d823b5b86a332ac4cf25e55" exitCode=0
Sep 06 12:18:05.819896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:05.819869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerDied","Data":"bd9d5b47ffbf9a9e05f97f45d61ccf08a9852a2a1d823b5b86a332ac4cf25e55"}
Sep 06 12:18:05.823686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:05.823662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" event={"ID":"c115dc27-265a-43ce-b886-bcbb5f407a8b","Type":"ContainerStarted","Data":"3fdf9d8a3159339ed120b25d830fab59460fc03586c26e6f2a973ed9416263b7"}
Sep 06 12:18:05.864102 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:05.864065    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg" podStartSLOduration=8.128486086 podStartE2EDuration="26.864052865s" totalImagesPullingTime="18.735566779s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:05.862363537 +0000 UTC m=+27.675787615" watchObservedRunningTime="2026-09-06 12:18:05.864052865 +0000 UTC m=+27.677476943"
Sep 06 12:18:06.662023 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:06.661995    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:06.662256 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:06.662098    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:06.825743 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:06.825715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:18:06.825893 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:06.825796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:18:06.825893 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:06.825847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:18:06.839637 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:06.839616    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:18:06.839885 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:06.839869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:18:07.011580 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.011554    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-547dz"]
Sep 06 12:18:07.011717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.011698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:07.011835 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:07.011801    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:18:07.015756 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.015729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-56gx2"]
Sep 06 12:18:07.015852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.015841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:07.015988 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:07.015962    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:07.016412 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.016383    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffnwb"]
Sep 06 12:18:07.016517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.016487    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:07.016619 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:07.016596    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:07.829406 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.829379    2578 generic.go:356] "Generic (PLEG): container finished" podID="503c81f2-ce8e-4b66-bd05-843066e0308c" containerID="824d65fb756926620c4acc51265d7ce5393437242e53d3c3efc0676c15ae6695" exitCode=0
Sep 06 12:18:07.829747 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:07.829462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerDied","Data":"824d65fb756926620c4acc51265d7ce5393437242e53d3c3efc0676c15ae6695"}
Sep 06 12:18:08.662732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:08.662701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:08.662836 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:08.662791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:08.662894 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:08.662829    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:08.662894 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:08.662865    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:08.662894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:08.662883    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:08.663041 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:08.662981    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:18:08.833798 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:08.833729    2578 generic.go:356] "Generic (PLEG): container finished" podID="503c81f2-ce8e-4b66-bd05-843066e0308c" containerID="45104842ab9c87b1b49eacde86f55c2ff68442fb75a27281a05c5cafda00e4af" exitCode=0
Sep 06 12:18:08.834137 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:08.833815    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerDied","Data":"45104842ab9c87b1b49eacde86f55c2ff68442fb75a27281a05c5cafda00e4af"}
Sep 06 12:18:10.661777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:10.661745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:10.662267 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:10.661745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:10.662267 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:10.661867    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-547dz" podUID="511dbd99-611b-4839-8f80-84edaf706c81"
Sep 06 12:18:10.662267 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:10.661947    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-56gx2" podUID="204d4f48-bcc4-40bc-b1a6-710dc2f955f9"
Sep 06 12:18:10.662267 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:10.661747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:10.662267 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:10.662053    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ffnwb" podUID="cbef0fcf-3628-4500-bb73-3af52c312c80"
Sep 06 12:18:12.464229 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.463966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.464259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464110    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.464335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464376    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret podName:511dbd99-611b-4839-8f80-84edaf706c81 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.464354112 +0000 UTC m=+66.277778186 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret") pod "global-pull-secret-syncer-547dz" (UID: "511dbd99-611b-4839-8f80-84edaf706c81") : object "kube-system"/"original-pull-secret" not registered
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464438    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464461    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464480    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464488    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs podName:cbef0fcf-3628-4500-bb73-3af52c312c80 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.464475498 +0000 UTC m=+66.277899583 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs") pod "network-metrics-daemon-ffnwb" (UID: "cbef0fcf-3628-4500-bb73-3af52c312c80") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464492    2578 projected.go:196] Error preparing data for projected volume kube-api-access-x2vbr for pod openshift-network-diagnostics/network-check-target-56gx2: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:18:12.464630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.464535    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr podName:204d4f48-bcc4-40bc-b1a6-710dc2f955f9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.464521138 +0000 UTC m=+66.277945201 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2vbr" (UniqueName: "kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr") pod "network-check-target-56gx2" (UID: "204d4f48-bcc4-40bc-b1a6-710dc2f955f9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 06 12:18:12.500262 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.500193    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-145.ec2.internal" event="NodeReady"
Sep 06 12:18:12.500409 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.500331    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 06 12:18:12.536826 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.536793    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-697558986f-9t9ps"]
Sep 06 12:18:12.595682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.595657    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jrpsk"]
Sep 06 12:18:12.595811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.595765    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.598402 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.598376    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 06 12:18:12.598402 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.598392    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 06 12:18:12.598613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.598379    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 06 12:18:12.598613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.598545    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jx6gc\""
Sep 06 12:18:12.603916 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.603770    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 06 12:18:12.610172 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.610135    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-5shz2"]
Sep 06 12:18:12.610283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.610266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.613107 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.613067    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-jjvth\""
Sep 06 12:18:12.613296 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.613262    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Sep 06 12:18:12.613962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.613940    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Sep 06 12:18:12.614087 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.613996    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.614673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.614652    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.620927 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.620897    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Sep 06 12:18:12.628310 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.628290    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"]
Sep 06 12:18:12.628432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.628412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.630882 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.630866    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-m98z9\""
Sep 06 12:18:12.631133 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.631112    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.631239 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.631158    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 06 12:18:12.631239 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.631142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.631392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.631375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 06 12:18:12.636941 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.636918    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 06 12:18:12.654409 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.654390    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-54f9f9784-n5ntv"]
Sep 06 12:18:12.654524 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.654506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.656821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.656803    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Sep 06 12:18:12.656988 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.656972    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.657084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.656995    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-xw9cz\""
Sep 06 12:18:12.657171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.657058    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.657171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.657073    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Sep 06 12:18:12.676727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.676701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.679141 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Sep 06 12:18:12.679261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679120    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Sep 06 12:18:12.679334 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679122    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5lbps\""
Sep 06 12:18:12.679406 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.679406 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.679514 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679131    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Sep 06 12:18:12.679624 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.679609    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Sep 06 12:18:12.680813 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.680791    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"]
Sep 06 12:18:12.694505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.694482    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"]
Sep 06 12:18:12.694602 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.694564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:12.694602 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.694570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"
Sep 06 12:18:12.694602 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.694570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:12.695016 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.694997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:12.697026 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.696822    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 12:18:12.697121 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697055    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.697321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-btdw7\""
Sep 06 12:18:12.697721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697699    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.697810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 12:18:12.697902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697844    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vrsdl\""
Sep 06 12:18:12.697902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697858    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.698014 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697903    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.698014 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.697946    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrr2p\""
Sep 06 12:18:12.708174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.707850    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"]
Sep 06 12:18:12.709390 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.709368    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:12.711644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.711622    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.712221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.712200    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 06 12:18:12.712576 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.712456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vnnxd\""
Sep 06 12:18:12.712977 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.712782    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.725646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.725612    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"]
Sep 06 12:18:12.725742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.725683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.728105 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.728085    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.728443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.728421    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bct5f\""
Sep 06 12:18:12.728520 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.728425    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.728520 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.728480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Sep 06 12:18:12.729784 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.729767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Sep 06 12:18:12.751871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.751822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-5shz2"]
Sep 06 12:18:12.751871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.751855    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jrpsk"]
Sep 06 12:18:12.751994 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.751874    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-697558986f-9t9ps"]
Sep 06 12:18:12.751994 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.751895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f9f9784-n5ntv"]
Sep 06 12:18:12.751994 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.751917    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6gcp8"]
Sep 06 12:18:12.751994 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.751953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.754632 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.754610    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Sep 06 12:18:12.754810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.754793    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Sep 06 12:18:12.754810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.754806    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-gj5lm\""
Sep 06 12:18:12.754922 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.754846    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.754922 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.754800    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.766509 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad05982d-9af8-4198-8ea4-31c9d329fd58-serving-cert\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.766592 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gck9z\" (UniqueName: \"kubernetes.io/projected/ad05982d-9af8-4198-8ea4-31c9d329fd58-kube-api-access-gck9z\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.766592 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7822caa6-5117-4f1f-bb80-94a1dcf4213e-serving-cert\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.766592 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-image-registry-private-configuration\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.766741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-default-certificate\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.766741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4g79\" (UniqueName: \"kubernetes.io/projected/43bf7fc1-0485-4f89-ae8b-043aa756f181-kube-api-access-m4g79\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.766741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-572s4\" (UniqueName: \"kubernetes.io/projected/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-kube-api-access-572s4\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.766887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43bf7fc1-0485-4f89-ae8b-043aa756f181-config\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.766887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmdv6\" (UniqueName: \"kubernetes.io/projected/7822caa6-5117-4f1f-bb80-94a1dcf4213e-kube-api-access-jmdv6\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.766887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad05982d-9af8-4198-8ea4-31c9d329fd58-config\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.766887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766865    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br9lt\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-kube-api-access-br9lt\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.767083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43bf7fc1-0485-4f89-ae8b-043aa756f181-trusted-ca\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.767083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.766976    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7822caa6-5117-4f1f-bb80-94a1dcf4213e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.767083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86c7dded-6875-4ec7-a88b-4048d7b098d9-ca-trust-extracted\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-trusted-ca\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43bf7fc1-0485-4f89-ae8b-043aa756f181-serving-cert\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.767295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7822caa6-5117-4f1f-bb80-94a1dcf4213e-tmp\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.767295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7822caa6-5117-4f1f-bb80-94a1dcf4213e-snapshots\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.767295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-certificates\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-bound-sa-token\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767368    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-stats-auth\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.767588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7822caa6-5117-4f1f-bb80-94a1dcf4213e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.767588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-installation-pull-secrets\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.767588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.767453    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.774028 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.774010    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-j2qn7"]
Sep 06 12:18:12.774136 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.774117    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.776550 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.776532    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 06 12:18:12.776654 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.776562    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nkgs4\""
Sep 06 12:18:12.776832 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.776811    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 06 12:18:12.776920 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.776884    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 06 12:18:12.794097 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.794079    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7jldb"]
Sep 06 12:18:12.794210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.794193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7"
Sep 06 12:18:12.796600 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.796578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-6kh2z\""
Sep 06 12:18:12.820227 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820209    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"]
Sep 06 12:18:12.820313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"]
Sep 06 12:18:12.820313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820268    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"]
Sep 06 12:18:12.820313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820283    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"]
Sep 06 12:18:12.820313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820300    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"]
Sep 06 12:18:12.820313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820312    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-j2qn7"]
Sep 06 12:18:12.820551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gcp8"]
Sep 06 12:18:12.820551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820335    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jldb"]
Sep 06 12:18:12.820551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.820349    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:12.822771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.822752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2nk9\""
Sep 06 12:18:12.822862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.822790    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 06 12:18:12.822862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.822815    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 06 12:18:12.868798 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-installation-pull-secrets\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.868915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868815    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gck9z\" (UniqueName: \"kubernetes.io/projected/ad05982d-9af8-4198-8ea4-31c9d329fd58-kube-api-access-gck9z\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.868915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-default-certificate\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.868915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4g79\" (UniqueName: \"kubernetes.io/projected/43bf7fc1-0485-4f89-ae8b-043aa756f181-kube-api-access-m4g79\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.868915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43bf7fc1-0485-4f89-ae8b-043aa756f181-config\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmdv6\" (UniqueName: \"kubernetes.io/projected/7822caa6-5117-4f1f-bb80-94a1dcf4213e-kube-api-access-jmdv6\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br9lt\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-kube-api-access-br9lt\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x98b5\" (UniqueName: \"kubernetes.io/projected/d8442971-80e2-4e7b-8dbc-34fa53089526-kube-api-access-x98b5\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.868994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43bf7fc1-0485-4f89-ae8b-043aa756f181-trusted-ca\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwt9q\" (UniqueName: \"kubernetes.io/projected/71eaf0cd-d88a-4a47-8cce-a24170f8d3da-kube-api-access-rwt9q\") pod \"volume-data-source-validator-695c895bd6-5vrcj\" (UID: \"71eaf0cd-d88a-4a47-8cce-a24170f8d3da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42466ce8-ea33-4f18-9e0a-90f730216171-cert\") pod \"ingress-canary-6gcp8\" (UID: \"42466ce8-ea33-4f18-9e0a-90f730216171\") " pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43bf7fc1-0485-4f89-ae8b-043aa756f181-serving-cert\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.869127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7822caa6-5117-4f1f-bb80-94a1dcf4213e-tmp\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7822caa6-5117-4f1f-bb80-94a1dcf4213e-snapshots\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-bound-sa-token\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-stats-auth\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dp4jq\" (UniqueName: \"kubernetes.io/projected/8d227759-ce05-4cde-9fc3-e5553262c45a-kube-api-access-dp4jq\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7822caa6-5117-4f1f-bb80-94a1dcf4213e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869317    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869347    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad05982d-9af8-4198-8ea4-31c9d329fd58-serving-cert\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7822caa6-5117-4f1f-bb80-94a1dcf4213e-serving-cert\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-image-registry-private-configuration\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.869441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-572s4\" (UniqueName: \"kubernetes.io/projected/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-kube-api-access-572s4\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad05982d-9af8-4198-8ea4-31c9d329fd58-config\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7822caa6-5117-4f1f-bb80-94a1dcf4213e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86c7dded-6875-4ec7-a88b-4048d7b098d9-ca-trust-extracted\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-trusted-ca\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/43bf7fc1-0485-4f89-ae8b-043aa756f181-config\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee9628f-34d8-4f2a-8914-cde72e918b82-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ee9628f-34d8-4f2a-8914-cde72e918b82-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.869807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.869804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnt2d\" (UniqueName: \"kubernetes.io/projected/42466ce8-ea33-4f18-9e0a-90f730216171-kube-api-access-gnt2d\") pod \"ingress-canary-6gcp8\" (UID: \"42466ce8-ea33-4f18-9e0a-90f730216171\") " pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.870254 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.869900    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:12.870254 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.869916    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-697558986f-9t9ps: secret "image-registry-tls" not found
Sep 06 12:18:12.870254 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.869979    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls podName:86c7dded-6875-4ec7-a88b-4048d7b098d9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:13.369962586 +0000 UTC m=+35.183386649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls") pod "image-registry-697558986f-9t9ps" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9") : secret "image-registry-tls" not found
Sep 06 12:18:12.870379 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/43bf7fc1-0485-4f89-ae8b-043aa756f181-trusted-ca\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.870769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqb72\" (UniqueName: \"kubernetes.io/projected/1ee9628f-34d8-4f2a-8914-cde72e918b82-kube-api-access-cqb72\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.870769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-certificates\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.870769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870485    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7822caa6-5117-4f1f-bb80-94a1dcf4213e-tmp\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.870769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d227759-ce05-4cde-9fc3-e5553262c45a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.870769 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.870638    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:13.370622615 +0000 UTC m=+35.184046692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : configmap references non-existent config key: service-ca.crt
Sep 06 12:18:12.870769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ad05982d-9af8-4198-8ea4-31c9d329fd58-config\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.871137 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.870845    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86c7dded-6875-4ec7-a88b-4048d7b098d9-ca-trust-extracted\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.871233 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.871214    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 12:18:12.872058 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.871469    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:13.371450573 +0000 UTC m=+35.184874633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : secret "router-metrics-certs-default" not found
Sep 06 12:18:12.872175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.872084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7822caa6-5117-4f1f-bb80-94a1dcf4213e-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.873386 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.873362    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-certificates\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.873386 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.873376    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7822caa6-5117-4f1f-bb80-94a1dcf4213e-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.873669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.873649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-trusted-ca\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.873811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.873786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7822caa6-5117-4f1f-bb80-94a1dcf4213e-snapshots\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.874479 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.874209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ad05982d-9af8-4198-8ea4-31c9d329fd58-serving-cert\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.874479 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.874356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7822caa6-5117-4f1f-bb80-94a1dcf4213e-serving-cert\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.874479 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.874424    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-default-certificate\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.875443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.875388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/43bf7fc1-0485-4f89-ae8b-043aa756f181-serving-cert\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.875612 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.875592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-stats-auth\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.876536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.876512    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-image-registry-private-configuration\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.877710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.877683    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmdv6\" (UniqueName: \"kubernetes.io/projected/7822caa6-5117-4f1f-bb80-94a1dcf4213e-kube-api-access-jmdv6\") pod \"insights-operator-76bcd6ccf5-5shz2\" (UID: \"7822caa6-5117-4f1f-bb80-94a1dcf4213e\") " pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.878674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.878645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-installation-pull-secrets\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.879092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.879069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gck9z\" (UniqueName: \"kubernetes.io/projected/ad05982d-9af8-4198-8ea4-31c9d329fd58-kube-api-access-gck9z\") pod \"service-ca-operator-859f94c4b-kxsnb\" (UID: \"ad05982d-9af8-4198-8ea4-31c9d329fd58\") " pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.879466 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.879421    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4g79\" (UniqueName: \"kubernetes.io/projected/43bf7fc1-0485-4f89-ae8b-043aa756f181-kube-api-access-m4g79\") pod \"console-operator-85b454874b-jrpsk\" (UID: \"43bf7fc1-0485-4f89-ae8b-043aa756f181\") " pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.879575 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.879471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br9lt\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-kube-api-access-br9lt\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.879960 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.879936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-bound-sa-token\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:12.880455 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.880433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-572s4\" (UniqueName: \"kubernetes.io/projected/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-kube-api-access-572s4\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:12.921005 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.920979    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:12.939163 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.939130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2"
Sep 06 12:18:12.962998 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.962976    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"
Sep 06 12:18:12.971908 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.971889    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee9628f-34d8-4f2a-8914-cde72e918b82-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.971999 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.971924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.971999 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.971961    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ee9628f-34d8-4f2a-8914-cde72e918b82-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.971999 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.971986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnt2d\" (UniqueName: \"kubernetes.io/projected/42466ce8-ea33-4f18-9e0a-90f730216171-kube-api-access-gnt2d\") pod \"ingress-canary-6gcp8\" (UID: \"42466ce8-ea33-4f18-9e0a-90f730216171\") " pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.972134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16da98dc-bc62-48e9-80d0-b2916ee630a3-tmp-dir\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:12.972134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqb72\" (UniqueName: \"kubernetes.io/projected/1ee9628f-34d8-4f2a-8914-cde72e918b82-kube-api-access-cqb72\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.972134 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.972121    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:12.972303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d227759-ce05-4cde-9fc3-e5553262c45a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.972303 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.972214    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls podName:8d227759-ce05-4cde-9fc3-e5553262c45a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:13.472194406 +0000 UTC m=+35.285618468 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hth6p" (UID: "8d227759-ce05-4cde-9fc3-e5553262c45a") : secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:12.972303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lshxc\" (UniqueName: \"kubernetes.io/projected/680386fe-f38c-48bf-8ad4-57141667dac4-kube-api-access-lshxc\") pod \"network-check-source-685456655f-j2qn7\" (UID: \"680386fe-f38c-48bf-8ad4-57141667dac4\") " pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7"
Sep 06 12:18:12.972460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x98b5\" (UniqueName: \"kubernetes.io/projected/d8442971-80e2-4e7b-8dbc-34fa53089526-kube-api-access-x98b5\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:12.972460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwt9q\" (UniqueName: \"kubernetes.io/projected/71eaf0cd-d88a-4a47-8cce-a24170f8d3da-kube-api-access-rwt9q\") pod \"volume-data-source-validator-695c895bd6-5vrcj\" (UID: \"71eaf0cd-d88a-4a47-8cce-a24170f8d3da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"
Sep 06 12:18:12.972460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972372    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42466ce8-ea33-4f18-9e0a-90f730216171-cert\") pod \"ingress-canary-6gcp8\" (UID: \"42466ce8-ea33-4f18-9e0a-90f730216171\") " pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.972460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972428    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dp4jq\" (UniqueName: \"kubernetes.io/projected/8d227759-ce05-4cde-9fc3-e5553262c45a-kube-api-access-dp4jq\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.972655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:12.972655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16da98dc-bc62-48e9-80d0-b2916ee630a3-config-volume\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:12.972655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ldvq\" (UniqueName: \"kubernetes.io/projected/16da98dc-bc62-48e9-80d0-b2916ee630a3-kube-api-access-8ldvq\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:12.972655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:12.972655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972648    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1ee9628f-34d8-4f2a-8914-cde72e918b82-config\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.972881 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.972789    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 12:18:12.972881 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:12.972842    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls podName:d8442971-80e2-4e7b-8dbc-34fa53089526 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:13.472826354 +0000 UTC m=+35.286250423 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vrvrz" (UID: "d8442971-80e2-4e7b-8dbc-34fa53089526") : secret "samples-operator-tls" not found
Sep 06 12:18:12.972881 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.972848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/8d227759-ce05-4cde-9fc3-e5553262c45a-telemetry-config\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:12.974928 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.974875    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1ee9628f-34d8-4f2a-8914-cde72e918b82-serving-cert\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.975167 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.975125    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/42466ce8-ea33-4f18-9e0a-90f730216171-cert\") pod \"ingress-canary-6gcp8\" (UID: \"42466ce8-ea33-4f18-9e0a-90f730216171\") " pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.981106 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.981080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnt2d\" (UniqueName: \"kubernetes.io/projected/42466ce8-ea33-4f18-9e0a-90f730216171-kube-api-access-gnt2d\") pod \"ingress-canary-6gcp8\" (UID: \"42466ce8-ea33-4f18-9e0a-90f730216171\") " pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:12.981611 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.981569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x98b5\" (UniqueName: \"kubernetes.io/projected/d8442971-80e2-4e7b-8dbc-34fa53089526-kube-api-access-x98b5\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:12.982095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.982012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwt9q\" (UniqueName: \"kubernetes.io/projected/71eaf0cd-d88a-4a47-8cce-a24170f8d3da-kube-api-access-rwt9q\") pod \"volume-data-source-validator-695c895bd6-5vrcj\" (UID: \"71eaf0cd-d88a-4a47-8cce-a24170f8d3da\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"
Sep 06 12:18:12.982193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.982136    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqb72\" (UniqueName: \"kubernetes.io/projected/1ee9628f-34d8-4f2a-8914-cde72e918b82-kube-api-access-cqb72\") pod \"kube-storage-version-migrator-operator-8d7dd4675-zlrrs\" (UID: \"1ee9628f-34d8-4f2a-8914-cde72e918b82\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:12.982885 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:12.982861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dp4jq\" (UniqueName: \"kubernetes.io/projected/8d227759-ce05-4cde-9fc3-e5553262c45a-kube-api-access-dp4jq\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:13.013606 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.013555    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"
Sep 06 12:18:13.061230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.061213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"
Sep 06 12:18:13.073475 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lshxc\" (UniqueName: \"kubernetes.io/projected/680386fe-f38c-48bf-8ad4-57141667dac4-kube-api-access-lshxc\") pod \"network-check-source-685456655f-j2qn7\" (UID: \"680386fe-f38c-48bf-8ad4-57141667dac4\") " pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7"
Sep 06 12:18:13.073534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16da98dc-bc62-48e9-80d0-b2916ee630a3-config-volume\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.073583 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ldvq\" (UniqueName: \"kubernetes.io/projected/16da98dc-bc62-48e9-80d0-b2916ee630a3-kube-api-access-8ldvq\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.073583 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.073681 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16da98dc-bc62-48e9-80d0-b2916ee630a3-tmp-dir\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.073743 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.073720    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:13.073798 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.073788    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls podName:16da98dc-bc62-48e9-80d0-b2916ee630a3 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:13.573768871 +0000 UTC m=+35.387192929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls") pod "dns-default-7jldb" (UID: "16da98dc-bc62-48e9-80d0-b2916ee630a3") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:13.073987 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/16da98dc-bc62-48e9-80d0-b2916ee630a3-tmp-dir\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.074021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.073984    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/16da98dc-bc62-48e9-80d0-b2916ee630a3-config-volume\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.081924 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.081897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ldvq\" (UniqueName: \"kubernetes.io/projected/16da98dc-bc62-48e9-80d0-b2916ee630a3-kube-api-access-8ldvq\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.082003 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.081989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lshxc\" (UniqueName: \"kubernetes.io/projected/680386fe-f38c-48bf-8ad4-57141667dac4-kube-api-access-lshxc\") pod \"network-check-source-685456655f-j2qn7\" (UID: \"680386fe-f38c-48bf-8ad4-57141667dac4\") " pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7"
Sep 06 12:18:13.083677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.083657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6gcp8"
Sep 06 12:18:13.102959 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.102938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7"
Sep 06 12:18:13.379492 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.379415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:13.379492 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.379463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.379500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.379582    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.379602    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-697558986f-9t9ps: secret "image-registry-tls" not found
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.379606    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.379619    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.379605009 +0000 UTC m=+36.193029087 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : configmap references non-existent config key: service-ca.crt
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.379645    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls podName:86c7dded-6875-4ec7-a88b-4048d7b098d9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.379631784 +0000 UTC m=+36.193055842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls") pod "image-registry-697558986f-9t9ps" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9") : secret "image-registry-tls" not found
Sep 06 12:18:13.379705 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.379658    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.379652075 +0000 UTC m=+36.193076131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : secret "router-metrics-certs-default" not found
Sep 06 12:18:13.452648 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.452622    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-j2qn7"]
Sep 06 12:18:13.456475 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.456415    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-5shz2"]
Sep 06 12:18:13.460662 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:13.460640    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7822caa6_5117_4f1f_bb80_94a1dcf4213e.slice/crio-1e6b0d449cba0f6556fd7d041692d350a947d769af6edb260e21279fe9a6c09c WatchSource:0}: Error finding container 1e6b0d449cba0f6556fd7d041692d350a947d769af6edb260e21279fe9a6c09c: Status 404 returned error can't find the container with id 1e6b0d449cba0f6556fd7d041692d350a947d769af6edb260e21279fe9a6c09c
Sep 06 12:18:13.462985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.462963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb"]
Sep 06 12:18:13.465212 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:13.465192    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad05982d_9af8_4198_8ea4_31c9d329fd58.slice/crio-6a1dac4762022a623fe471d95f06114c9e9ce51be0fa1b016ab30b53d690535b WatchSource:0}: Error finding container 6a1dac4762022a623fe471d95f06114c9e9ce51be0fa1b016ab30b53d690535b: Status 404 returned error can't find the container with id 6a1dac4762022a623fe471d95f06114c9e9ce51be0fa1b016ab30b53d690535b
Sep 06 12:18:13.467127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.467109    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6gcp8"]
Sep 06 12:18:13.470635 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:13.470601    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42466ce8_ea33_4f18_9e0a_90f730216171.slice/crio-0d6b6c425af37f8eb49371d2c1a82c48abf3e2be879a1877a677340434f167ef WatchSource:0}: Error finding container 0d6b6c425af37f8eb49371d2c1a82c48abf3e2be879a1877a677340434f167ef: Status 404 returned error can't find the container with id 0d6b6c425af37f8eb49371d2c1a82c48abf3e2be879a1877a677340434f167ef
Sep 06 12:18:13.471542 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.471120    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj"]
Sep 06 12:18:13.472419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.472309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs"]
Sep 06 12:18:13.473058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.473041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-85b454874b-jrpsk"]
Sep 06 12:18:13.473948 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:13.473920    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71eaf0cd_d88a_4a47_8cce_a24170f8d3da.slice/crio-34ce4fc74837e06a942f332a7f86885f5268ac39192de7661fecea5ecaa4f846 WatchSource:0}: Error finding container 34ce4fc74837e06a942f332a7f86885f5268ac39192de7661fecea5ecaa4f846: Status 404 returned error can't find the container with id 34ce4fc74837e06a942f332a7f86885f5268ac39192de7661fecea5ecaa4f846
Sep 06 12:18:13.474487 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:13.474471    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43bf7fc1_0485_4f89_ae8b_043aa756f181.slice/crio-c88a4cc92c2865b729cb32b88d22afeb7da5550cf159cf4bd11a9239e5fb6b06 WatchSource:0}: Error finding container c88a4cc92c2865b729cb32b88d22afeb7da5550cf159cf4bd11a9239e5fb6b06: Status 404 returned error can't find the container with id c88a4cc92c2865b729cb32b88d22afeb7da5550cf159cf4bd11a9239e5fb6b06
Sep 06 12:18:13.475419 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:13.475383    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ee9628f_34d8_4f2a_8914_cde72e918b82.slice/crio-4abfacc711b3c0f62e46d9724c0c656a1c5072d7511a9eda2b2963c160eef7a8 WatchSource:0}: Error finding container 4abfacc711b3c0f62e46d9724c0c656a1c5072d7511a9eda2b2963c160eef7a8: Status 404 returned error can't find the container with id 4abfacc711b3c0f62e46d9724c0c656a1c5072d7511a9eda2b2963c160eef7a8
Sep 06 12:18:13.480115 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.480096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:13.480242 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.480227    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:13.480307 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.480275    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls podName:8d227759-ce05-4cde-9fc3-e5553262c45a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.480261569 +0000 UTC m=+36.293685626 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hth6p" (UID: "8d227759-ce05-4cde-9fc3-e5553262c45a") : secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:13.480307 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.480228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:13.480422 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.480306    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 12:18:13.480422 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.480362    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls podName:d8442971-80e2-4e7b-8dbc-34fa53089526 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.480346308 +0000 UTC m=+36.293770369 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vrvrz" (UID: "d8442971-80e2-4e7b-8dbc-34fa53089526") : secret "samples-operator-tls" not found
Sep 06 12:18:13.581339 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.581203    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:13.581443 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.581343    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:13.581443 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.581402    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls podName:16da98dc-bc62-48e9-80d0-b2916ee630a3 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.581382911 +0000 UTC m=+36.394806979 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls") pod "dns-default-7jldb" (UID: "16da98dc-bc62-48e9-80d0-b2916ee630a3") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:13.716820 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.716593    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pbdnq"]
Sep 06 12:18:13.735416 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.735390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pbdnq"]
Sep 06 12:18:13.735542 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.735510    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:13.737948 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.737928    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Sep 06 12:18:13.738074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.737932    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hpz9n\""
Sep 06 12:18:13.738237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.738217    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Sep 06 12:18:13.849219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.849194    2578 generic.go:356] "Generic (PLEG): container finished" podID="503c81f2-ce8e-4b66-bd05-843066e0308c" containerID="34381387b0b91db9532082646aa5ec1c6942cc58da26c71cf1b6ea7668e9ee2a" exitCode=0
Sep 06 12:18:13.849324 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.849268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerDied","Data":"34381387b0b91db9532082646aa5ec1c6942cc58da26c71cf1b6ea7668e9ee2a"}
Sep 06 12:18:13.850501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.850475    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7" event={"ID":"680386fe-f38c-48bf-8ad4-57141667dac4","Type":"ContainerStarted","Data":"45d3ff4d4c7d0ae68f1737b7a1dcfc542064bc64cfc76eeaa6983c9cb5978756"}
Sep 06 12:18:13.851669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.851647    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gcp8" event={"ID":"42466ce8-ea33-4f18-9e0a-90f730216171","Type":"ContainerStarted","Data":"0d6b6c425af37f8eb49371d2c1a82c48abf3e2be879a1877a677340434f167ef"}
Sep 06 12:18:13.852838 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.852809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2" event={"ID":"7822caa6-5117-4f1f-bb80-94a1dcf4213e","Type":"ContainerStarted","Data":"1e6b0d449cba0f6556fd7d041692d350a947d769af6edb260e21279fe9a6c09c"}
Sep 06 12:18:13.853967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.853947    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb" event={"ID":"ad05982d-9af8-4198-8ea4-31c9d329fd58","Type":"ContainerStarted","Data":"6a1dac4762022a623fe471d95f06114c9e9ce51be0fa1b016ab30b53d690535b"}
Sep 06 12:18:13.855116 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.855088    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj" event={"ID":"71eaf0cd-d88a-4a47-8cce-a24170f8d3da","Type":"ContainerStarted","Data":"34ce4fc74837e06a942f332a7f86885f5268ac39192de7661fecea5ecaa4f846"}
Sep 06 12:18:13.856096 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.856081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs" event={"ID":"1ee9628f-34d8-4f2a-8914-cde72e918b82","Type":"ContainerStarted","Data":"4abfacc711b3c0f62e46d9724c0c656a1c5072d7511a9eda2b2963c160eef7a8"}
Sep 06 12:18:13.857106 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.857089    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" event={"ID":"43bf7fc1-0485-4f89-ae8b-043aa756f181","Type":"ContainerStarted","Data":"c88a4cc92c2865b729cb32b88d22afeb7da5550cf159cf4bd11a9239e5fb6b06"}
Sep 06 12:18:13.884080 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.884054    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c79ce967-390b-405f-99c6-f3b8ab2e65d5-nginx-conf\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:13.884184 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.884163    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:13.985721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.985690    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c79ce967-390b-405f-99c6-f3b8ab2e65d5-nginx-conf\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:13.985915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.985888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:13.986053 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.986027    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 12:18:13.986140 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:13.986099    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert podName:c79ce967-390b-405f-99c6-f3b8ab2e65d5 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:14.486081356 +0000 UTC m=+36.299505416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-pbdnq" (UID: "c79ce967-390b-405f-99c6-f3b8ab2e65d5") : secret "networking-console-plugin-cert" not found
Sep 06 12:18:13.986428 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:13.986408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c79ce967-390b-405f-99c6-f3b8ab2e65d5-nginx-conf\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:14.390074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.389984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.390393    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.390414    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-697558986f-9t9ps: secret "image-registry-tls" not found
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.390474    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls podName:86c7dded-6875-4ec7-a88b-4048d7b098d9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.39045562 +0000 UTC m=+38.203879694 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls") pod "image-registry-697558986f-9t9ps" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9") : secret "image-registry-tls" not found
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.390752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.390814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.390898    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.390949    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.39092787 +0000 UTC m=+38.204351945 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : secret "router-metrics-certs-default" not found
Sep 06 12:18:14.390981 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.390975    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.390964086 +0000 UTC m=+38.204388160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : configmap references non-existent config key: service-ca.crt
Sep 06 12:18:14.491741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.491703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:14.492192 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.491825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:14.492192 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.491865    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:14.492192 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.492014    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 12:18:14.492192 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.492074    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls podName:d8442971-80e2-4e7b-8dbc-34fa53089526 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.492057556 +0000 UTC m=+38.305481627 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vrvrz" (UID: "d8442971-80e2-4e7b-8dbc-34fa53089526") : secret "samples-operator-tls" not found
Sep 06 12:18:14.492192 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.492139    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:14.492192 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.492188    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls podName:8d227759-ce05-4cde-9fc3-e5553262c45a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.492177078 +0000 UTC m=+38.305601150 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hth6p" (UID: "8d227759-ce05-4cde-9fc3-e5553262c45a") : secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:14.492515 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.492242    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 12:18:14.492515 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.492274    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert podName:c79ce967-390b-405f-99c6-f3b8ab2e65d5 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:15.492262752 +0000 UTC m=+37.305686824 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-pbdnq" (UID: "c79ce967-390b-405f-99c6-f3b8ab2e65d5") : secret "networking-console-plugin-cert" not found
Sep 06 12:18:14.593687 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.593164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:14.593687 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.593314    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:14.593687 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:14.593371    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls podName:16da98dc-bc62-48e9-80d0-b2916ee630a3 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:16.593355169 +0000 UTC m=+38.406779229 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls") pod "dns-default-7jldb" (UID: "16da98dc-bc62-48e9-80d0-b2916ee630a3") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:14.872114 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.872077    2578 generic.go:356] "Generic (PLEG): container finished" podID="503c81f2-ce8e-4b66-bd05-843066e0308c" containerID="7d9bb77bbd89401f87b423dc92ecb80c7ca15ea8b2022b6bafcb83a155c8e9fc" exitCode=0
Sep 06 12:18:14.872294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:14.872158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerDied","Data":"7d9bb77bbd89401f87b423dc92ecb80c7ca15ea8b2022b6bafcb83a155c8e9fc"}
Sep 06 12:18:15.501225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:15.501187    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:15.501631 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:15.501511    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 12:18:15.501631 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:15.501576    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert podName:c79ce967-390b-405f-99c6-f3b8ab2e65d5 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:17.501556761 +0000 UTC m=+39.314980850 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-pbdnq" (UID: "c79ce967-390b-405f-99c6-f3b8ab2e65d5") : secret "networking-console-plugin-cert" not found
Sep 06 12:18:15.879282 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:15.879204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tchzz" event={"ID":"503c81f2-ce8e-4b66-bd05-843066e0308c","Type":"ContainerStarted","Data":"3ce1d6b075821f8d77a7cc7ff17db638cf82546ec685645854e1ddd79b678296"}
Sep 06 12:18:15.900735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:15.900671    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tchzz" podStartSLOduration=7.222546983 podStartE2EDuration="36.900649649s" totalImagesPullingTime="29.678102666s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:15.899043004 +0000 UTC m=+37.712467108" watchObservedRunningTime="2026-09-06 12:18:15.900649649 +0000 UTC m=+37.714073729"
Sep 06 12:18:16.411038 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:16.411005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:16.411265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:16.411081    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:16.411265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:16.411130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:16.411265 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.411182    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:16.411265 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.411208    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-697558986f-9t9ps: secret "image-registry-tls" not found
Sep 06 12:18:16.411265 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.411269    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls podName:86c7dded-6875-4ec7-a88b-4048d7b098d9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:20.411249184 +0000 UTC m=+42.224673261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls") pod "image-registry-697558986f-9t9ps" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9") : secret "image-registry-tls" not found
Sep 06 12:18:16.411513 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.411266    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 12:18:16.411513 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.411331    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:20.411313557 +0000 UTC m=+42.224737654 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : secret "router-metrics-certs-default" not found
Sep 06 12:18:16.411513 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.411351    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:20.411342619 +0000 UTC m=+42.224766676 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : configmap references non-existent config key: service-ca.crt
Sep 06 12:18:16.512095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:16.512053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:16.512527 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.512184    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:16.512527 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:16.512247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:16.512527 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.512260    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls podName:8d227759-ce05-4cde-9fc3-e5553262c45a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:20.512238376 +0000 UTC m=+42.325662435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hth6p" (UID: "8d227759-ce05-4cde-9fc3-e5553262c45a") : secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:16.512527 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.512341    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 12:18:16.512527 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.512390    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls podName:d8442971-80e2-4e7b-8dbc-34fa53089526 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:20.51237534 +0000 UTC m=+42.325799414 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vrvrz" (UID: "d8442971-80e2-4e7b-8dbc-34fa53089526") : secret "samples-operator-tls" not found
Sep 06 12:18:16.613373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:16.613334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:16.613541 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.613507    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:16.613601 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:16.613582    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls podName:16da98dc-bc62-48e9-80d0-b2916ee630a3 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:20.613561874 +0000 UTC m=+42.426985945 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls") pod "dns-default-7jldb" (UID: "16da98dc-bc62-48e9-80d0-b2916ee630a3") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:17.521827 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:17.521788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:17.522259 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:17.521940    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 12:18:17.522259 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:17.522001    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert podName:c79ce967-390b-405f-99c6-f3b8ab2e65d5 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:21.521985469 +0000 UTC m=+43.335409540 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-pbdnq" (UID: "c79ce967-390b-405f-99c6-f3b8ab2e65d5") : secret "networking-console-plugin-cert" not found
Sep 06 12:18:20.442043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:20.442003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:20.442092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:20.442139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.442192    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.442215    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-697558986f-9t9ps: secret "image-registry-tls" not found
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.442255    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.442275    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls podName:86c7dded-6875-4ec7-a88b-4048d7b098d9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:28.442256285 +0000 UTC m=+50.255680360 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls") pod "image-registry-697558986f-9t9ps" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9") : secret "image-registry-tls" not found
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.442312    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:28.442295965 +0000 UTC m=+50.255720042 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : configmap references non-existent config key: service-ca.crt
Sep 06 12:18:20.442500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.442331    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:28.442323553 +0000 UTC m=+50.255747614 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : secret "router-metrics-certs-default" not found
Sep 06 12:18:20.542936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:20.542894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:20.543109 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.543060    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:20.543109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:20.543035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:20.543234 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.543128    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls podName:8d227759-ce05-4cde-9fc3-e5553262c45a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:28.543108609 +0000 UTC m=+50.356532679 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hth6p" (UID: "8d227759-ce05-4cde-9fc3-e5553262c45a") : secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:20.543234 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.543181    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 12:18:20.543353 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.543238    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls podName:d8442971-80e2-4e7b-8dbc-34fa53089526 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:28.543223871 +0000 UTC m=+50.356647942 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vrvrz" (UID: "d8442971-80e2-4e7b-8dbc-34fa53089526") : secret "samples-operator-tls" not found
Sep 06 12:18:20.643919 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:20.643888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:20.644090 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.644070    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:20.644173 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:20.644161    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls podName:16da98dc-bc62-48e9-80d0-b2916ee630a3 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:28.644130815 +0000 UTC m=+50.457554885 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls") pod "dns-default-7jldb" (UID: "16da98dc-bc62-48e9-80d0-b2916ee630a3") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:21.550981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.550949    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:21.551300 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:21.551213    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 12:18:21.551300 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:21.551267    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert podName:c79ce967-390b-405f-99c6-f3b8ab2e65d5 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:29.551248948 +0000 UTC m=+51.364673010 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-pbdnq" (UID: "c79ce967-390b-405f-99c6-f3b8ab2e65d5") : secret "networking-console-plugin-cert" not found
Sep 06 12:18:21.905522 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.905377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb" event={"ID":"ad05982d-9af8-4198-8ea4-31c9d329fd58","Type":"ContainerStarted","Data":"4049b02dd5d9da42ce612f0c99a8aa66a03006fe21d6e12ae5f9de0f79fd7e27"}
Sep 06 12:18:21.907210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.907180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj" event={"ID":"71eaf0cd-d88a-4a47-8cce-a24170f8d3da","Type":"ContainerStarted","Data":"081af56ed9140a16100a57a5527e12d9c570f839414090b01807a16cdeebbcbe"}
Sep 06 12:18:21.908987 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.908964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs" event={"ID":"1ee9628f-34d8-4f2a-8914-cde72e918b82","Type":"ContainerStarted","Data":"022a3bd7325151e29b1d3b3ea8fe656a939afcfd1200bb26c0ba9fed76ba8a50"}
Sep 06 12:18:21.911225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.911206    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/0.log"
Sep 06 12:18:21.911341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.911241    2578 generic.go:356] "Generic (PLEG): container finished" podID="43bf7fc1-0485-4f89-ae8b-043aa756f181" containerID="78fa030e8c1bf61ff0d317f736a162c5a251d77017074d6f812563be2d42a9ef" exitCode=255
Sep 06 12:18:21.911341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.911326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" event={"ID":"43bf7fc1-0485-4f89-ae8b-043aa756f181","Type":"ContainerDied","Data":"78fa030e8c1bf61ff0d317f736a162c5a251d77017074d6f812563be2d42a9ef"}
Sep 06 12:18:21.911534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.911500    2578 scope.go:117] "RemoveContainer" containerID="78fa030e8c1bf61ff0d317f736a162c5a251d77017074d6f812563be2d42a9ef"
Sep 06 12:18:21.913132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.913110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7" event={"ID":"680386fe-f38c-48bf-8ad4-57141667dac4","Type":"ContainerStarted","Data":"8e88312fd93c6e478bbb5aaa93cc1182e9c23d5a05f7ade57428b1df8a0233b3"}
Sep 06 12:18:21.914752 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.914730    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6gcp8" event={"ID":"42466ce8-ea33-4f18-9e0a-90f730216171","Type":"ContainerStarted","Data":"f16df5163e41d3c8301f169bd57b311566582815b143f6381ba62f85e1dc698a"}
Sep 06 12:18:21.916357 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.916332    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2" event={"ID":"7822caa6-5117-4f1f-bb80-94a1dcf4213e","Type":"ContainerStarted","Data":"0660bb2013e750b9a2ff6284a9c5184bce2f0c8a94d0c88247cd82f85edbf183"}
Sep 06 12:18:21.924877 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.924832    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb" podStartSLOduration=27.171106056 podStartE2EDuration="34.924817759s" totalImagesPullingTime="7.753711703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:21.923993578 +0000 UTC m=+43.737417658" watchObservedRunningTime="2026-09-06 12:18:21.924817759 +0000 UTC m=+43.738241839"
Sep 06 12:18:21.960291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.959078    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-5vrcj" podStartSLOduration=27.363573181 podStartE2EDuration="34.959061947s" totalImagesPullingTime="7.595488766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:21.944293258 +0000 UTC m=+43.757717338" watchObservedRunningTime="2026-09-06 12:18:21.959061947 +0000 UTC m=+43.772486027"
Sep 06 12:18:21.960291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.959609    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6gcp8" podStartSLOduration=2.2064796700000002 podStartE2EDuration="9.959600125s" totalImagesPullingTime="7.753120455s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:21.959585109 +0000 UTC m=+43.773009193" watchObservedRunningTime="2026-09-06 12:18:21.959600125 +0000 UTC m=+43.773024208"
Sep 06 12:18:21.991827 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:21.991779    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs" podStartSLOduration=27.238421744 podStartE2EDuration="34.991764158s" totalImagesPullingTime="7.753342414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:21.991463838 +0000 UTC m=+43.804887918" watchObservedRunningTime="2026-09-06 12:18:21.991764158 +0000 UTC m=+43.805188238"
Sep 06 12:18:22.004492 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.004456    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-j2qn7" podStartSLOduration=27.241399831 podStartE2EDuration="35.004443581s" totalImagesPullingTime="7.76304375s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:22.004362221 +0000 UTC m=+43.817786299" watchObservedRunningTime="2026-09-06 12:18:22.004443581 +0000 UTC m=+43.817867660"
Sep 06 12:18:22.021766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.021726    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2" podStartSLOduration=27.267335455 podStartE2EDuration="35.021692235s" totalImagesPullingTime="7.75435678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:22.021281755 +0000 UTC m=+43.834705834" watchObservedRunningTime="2026-09-06 12:18:22.021692235 +0000 UTC m=+43.835116316"
Sep 06 12:18:22.921690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.921662    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:22.922094 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.921730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:22.925444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.925424    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:18:22.925894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.925878    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/0.log"
Sep 06 12:18:22.926019 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.925917    2578 generic.go:356] "Generic (PLEG): container finished" podID="43bf7fc1-0485-4f89-ae8b-043aa756f181" containerID="2fab6562a228fa112de5034ec30c0433488c153ce7eb4d5dbf6436ca02c9af70" exitCode=255
Sep 06 12:18:22.926077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.926017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" event={"ID":"43bf7fc1-0485-4f89-ae8b-043aa756f181","Type":"ContainerDied","Data":"2fab6562a228fa112de5034ec30c0433488c153ce7eb4d5dbf6436ca02c9af70"}
Sep 06 12:18:22.926122 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.926076    2578 scope.go:117] "RemoveContainer" containerID="78fa030e8c1bf61ff0d317f736a162c5a251d77017074d6f812563be2d42a9ef"
Sep 06 12:18:22.926491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:22.926299    2578 scope.go:117] "RemoveContainer" containerID="2fab6562a228fa112de5034ec30c0433488c153ce7eb4d5dbf6436ca02c9af70"
Sep 06 12:18:22.926573 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:22.926487    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jrpsk_openshift-console-operator(43bf7fc1-0485-4f89-ae8b-043aa756f181)\"" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" podUID="43bf7fc1-0485-4f89-ae8b-043aa756f181"
Sep 06 12:18:23.392669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.392634    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mlsk9"]
Sep 06 12:18:23.428292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.428255    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mlsk9"]
Sep 06 12:18:23.428428 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.428380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.430738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.430715    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 06 12:18:23.430867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.430813    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 06 12:18:23.430867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.430860    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-spt24\""
Sep 06 12:18:23.467900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.467874    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.468013 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.467921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-crio-socket\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.468053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.468008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.468053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.468048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-data-volume\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.468132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.468089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x626n\" (UniqueName: \"kubernetes.io/projected/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-api-access-x626n\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-crio-socket\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-data-volume\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x626n\" (UniqueName: \"kubernetes.io/projected/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-api-access-x626n\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-crio-socket\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569671 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:23.569558    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:23.569671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.569671 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:23.569620    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:24.069603775 +0000 UTC m=+45.883027847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:23.569844 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:23.569698    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:23.569844 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:23.569755    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:24.069738457 +0000 UTC m=+45.883162536 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:23.569844 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.569811    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-data-volume\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.578926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.578909    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x626n\" (UniqueName: \"kubernetes.io/projected/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-api-access-x626n\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:23.931299 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.931273    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:18:23.931659 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:23.931604    2578 scope.go:117] "RemoveContainer" containerID="2fab6562a228fa112de5034ec30c0433488c153ce7eb4d5dbf6436ca02c9af70"
Sep 06 12:18:23.931805 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:23.931785    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-85b454874b-jrpsk_openshift-console-operator(43bf7fc1-0485-4f89-ae8b-043aa756f181)\"" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" podUID="43bf7fc1-0485-4f89-ae8b-043aa756f181"
Sep 06 12:18:24.074321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:24.074291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:24.074457 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:24.074390    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:24.074457 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:24.074402    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:24.074529 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:24.074469    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:25.07445064 +0000 UTC m=+46.887874727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:24.074529 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:24.074521    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:24.074598 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:24.074581    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:25.074568921 +0000 UTC m=+46.887992991 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:25.082744 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:25.082716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:25.083175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:25.082794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:25.083175 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:25.082835    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:25.083175 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:25.082900    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:27.082886276 +0000 UTC m=+48.896310332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:25.083175 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:25.082955    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:25.083175 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:25.083023    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:27.083006907 +0000 UTC m=+48.896430982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:25.754304 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:25.754275    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxrmg_54aa5f32-f784-42ad-a18e-ceb438edf790/dns-node-resolver/0.log"
Sep 06 12:18:26.954244 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:26.954215    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p9t9n_7f2966f7-6de1-4f24-8c25-6cb02f10280d/node-ca/0.log"
Sep 06 12:18:27.100086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:27.100054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:27.100248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:27.100170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:27.100248 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:27.100203    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:27.100332 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:27.100261    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:31.100246689 +0000 UTC m=+52.913670746 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:27.100332 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:27.100289    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 06 12:18:27.100408 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:27.100348    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:31.100332293 +0000 UTC m=+52.913756367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : configmap "kube-rbac-proxy" not found
Sep 06 12:18:27.555434 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:27.555402    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gcp8_42466ce8-ea33-4f18-9e0a-90f730216171/serve-healthcheck-canary/0.log"
Sep 06 12:18:28.156458 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.156429    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-zlrrs_1ee9628f-34d8-4f2a-8914-cde72e918b82/kube-storage-version-migrator-operator/0.log"
Sep 06 12:18:28.516804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.516768    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:28.516962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.516874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:28.516962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.516913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:28.517032 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.516973    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.516948539 +0000 UTC m=+66.330372615 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : configmap references non-existent config key: service-ca.crt
Sep 06 12:18:28.517032 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.516997    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Sep 06 12:18:28.517032 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.517026    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 06 12:18:28.517132 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.517041    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-697558986f-9t9ps: secret "image-registry-tls" not found
Sep 06 12:18:28.517132 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.517048    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs podName:fe76b0a0-a1ec-4344-bc69-48a6028d51ff nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.517036392 +0000 UTC m=+66.330460449 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs") pod "router-default-54f9f9784-n5ntv" (UID: "fe76b0a0-a1ec-4344-bc69-48a6028d51ff") : secret "router-metrics-certs-default" not found
Sep 06 12:18:28.517132 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.517087    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls podName:86c7dded-6875-4ec7-a88b-4048d7b098d9 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.517075689 +0000 UTC m=+66.330499763 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls") pod "image-registry-697558986f-9t9ps" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9") : secret "image-registry-tls" not found
Sep 06 12:18:28.617983 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.617947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:28.618186 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.618050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:28.618186 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.618081    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 06 12:18:28.618186 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.618136    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:28.618352 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.618139    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls podName:d8442971-80e2-4e7b-8dbc-34fa53089526 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.618125198 +0000 UTC m=+66.431549275 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls") pod "cluster-samples-operator-7cdcfcf76c-vrvrz" (UID: "d8442971-80e2-4e7b-8dbc-34fa53089526") : secret "samples-operator-tls" not found
Sep 06 12:18:28.618352 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.618231    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls podName:8d227759-ce05-4cde-9fc3-e5553262c45a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.61821016 +0000 UTC m=+66.431634232 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6cdcc96965-hth6p" (UID: "8d227759-ce05-4cde-9fc3-e5553262c45a") : secret "cluster-monitoring-operator-tls" not found
Sep 06 12:18:28.718518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:28.718489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:28.718646 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.718630    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 06 12:18:28.718697 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:28.718688    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls podName:16da98dc-bc62-48e9-80d0-b2916ee630a3 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:44.718672527 +0000 UTC m=+66.532096584 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls") pod "dns-default-7jldb" (UID: "16da98dc-bc62-48e9-80d0-b2916ee630a3") : secret "dns-default-metrics-tls" not found
Sep 06 12:18:29.626678 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:29.626644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:29.627057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:29.626790    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Sep 06 12:18:29.627057 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:29.626864    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert podName:c79ce967-390b-405f-99c6-f3b8ab2e65d5 nodeName:}" failed. No retries permitted until 2026-09-06 12:18:45.626848414 +0000 UTC m=+67.440272472 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert") pod "networking-console-plugin-79977f9844-pbdnq" (UID: "c79ce967-390b-405f-99c6-f3b8ab2e65d5") : secret "networking-console-plugin-cert" not found
Sep 06 12:18:31.139664 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:31.139632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:31.140050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:31.139722    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:31.140050 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:31.139815    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:31.140050 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:18:31.139866    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls podName:7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a nodeName:}" failed. No retries permitted until 2026-09-06 12:18:39.139853064 +0000 UTC m=+60.953277121 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls") pod "insights-runtime-extractor-mlsk9" (UID: "7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a") : secret "insights-runtime-extractor-tls" not found
Sep 06 12:18:31.140246 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:31.140228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:32.921491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:32.921459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:32.921902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:32.921513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:32.921902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:32.921814    2578 scope.go:117] "RemoveContainer" containerID="2fab6562a228fa112de5034ec30c0433488c153ce7eb4d5dbf6436ca02c9af70"
Sep 06 12:18:33.965751 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:33.965722    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:18:33.966224 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:33.965802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" event={"ID":"43bf7fc1-0485-4f89-ae8b-043aa756f181","Type":"ContainerStarted","Data":"421d36214086b2376d2fbf837d9ef2585ab28a7ea638ecb8ae4c82a4df334543"}
Sep 06 12:18:33.966224 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:33.966111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:33.982291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:33.982246    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-85b454874b-jrpsk" podStartSLOduration=39.229738217 podStartE2EDuration="46.982235031s" totalImagesPullingTime="7.752496814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:33.981512625 +0000 UTC m=+55.794936728" watchObservedRunningTime="2026-09-06 12:18:33.982235031 +0000 UTC m=+55.795659109"
Sep 06 12:18:34.050478 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:34.050454    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-85b454874b-jrpsk"
Sep 06 12:18:38.843809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:38.843785    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2mcdg"
Sep 06 12:18:39.208754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.208720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:39.210745 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.210723    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mlsk9\" (UID: \"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a\") " pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:39.339484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.339463    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-spt24\""
Sep 06 12:18:39.347683 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.347664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mlsk9"
Sep 06 12:18:39.614783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.614718    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mlsk9"]
Sep 06 12:18:39.619370 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:39.619334    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c0ff89e_93c0_4af8_8c9b_60a7cb079b1a.slice/crio-32001704772dc7f9684177e767a501aaba40b0d084356b8d2a67ad85957f420a WatchSource:0}: Error finding container 32001704772dc7f9684177e767a501aaba40b0d084356b8d2a67ad85957f420a: Status 404 returned error can't find the container with id 32001704772dc7f9684177e767a501aaba40b0d084356b8d2a67ad85957f420a
Sep 06 12:18:39.985260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.985224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlsk9" event={"ID":"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a","Type":"ContainerStarted","Data":"337893c227ae47cbb9aefd7e08e94be2a8e49076ca7a77d9496d4a8123b65979"}
Sep 06 12:18:39.985610 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:39.985285    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlsk9" event={"ID":"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a","Type":"ContainerStarted","Data":"32001704772dc7f9684177e767a501aaba40b0d084356b8d2a67ad85957f420a"}
Sep 06 12:18:40.991208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:40.991172    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlsk9" event={"ID":"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a","Type":"ContainerStarted","Data":"6ed68d185b623ce656bf34f2ad62f7260b2cb70b42ec471fee2d0c52702ee97f"}
Sep 06 12:18:41.998622 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:41.998584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mlsk9" event={"ID":"7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a","Type":"ContainerStarted","Data":"6bd85549f8524d4d6d5549ef91007c682bb3b1376b6d1abf1f1db3808a3bd864"}
Sep 06 12:18:42.015280 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:42.015241    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mlsk9" podStartSLOduration=16.862539537 podStartE2EDuration="19.015225891s" totalImagesPullingTime="2.152686354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:18:23 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:42.014822949 +0000 UTC m=+63.828247028" watchObservedRunningTime="2026-09-06 12:18:42.015225891 +0000 UTC m=+63.828649969"
Sep 06 12:18:44.552695 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.552658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:44.552695 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.552699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:44.553295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.552723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:44.553295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.552770    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:44.553295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.552811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:44.553295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.552877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:44.553449 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.553397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-service-ca-bundle\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:44.555303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.555276    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 06 12:18:44.555451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.555418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fe76b0a0-a1ec-4344-bc69-48a6028d51ff-metrics-certs\") pod \"router-default-54f9f9784-n5ntv\" (UID: \"fe76b0a0-a1ec-4344-bc69-48a6028d51ff\") " pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:44.555978 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.555949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"image-registry-697558986f-9t9ps\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") " pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:44.555978 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.555966    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2vbr\" (UniqueName: \"kubernetes.io/projected/204d4f48-bcc4-40bc-b1a6-710dc2f955f9-kube-api-access-x2vbr\") pod \"network-check-target-56gx2\" (UID: \"204d4f48-bcc4-40bc-b1a6-710dc2f955f9\") " pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:44.556279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.556265    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 06 12:18:44.565099 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.565075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cbef0fcf-3628-4500-bb73-3af52c312c80-metrics-certs\") pod \"network-metrics-daemon-ffnwb\" (UID: \"cbef0fcf-3628-4500-bb73-3af52c312c80\") " pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:44.565285 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.565264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/511dbd99-611b-4839-8f80-84edaf706c81-original-pull-secret\") pod \"global-pull-secret-syncer-547dz\" (UID: \"511dbd99-611b-4839-8f80-84edaf706c81\") " pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:44.654221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.654195    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:44.654307 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.654244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:44.656220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.656193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/d8442971-80e2-4e7b-8dbc-34fa53089526-samples-operator-tls\") pod \"cluster-samples-operator-7cdcfcf76c-vrvrz\" (UID: \"d8442971-80e2-4e7b-8dbc-34fa53089526\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:44.656321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.656306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/8d227759-ce05-4cde-9fc3-e5553262c45a-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6cdcc96965-hth6p\" (UID: \"8d227759-ce05-4cde-9fc3-e5553262c45a\") " pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:44.708920 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.708899    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-jx6gc\""
Sep 06 12:18:44.717020 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.716997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:44.755286 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.755262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:44.757271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.757254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/16da98dc-bc62-48e9-80d0-b2916ee630a3-metrics-tls\") pod \"dns-default-7jldb\" (UID: \"16da98dc-bc62-48e9-80d0-b2916ee630a3\") " pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:44.789467 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.789445    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-5lbps\""
Sep 06 12:18:44.797789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.797770    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:44.807972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.807945    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-qrr2p\""
Sep 06 12:18:44.815946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.815928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ffnwb"
Sep 06 12:18:44.822054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.822037    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vrsdl\""
Sep 06 12:18:44.827293 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.827272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-547dz"
Sep 06 12:18:44.829898 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.829880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:44.837373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.837185    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vnnxd\""
Sep 06 12:18:44.841538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.841470    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-bct5f\""
Sep 06 12:18:44.845421 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.845397    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"
Sep 06 12:18:44.849689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.849668    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"
Sep 06 12:18:44.934311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.934220    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-x2nk9\""
Sep 06 12:18:44.944647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.941093    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7jldb"
Sep 06 12:18:44.989638 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:44.989352    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-697558986f-9t9ps"]
Sep 06 12:18:44.992617 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:44.992585    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86c7dded_6875_4ec7_a88b_4048d7b098d9.slice/crio-b6207c1348a8e30f770d713281d4a06440e38aceb38686511ab9fce07359a03d WatchSource:0}: Error finding container b6207c1348a8e30f770d713281d4a06440e38aceb38686511ab9fce07359a03d: Status 404 returned error can't find the container with id b6207c1348a8e30f770d713281d4a06440e38aceb38686511ab9fce07359a03d
Sep 06 12:18:45.011859 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.011745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697558986f-9t9ps" event={"ID":"86c7dded-6875-4ec7-a88b-4048d7b098d9","Type":"ContainerStarted","Data":"b6207c1348a8e30f770d713281d4a06440e38aceb38686511ab9fce07359a03d"}
Sep 06 12:18:45.087673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.087650    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-54f9f9784-n5ntv"]
Sep 06 12:18:45.089838 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:45.089810    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe76b0a0_a1ec_4344_bc69_48a6028d51ff.slice/crio-027ed421a2946d90b1fce7d03a52ac87de1608750df0bc83858f12ec09e0a17e WatchSource:0}: Error finding container 027ed421a2946d90b1fce7d03a52ac87de1608750df0bc83858f12ec09e0a17e: Status 404 returned error can't find the container with id 027ed421a2946d90b1fce7d03a52ac87de1608750df0bc83858f12ec09e0a17e
Sep 06 12:18:45.157847 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.157808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ffnwb"]
Sep 06 12:18:45.161220 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:45.161188    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbef0fcf_3628_4500_bb73_3af52c312c80.slice/crio-537fdd0180e0791a841e0bfce23b2cc70c338e625edc9ee12f58af4d6430bd39 WatchSource:0}: Error finding container 537fdd0180e0791a841e0bfce23b2cc70c338e625edc9ee12f58af4d6430bd39: Status 404 returned error can't find the container with id 537fdd0180e0791a841e0bfce23b2cc70c338e625edc9ee12f58af4d6430bd39
Sep 06 12:18:45.181331 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.181296    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-547dz"]
Sep 06 12:18:45.187542 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.185377    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p"]
Sep 06 12:18:45.187542 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.186891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-56gx2"]
Sep 06 12:18:45.188280 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.188251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz"]
Sep 06 12:18:45.191059 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:45.189988    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d227759_ce05_4cde_9fc3_e5553262c45a.slice/crio-88a8ab70f00e1f849ade2cf7d680dd47dfab03ed9819461cacc5ad4edf8ab205 WatchSource:0}: Error finding container 88a8ab70f00e1f849ade2cf7d680dd47dfab03ed9819461cacc5ad4edf8ab205: Status 404 returned error can't find the container with id 88a8ab70f00e1f849ade2cf7d680dd47dfab03ed9819461cacc5ad4edf8ab205
Sep 06 12:18:45.191059 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:45.190411    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204d4f48_bcc4_40bc_b1a6_710dc2f955f9.slice/crio-04d9ba55010d853fdbef5cc4a34e075d80b3df95b1ccf05eabe5ea1ce4fa16f0 WatchSource:0}: Error finding container 04d9ba55010d853fdbef5cc4a34e075d80b3df95b1ccf05eabe5ea1ce4fa16f0: Status 404 returned error can't find the container with id 04d9ba55010d853fdbef5cc4a34e075d80b3df95b1ccf05eabe5ea1ce4fa16f0
Sep 06 12:18:45.235979 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.235956    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7jldb"]
Sep 06 12:18:45.238535 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:45.238508    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16da98dc_bc62_48e9_80d0_b2916ee630a3.slice/crio-1aae9dd9c38e65f79dfb7c63de8dc0c69d6dec2282e2d34149454a39a83563f9 WatchSource:0}: Error finding container 1aae9dd9c38e65f79dfb7c63de8dc0c69d6dec2282e2d34149454a39a83563f9: Status 404 returned error can't find the container with id 1aae9dd9c38e65f79dfb7c63de8dc0c69d6dec2282e2d34149454a39a83563f9
Sep 06 12:18:45.419834 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.419758    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"]
Sep 06 12:18:45.424193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.424172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.427074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.427044    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 06 12:18:45.427273 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.427183    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 06 12:18:45.427528 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.427391    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 06 12:18:45.427666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.427620    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 06 12:18:45.438909 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.438884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"]
Sep 06 12:18:45.519012 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.518977    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-7jgf5"]
Sep 06 12:18:45.522213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.522194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:18:45.525016 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.524997    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 06 12:18:45.525297 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.525282    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 06 12:18:45.525377 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.525316    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-fhg6l\""
Sep 06 12:18:45.532639 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.532618    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-7jgf5"]
Sep 06 12:18:45.561309 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.561282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5cef610-92ac-43c7-a3c8-663c775745b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.561594 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.561318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5cef610-92ac-43c7-a3c8-663c775745b1-tmp\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.561594 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.561363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4zcl\" (UniqueName: \"kubernetes.io/projected/b5cef610-92ac-43c7-a3c8-663c775745b1-kube-api-access-q4zcl\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.662174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.662122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5cef610-92ac-43c7-a3c8-663c775745b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.662174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.662179    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5cef610-92ac-43c7-a3c8-663c775745b1-tmp\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.662367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.662211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4zcl\" (UniqueName: \"kubernetes.io/projected/b5cef610-92ac-43c7-a3c8-663c775745b1-kube-api-access-q4zcl\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.662367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.662233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgr7\" (UniqueName: \"kubernetes.io/projected/ad66a5b3-cfc5-4284-9519-d85963e011fa-kube-api-access-qtgr7\") pod \"downloads-85d98c998f-7jgf5\" (UID: \"ad66a5b3-cfc5-4284-9519-d85963e011fa\") " pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:18:45.662367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.662258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:45.662646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.662619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b5cef610-92ac-43c7-a3c8-663c775745b1-tmp\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.664644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.664611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/c79ce967-390b-405f-99c6-f3b8ab2e65d5-networking-console-plugin-cert\") pod \"networking-console-plugin-79977f9844-pbdnq\" (UID: \"c79ce967-390b-405f-99c6-f3b8ab2e65d5\") " pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:45.664744 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.664726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/b5cef610-92ac-43c7-a3c8-663c775745b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.671423 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.671358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4zcl\" (UniqueName: \"kubernetes.io/projected/b5cef610-92ac-43c7-a3c8-663c775745b1-kube-api-access-q4zcl\") pod \"klusterlet-addon-workmgr-6bc65fcbdb-jpmrt\" (UID: \"b5cef610-92ac-43c7-a3c8-663c775745b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.736623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.736591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:45.763484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.763455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgr7\" (UniqueName: \"kubernetes.io/projected/ad66a5b3-cfc5-4284-9519-d85963e011fa-kube-api-access-qtgr7\") pod \"downloads-85d98c998f-7jgf5\" (UID: \"ad66a5b3-cfc5-4284-9519-d85963e011fa\") " pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:18:45.777223 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.777193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgr7\" (UniqueName: \"kubernetes.io/projected/ad66a5b3-cfc5-4284-9519-d85963e011fa-kube-api-access-qtgr7\") pod \"downloads-85d98c998f-7jgf5\" (UID: \"ad66a5b3-cfc5-4284-9519-d85963e011fa\") " pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:18:45.832262 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.832031    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:18:45.847047 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.847015    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-hpz9n\""
Sep 06 12:18:45.855695 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:45.855666    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq"
Sep 06 12:18:46.023757 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.023728    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"]
Sep 06 12:18:46.024120 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.024080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz" event={"ID":"d8442971-80e2-4e7b-8dbc-34fa53089526","Type":"ContainerStarted","Data":"aae6d34ba6ddcba86250dc6e6865e7584e49c1cd3df6c5f5fd486f605f88c3b2"}
Sep 06 12:18:46.029039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.028977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-547dz" event={"ID":"511dbd99-611b-4839-8f80-84edaf706c81","Type":"ContainerStarted","Data":"cafffe55a081ff6d5d8a52b5a7aa4f0cf28228a983fd5990c0e34238bddb3c8c"}
Sep 06 12:18:46.031338 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:46.031313    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5cef610_92ac_43c7_a3c8_663c775745b1.slice/crio-6a53d5e9e2686f33fffddf8acfcda7235033648c9189fd015b417de5f5986547 WatchSource:0}: Error finding container 6a53d5e9e2686f33fffddf8acfcda7235033648c9189fd015b417de5f5986547: Status 404 returned error can't find the container with id 6a53d5e9e2686f33fffddf8acfcda7235033648c9189fd015b417de5f5986547
Sep 06 12:18:46.033488 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.033462    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-56gx2" event={"ID":"204d4f48-bcc4-40bc-b1a6-710dc2f955f9","Type":"ContainerStarted","Data":"d216e31bcd74dd98f8b94f1e3d1d86a0934f50e6761a61b9ffd3d3688fea3500"}
Sep 06 12:18:46.033745 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.033729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:18:46.033986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.033968    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-56gx2" event={"ID":"204d4f48-bcc4-40bc-b1a6-710dc2f955f9","Type":"ContainerStarted","Data":"04d9ba55010d853fdbef5cc4a34e075d80b3df95b1ccf05eabe5ea1ce4fa16f0"}
Sep 06 12:18:46.036051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.035989    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffnwb" event={"ID":"cbef0fcf-3628-4500-bb73-3af52c312c80","Type":"ContainerStarted","Data":"537fdd0180e0791a841e0bfce23b2cc70c338e625edc9ee12f58af4d6430bd39"}
Sep 06 12:18:46.042318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.042289    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f9f9784-n5ntv" event={"ID":"fe76b0a0-a1ec-4344-bc69-48a6028d51ff","Type":"ContainerStarted","Data":"11bafd044f2e5a1013c20daed6bef45324470519cf5efa7048b68f71d1d435a4"}
Sep 06 12:18:46.042417 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.042339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-54f9f9784-n5ntv" event={"ID":"fe76b0a0-a1ec-4344-bc69-48a6028d51ff","Type":"ContainerStarted","Data":"027ed421a2946d90b1fce7d03a52ac87de1608750df0bc83858f12ec09e0a17e"}
Sep 06 12:18:46.046770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.046725    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697558986f-9t9ps" event={"ID":"86c7dded-6875-4ec7-a88b-4048d7b098d9","Type":"ContainerStarted","Data":"9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99"}
Sep 06 12:18:46.046855 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.046782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:18:46.052078 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.052016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jldb" event={"ID":"16da98dc-bc62-48e9-80d0-b2916ee630a3","Type":"ContainerStarted","Data":"1aae9dd9c38e65f79dfb7c63de8dc0c69d6dec2282e2d34149454a39a83563f9"}
Sep 06 12:18:46.054728 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.054662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p" event={"ID":"8d227759-ce05-4cde-9fc3-e5553262c45a","Type":"ContainerStarted","Data":"88a8ab70f00e1f849ade2cf7d680dd47dfab03ed9819461cacc5ad4edf8ab205"}
Sep 06 12:18:46.071701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.070533    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-56gx2" podStartSLOduration=67.070517217 podStartE2EDuration="1m7.070517217s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:46.049402156 +0000 UTC m=+67.862826237" watchObservedRunningTime="2026-09-06 12:18:46.070517217 +0000 UTC m=+67.883941298"
Sep 06 12:18:46.092174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.091832    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-54f9f9784-n5ntv" podStartSLOduration=59.091814771 podStartE2EDuration="59.091814771s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:46.091585565 +0000 UTC m=+67.905009646" watchObservedRunningTime="2026-09-06 12:18:46.091814771 +0000 UTC m=+67.905238850"
Sep 06 12:18:46.093096 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.092908    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-697558986f-9t9ps" podStartSLOduration=67.092892895 podStartE2EDuration="1m7.092892895s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:46.071599551 +0000 UTC m=+67.885023634" watchObservedRunningTime="2026-09-06 12:18:46.092892895 +0000 UTC m=+67.906316978"
Sep 06 12:18:46.117852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.117795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-7jgf5"]
Sep 06 12:18:46.154674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.153136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-79977f9844-pbdnq"]
Sep 06 12:18:46.532252 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:46.532120    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc79ce967_390b_405f_99c6_f3b8ab2e65d5.slice/crio-9c1847754579e40c7cc6b6be7d77cd377e4e3c3525259a8d3cae19ad4ee1a0d8 WatchSource:0}: Error finding container 9c1847754579e40c7cc6b6be7d77cd377e4e3c3525259a8d3cae19ad4ee1a0d8: Status 404 returned error can't find the container with id 9c1847754579e40c7cc6b6be7d77cd377e4e3c3525259a8d3cae19ad4ee1a0d8
Sep 06 12:18:46.532474 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:18:46.532432    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad66a5b3_cfc5_4284_9519_d85963e011fa.slice/crio-62c1537889bac0589189ae61f343e0e4c28169ee4b3b5caee3da9539f5c61ee7 WatchSource:0}: Error finding container 62c1537889bac0589189ae61f343e0e4c28169ee4b3b5caee3da9539f5c61ee7: Status 404 returned error can't find the container with id 62c1537889bac0589189ae61f343e0e4c28169ee4b3b5caee3da9539f5c61ee7
Sep 06 12:18:46.799208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.798819    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:46.802357 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:46.802089    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:47.061892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.061814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq" event={"ID":"c79ce967-390b-405f-99c6-f3b8ab2e65d5","Type":"ContainerStarted","Data":"9c1847754579e40c7cc6b6be7d77cd377e4e3c3525259a8d3cae19ad4ee1a0d8"}
Sep 06 12:18:47.063973 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.063904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt" event={"ID":"b5cef610-92ac-43c7-a3c8-663c775745b1","Type":"ContainerStarted","Data":"6a53d5e9e2686f33fffddf8acfcda7235033648c9189fd015b417de5f5986547"}
Sep 06 12:18:47.065810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.065752    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-7jgf5" event={"ID":"ad66a5b3-cfc5-4284-9519-d85963e011fa","Type":"ContainerStarted","Data":"62c1537889bac0589189ae61f343e0e4c28169ee4b3b5caee3da9539f5c61ee7"}
Sep 06 12:18:47.070185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.070161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffnwb" event={"ID":"cbef0fcf-3628-4500-bb73-3af52c312c80","Type":"ContainerStarted","Data":"5f2a227fa5b801dd2923bcf648a5534143ea5ebc0f64338e76d5b44808dd2e94"}
Sep 06 12:18:47.070691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.070671    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:47.071436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.071418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ffnwb" event={"ID":"cbef0fcf-3628-4500-bb73-3af52c312c80","Type":"ContainerStarted","Data":"57d522133fefd7a42810fc5ed949750f51b87c520e45ce5349cc366b346fa82a"}
Sep 06 12:18:47.073176 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.072789    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-54f9f9784-n5ntv"
Sep 06 12:18:47.089229 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:47.089183    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ffnwb" podStartSLOduration=66.673887259 podStartE2EDuration="1m8.089165201s" totalImagesPullingTime="1.415277942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:47.087193305 +0000 UTC m=+68.900617384" watchObservedRunningTime="2026-09-06 12:18:47.089165201 +0000 UTC m=+68.902589477"
Sep 06 12:18:55.112692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:55.111893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p" event={"ID":"8d227759-ce05-4cde-9fc3-e5553262c45a","Type":"ContainerStarted","Data":"019bac67397798a1990a9724c2680379d25b0ae12f28b17f16d49cadd6b445d9"}
Sep 06 12:18:55.132277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:55.132224    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6cdcc96965-hth6p" podStartSLOduration=58.951486697 podStartE2EDuration="1m8.132200731s" totalImagesPullingTime="9.180714034s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:55.127990952 +0000 UTC m=+76.941415045" watchObservedRunningTime="2026-09-06 12:18:55.132200731 +0000 UTC m=+76.945624811"
Sep 06 12:18:56.127836 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.127789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz" event={"ID":"d8442971-80e2-4e7b-8dbc-34fa53089526","Type":"ContainerStarted","Data":"1c731c36b97ddec8fa99ca70d8cebdc0798f597e3601c1ef4b0577961d09807f"}
Sep 06 12:18:56.128312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.127869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz" event={"ID":"d8442971-80e2-4e7b-8dbc-34fa53089526","Type":"ContainerStarted","Data":"90f012c7b9f6e1de26386b3640d19597c23abb2058161553a60dbc62890f27ae"}
Sep 06 12:18:56.129936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.129902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq" event={"ID":"c79ce967-390b-405f-99c6-f3b8ab2e65d5","Type":"ContainerStarted","Data":"c087138ab3301ca97218e2310f9f465b36db8243ca41cdbe340c7459dbafdc38"}
Sep 06 12:18:56.131760 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.131732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt" event={"ID":"b5cef610-92ac-43c7-a3c8-663c775745b1","Type":"ContainerStarted","Data":"9a19389a7bb5182c975c56c44c7f4d3ad026d7a32c7162f7d93e7a44fbc264d6"}
Sep 06 12:18:56.131872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.131782    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:56.133841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.133810    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-547dz" event={"ID":"511dbd99-611b-4839-8f80-84edaf706c81","Type":"ContainerStarted","Data":"09c6abb304bc5e65b7de91a86d9d81e82613b74ee194614a71a4f7b2a927acf0"}
Sep 06 12:18:56.134205 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.134183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt"
Sep 06 12:18:56.135853 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.135832    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jldb" event={"ID":"16da98dc-bc62-48e9-80d0-b2916ee630a3","Type":"ContainerStarted","Data":"d08e151b1e07579986aa864f78d29d7208485a28bb5e66d296f2ccba91bc3479"}
Sep 06 12:18:56.135951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.135875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7jldb" event={"ID":"16da98dc-bc62-48e9-80d0-b2916ee630a3","Type":"ContainerStarted","Data":"b57e1e272e5c6d73b3bbbcd6856b76b09a3bda89875d735c46b3b507d074d879"}
Sep 06 12:18:56.144324 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.144275    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-7cdcfcf76c-vrvrz" podStartSLOduration=59.47264932 podStartE2EDuration="1m9.144256913s" totalImagesPullingTime="9.671607593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:17:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:56.142060449 +0000 UTC m=+77.955484533" watchObservedRunningTime="2026-09-06 12:18:56.144256913 +0000 UTC m=+77.957680992"
Sep 06 12:18:56.160959 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.160899    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-547dz" podStartSLOduration=67.450107906 podStartE2EDuration="1m17.160888378s" totalImagesPullingTime="9.710780472s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:17:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:56.160063369 +0000 UTC m=+77.973487449" watchObservedRunningTime="2026-09-06 12:18:56.160888378 +0000 UTC m=+77.974312458"
Sep 06 12:18:56.174810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.174752    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6bc65fcbdb-jpmrt" podStartSLOduration=2.295233121 podStartE2EDuration="11.174737757s" totalImagesPullingTime="8.879504636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:56.174037912 +0000 UTC m=+77.987461994" watchObservedRunningTime="2026-09-06 12:18:56.174737757 +0000 UTC m=+77.988161837"
Sep 06 12:18:56.187809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.187765    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-79977f9844-pbdnq" podStartSLOduration=34.827875238 podStartE2EDuration="43.187749429s" totalImagesPullingTime="8.359874191s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:56.186764446 +0000 UTC m=+78.000188526" watchObservedRunningTime="2026-09-06 12:18:56.187749429 +0000 UTC m=+78.001173548"
Sep 06 12:18:56.205399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:56.205357    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7jldb" podStartSLOduration=34.552039079 podStartE2EDuration="44.205342906s" totalImagesPullingTime="9.653303827s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:18:56.20463871 +0000 UTC m=+78.018062794" watchObservedRunningTime="2026-09-06 12:18:56.205342906 +0000 UTC m=+78.018767000"
Sep 06 12:18:57.140891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:18:57.140836    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7jldb"
Sep 06 12:19:04.722860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:04.722827    2578 patch_prober.go:28] interesting pod/image-registry-697558986f-9t9ps container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 06 12:19:04.723256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:04.722886    2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-697558986f-9t9ps" podUID="86c7dded-6875-4ec7-a88b-4048d7b098d9" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 12:19:05.177091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.176967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-7jgf5" event={"ID":"ad66a5b3-cfc5-4284-9519-d85963e011fa","Type":"ContainerStarted","Data":"1a5fc2b0bb41f5518bd06ef9ca5d13a3e2dd27034097221ecc5caf0bae83dac1"}
Sep 06 12:19:05.177408 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.177382    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:19:05.194869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.194818    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-7jgf5" podStartSLOduration=2.298652965 podStartE2EDuration="20.194802878s" totalImagesPullingTime="17.896149913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:19:05.193847689 +0000 UTC m=+87.007271769" watchObservedRunningTime="2026-09-06 12:19:05.194802878 +0000 UTC m=+87.008226956"
Sep 06 12:19:05.198531 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.198511    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-7jgf5"
Sep 06 12:19:05.959108 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.959071    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ptfgs"]
Sep 06 12:19:05.988657 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.988628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:05.991649 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.991502    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 06 12:19:05.991649 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.991506    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-pmdxk\""
Sep 06 12:19:05.991649 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.991558    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 06 12:19:05.991906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.991654    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 06 12:19:05.992530 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:05.992507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 06 12:19:06.052585 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-245nz\" (UniqueName: \"kubernetes.io/projected/83d51f69-5c7a-45b3-9353-445e14b5a614-kube-api-access-245nz\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052764 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052613    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-wtmp\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052764 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-sys\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052764 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052764 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-root\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-textfile\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-tls\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d51f69-5c7a-45b3-9353-445e14b5a614-metrics-client-ca\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.052946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.052851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.154661 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154568    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-245nz\" (UniqueName: \"kubernetes.io/projected/83d51f69-5c7a-45b3-9353-445e14b5a614-kube-api-access-245nz\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.154843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-wtmp\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.154843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-sys\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.154843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.154843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-root\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.155055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-textfile\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.155055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-tls\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.155055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.154963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d51f69-5c7a-45b3-9353-445e14b5a614-metrics-client-ca\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.155055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.155016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.155291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.155071    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-wtmp\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.159172 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.155487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-sys\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.159172 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.155509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-textfile\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.159172 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:19:06.155569    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 06 12:19:06.159172 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:19:06.155645    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-tls podName:83d51f69-5c7a-45b3-9353-445e14b5a614 nodeName:}" failed. No retries permitted until 2026-09-06 12:19:06.655627439 +0000 UTC m=+88.469051499 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-tls") pod "node-exporter-ptfgs" (UID: "83d51f69-5c7a-45b3-9353-445e14b5a614") : secret "node-exporter-tls" not found
Sep 06 12:19:06.159172 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.155688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-accelerators-collector-config\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.160025 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.159997    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83d51f69-5c7a-45b3-9353-445e14b5a614-root\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.162704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.162065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83d51f69-5c7a-45b3-9353-445e14b5a614-metrics-client-ca\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.162704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.162302    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.165087 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.165045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-245nz\" (UniqueName: \"kubernetes.io/projected/83d51f69-5c7a-45b3-9353-445e14b5a614-kube-api-access-245nz\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.665120 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.665088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-tls\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.668284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.668248    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83d51f69-5c7a-45b3-9353-445e14b5a614-node-exporter-tls\") pod \"node-exporter-ptfgs\" (UID: \"83d51f69-5c7a-45b3-9353-445e14b5a614\") " pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.900852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:06.900823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ptfgs"
Sep 06 12:19:06.934419 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:19:06.934380    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d51f69_5c7a_45b3_9353_445e14b5a614.slice/crio-1f899d8e1b6898c4100df1307a7a712dc7cfe5aa321093b1711270e90984fb33 WatchSource:0}: Error finding container 1f899d8e1b6898c4100df1307a7a712dc7cfe5aa321093b1711270e90984fb33: Status 404 returned error can't find the container with id 1f899d8e1b6898c4100df1307a7a712dc7cfe5aa321093b1711270e90984fb33
Sep 06 12:19:07.076235 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:07.076205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:19:07.148340 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:07.148305    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7jldb"
Sep 06 12:19:07.189361 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:07.189265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfgs" event={"ID":"83d51f69-5c7a-45b3-9353-445e14b5a614","Type":"ContainerStarted","Data":"1f899d8e1b6898c4100df1307a7a712dc7cfe5aa321093b1711270e90984fb33"}
Sep 06 12:19:07.833141 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:07.833107    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-697558986f-9t9ps"]
Sep 06 12:19:09.199804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:09.199767    2578 generic.go:356] "Generic (PLEG): container finished" podID="83d51f69-5c7a-45b3-9353-445e14b5a614" containerID="d78d44bd993d67107939a57438d8aaadc7494d1f060896f890628702605cf534" exitCode=0
Sep 06 12:19:09.200260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:09.199858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfgs" event={"ID":"83d51f69-5c7a-45b3-9353-445e14b5a614","Type":"ContainerDied","Data":"d78d44bd993d67107939a57438d8aaadc7494d1f060896f890628702605cf534"}
Sep 06 12:19:10.206908 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:10.206868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfgs" event={"ID":"83d51f69-5c7a-45b3-9353-445e14b5a614","Type":"ContainerStarted","Data":"96a5cb0f6ab18d66adf6001e01aa856ac67faa903a2096a5e513d7afa5b8b014"}
Sep 06 12:19:10.207363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:10.206939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ptfgs" event={"ID":"83d51f69-5c7a-45b3-9353-445e14b5a614","Type":"ContainerStarted","Data":"a4cd8c4b15cb277e8b8b553e916a81029d75cf77bf6e599d99c055963573b827"}
Sep 06 12:19:10.227303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:10.227257    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ptfgs" podStartSLOduration=3.538605825 podStartE2EDuration="5.227241836s" totalImagesPullingTime="1.603106464s" totalInitContainerRuntime="85.529547ms" isStatefulPod=true podCreationTimestamp="2026-09-06 12:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:19:10.225210308 +0000 UTC m=+92.038634388" watchObservedRunningTime="2026-09-06 12:19:10.227241836 +0000 UTC m=+92.040665964"
Sep 06 12:19:18.080955 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:18.080918    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-56gx2"
Sep 06 12:19:27.273942 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:27.273910    2578 generic.go:356] "Generic (PLEG): container finished" podID="ad05982d-9af8-4198-8ea4-31c9d329fd58" containerID="4049b02dd5d9da42ce612f0c99a8aa66a03006fe21d6e12ae5f9de0f79fd7e27" exitCode=0
Sep 06 12:19:27.274305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:27.273980    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb" event={"ID":"ad05982d-9af8-4198-8ea4-31c9d329fd58","Type":"ContainerDied","Data":"4049b02dd5d9da42ce612f0c99a8aa66a03006fe21d6e12ae5f9de0f79fd7e27"}
Sep 06 12:19:27.274346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:27.274318    2578 scope.go:117] "RemoveContainer" containerID="4049b02dd5d9da42ce612f0c99a8aa66a03006fe21d6e12ae5f9de0f79fd7e27"
Sep 06 12:19:28.280798 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:28.280766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-859f94c4b-kxsnb" event={"ID":"ad05982d-9af8-4198-8ea4-31c9d329fd58","Type":"ContainerStarted","Data":"395b83e7490fbab18c6bf351d2c3dd349c9c5edb88931b2537d2c8d93a7f2252"}
Sep 06 12:19:32.858702 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:32.858649    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-697558986f-9t9ps" podUID="86c7dded-6875-4ec7-a88b-4048d7b098d9" containerName="registry" containerID="cri-o://9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99" gracePeriod=30
Sep 06 12:19:33.132504 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.132451    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:19:33.266683 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266655    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-trusted-ca\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.266823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-image-registry-private-configuration\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.266823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86c7dded-6875-4ec7-a88b-4048d7b098d9-ca-trust-extracted\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.266823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.266823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br9lt\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-kube-api-access-br9lt\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.266823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-installation-pull-secrets\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.267064 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266829    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-bound-sa-token\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.267064 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.266868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-certificates\") pod \"86c7dded-6875-4ec7-a88b-4048d7b098d9\" (UID: \"86c7dded-6875-4ec7-a88b-4048d7b098d9\") "
Sep 06 12:19:33.267199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.267138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:19:33.267424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.267391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:19:33.269402 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.269376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:19:33.269509 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.269420    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:19:33.269568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.269507    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:19:33.269706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.269685    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:19:33.269763 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.269716    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-kube-api-access-br9lt" (OuterVolumeSpecName: "kube-api-access-br9lt") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "kube-api-access-br9lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:19:33.275873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.275844    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86c7dded-6875-4ec7-a88b-4048d7b098d9-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "86c7dded-6875-4ec7-a88b-4048d7b098d9" (UID: "86c7dded-6875-4ec7-a88b-4048d7b098d9"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:19:33.300018 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.299994    2578 generic.go:356] "Generic (PLEG): container finished" podID="86c7dded-6875-4ec7-a88b-4048d7b098d9" containerID="9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99" exitCode=0
Sep 06 12:19:33.300099 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.300043    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-697558986f-9t9ps"
Sep 06 12:19:33.300099 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.300080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697558986f-9t9ps" event={"ID":"86c7dded-6875-4ec7-a88b-4048d7b098d9","Type":"ContainerDied","Data":"9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99"}
Sep 06 12:19:33.300209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.300134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-697558986f-9t9ps" event={"ID":"86c7dded-6875-4ec7-a88b-4048d7b098d9","Type":"ContainerDied","Data":"b6207c1348a8e30f770d713281d4a06440e38aceb38686511ab9fce07359a03d"}
Sep 06 12:19:33.300209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.300176    2578 scope.go:117] "RemoveContainer" containerID="9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99"
Sep 06 12:19:33.301781 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.301762    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ee9628f-34d8-4f2a-8914-cde72e918b82" containerID="022a3bd7325151e29b1d3b3ea8fe656a939afcfd1200bb26c0ba9fed76ba8a50" exitCode=0
Sep 06 12:19:33.301895 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.301795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs" event={"ID":"1ee9628f-34d8-4f2a-8914-cde72e918b82","Type":"ContainerDied","Data":"022a3bd7325151e29b1d3b3ea8fe656a939afcfd1200bb26c0ba9fed76ba8a50"}
Sep 06 12:19:33.302053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.302039    2578 scope.go:117] "RemoveContainer" containerID="022a3bd7325151e29b1d3b3ea8fe656a939afcfd1200bb26c0ba9fed76ba8a50"
Sep 06 12:19:33.308958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.308370    2578 scope.go:117] "RemoveContainer" containerID="9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99"
Sep 06 12:19:33.309389 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:19:33.309347    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99\": container with ID starting with 9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99 not found: ID does not exist" containerID="9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99"
Sep 06 12:19:33.309481 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.309383    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99"} err="failed to get container status \"9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99\": rpc error: code = NotFound desc = could not find container \"9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99\": container with ID starting with 9aa43a510a562cac6d3aa85e0cc1ec775726707e5144e2878a11d56c42ed7d99 not found: ID does not exist"
Sep 06 12:19:33.335177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.335142    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-697558986f-9t9ps"]
Sep 06 12:19:33.342210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.342188    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-697558986f-9t9ps"]
Sep 06 12:19:33.368491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368469    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368495    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br9lt\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-kube-api-access-br9lt\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368511    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-installation-pull-secrets\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368525    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/86c7dded-6875-4ec7-a88b-4048d7b098d9-bound-sa-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368540    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-registry-certificates\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368552    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86c7dded-6875-4ec7-a88b-4048d7b098d9-trusted-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368567    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/86c7dded-6875-4ec7-a88b-4048d7b098d9-image-registry-private-configuration\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:33.368589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:33.368580    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/86c7dded-6875-4ec7-a88b-4048d7b098d9-ca-trust-extracted\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:19:34.308657 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:34.308615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-8d7dd4675-zlrrs" event={"ID":"1ee9628f-34d8-4f2a-8914-cde72e918b82","Type":"ContainerStarted","Data":"c5b1fb6e4a86165b2b60fb73b518d017f0aab9610647a9dde99212e020bdb97c"}
Sep 06 12:19:34.666441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:34.666367    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86c7dded-6875-4ec7-a88b-4048d7b098d9" path="/var/lib/kubelet/pods/86c7dded-6875-4ec7-a88b-4048d7b098d9/volumes"
Sep 06 12:19:48.361358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:48.361321    2578 generic.go:356] "Generic (PLEG): container finished" podID="7822caa6-5117-4f1f-bb80-94a1dcf4213e" containerID="0660bb2013e750b9a2ff6284a9c5184bce2f0c8a94d0c88247cd82f85edbf183" exitCode=0
Sep 06 12:19:48.361760 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:48.361401    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2" event={"ID":"7822caa6-5117-4f1f-bb80-94a1dcf4213e","Type":"ContainerDied","Data":"0660bb2013e750b9a2ff6284a9c5184bce2f0c8a94d0c88247cd82f85edbf183"}
Sep 06 12:19:48.361760 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:48.361722    2578 scope.go:117] "RemoveContainer" containerID="0660bb2013e750b9a2ff6284a9c5184bce2f0c8a94d0c88247cd82f85edbf183"
Sep 06 12:19:49.367987 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:19:49.367957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-5shz2" event={"ID":"7822caa6-5117-4f1f-bb80-94a1dcf4213e","Type":"ContainerStarted","Data":"28a079e763eb026cf020c2c9127fe6a1f6953581972a6d45d5a902dee6c56fde"}
Sep 06 12:20:30.163574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.163541    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"]
Sep 06 12:20:30.164095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.163954    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c7dded-6875-4ec7-a88b-4048d7b098d9" containerName="registry"
Sep 06 12:20:30.164095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.163971    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c7dded-6875-4ec7-a88b-4048d7b098d9" containerName="registry"
Sep 06 12:20:30.164095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.164023    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c7dded-6875-4ec7-a88b-4048d7b098d9" containerName="registry"
Sep 06 12:20:30.166954 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.166938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.169445 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.169414    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ggnj9\""
Sep 06 12:20:30.169565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.169454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Sep 06 12:20:30.169565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.169518    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Sep 06 12:20:30.169565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.169537    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Sep 06 12:20:30.169565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.169520    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Sep 06 12:20:30.169787 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.169772    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Sep 06 12:20:30.174556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.174534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Sep 06 12:20:30.183964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.183942    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"]
Sep 06 12:20:30.254991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.254961    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-telemeter-client-tls\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-metrics-client-ca\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-secret-telemeter-client\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-federate-client-tls\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-psrf8\" (UniqueName: \"kubernetes.io/projected/e4c85c82-d505-4810-b91e-96693f5258b7-kube-api-access-psrf8\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.255438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.255329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-serving-certs-ca-bundle\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.355945 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.355922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-secret-telemeter-client\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356028 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.355947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-federate-client-tls\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356028 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.355967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356028 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.355984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-psrf8\" (UniqueName: \"kubernetes.io/projected/e4c85c82-d505-4810-b91e-96693f5258b7-kube-api-access-psrf8\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356028 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.356008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.356073    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-serving-certs-ca-bundle\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.356124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-telemeter-client-tls\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.356198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-metrics-client-ca\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.356937 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.356907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-serving-certs-ca-bundle\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.357049 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.356936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-metrics-client-ca\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.357187 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.357170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e4c85c82-d505-4810-b91e-96693f5258b7-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.358664 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.358640    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-federate-client-tls\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.358974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.358952    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.359016 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.358975    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-telemeter-client-tls\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.359110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.359096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/e4c85c82-d505-4810-b91e-96693f5258b7-secret-telemeter-client\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.363118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.363101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-psrf8\" (UniqueName: \"kubernetes.io/projected/e4c85c82-d505-4810-b91e-96693f5258b7-kube-api-access-psrf8\") pod \"telemeter-client-5c7bdc8557-z62cv\" (UID: \"e4c85c82-d505-4810-b91e-96693f5258b7\") " pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.478202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.478176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"
Sep 06 12:20:30.752222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:30.752189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5c7bdc8557-z62cv"]
Sep 06 12:20:30.754846 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:20:30.754820    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4c85c82_d505_4810_b91e_96693f5258b7.slice/crio-780218d5d894975fc44ca5773015644e991808fb2ba33f766b879b5126947691 WatchSource:0}: Error finding container 780218d5d894975fc44ca5773015644e991808fb2ba33f766b879b5126947691: Status 404 returned error can't find the container with id 780218d5d894975fc44ca5773015644e991808fb2ba33f766b879b5126947691
Sep 06 12:20:31.526322 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:31.526282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv" event={"ID":"e4c85c82-d505-4810-b91e-96693f5258b7","Type":"ContainerStarted","Data":"780218d5d894975fc44ca5773015644e991808fb2ba33f766b879b5126947691"}
Sep 06 12:20:32.531695 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:32.531668    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv" event={"ID":"e4c85c82-d505-4810-b91e-96693f5258b7","Type":"ContainerStarted","Data":"b586ceed84dea655ee16c800782b101f785b32c0ca72d5769f6f5c8ca991e8bb"}
Sep 06 12:20:34.540559 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:34.540523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv" event={"ID":"e4c85c82-d505-4810-b91e-96693f5258b7","Type":"ContainerStarted","Data":"844796e5028c63ed4bea62b0e8c98e929029970f7bc311961699ddde0e9759b1"}
Sep 06 12:20:34.540925 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:34.540582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv" event={"ID":"e4c85c82-d505-4810-b91e-96693f5258b7","Type":"ContainerStarted","Data":"f4c565ceb34514b1bc0d18e29546e2106b9be1bfffd3045a45f3cb25eb06036d"}
Sep 06 12:20:34.561208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:20:34.561128    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5c7bdc8557-z62cv" podStartSLOduration=1.80487855 podStartE2EDuration="4.561108095s" totalImagesPullingTime="2.756229545s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:20:30 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:20:34.559301051 +0000 UTC m=+176.372725130" watchObservedRunningTime="2026-09-06 12:20:34.561108095 +0000 UTC m=+176.374532175"
Sep 06 12:21:38.458692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.458659    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"]
Sep 06 12:21:38.462071 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.462054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.464674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.464648    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 12:21:38.464801 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.464710    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 12:21:38.465808 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.465790    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88lvk\""
Sep 06 12:21:38.469311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.469291    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"]
Sep 06 12:21:38.513555 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.513524    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.513668 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.513585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.513668 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.513630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9phrj\" (UniqueName: \"kubernetes.io/projected/72ee5bfb-647f-4611-890c-8a398a7b94b3-kube-api-access-9phrj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.614324 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.614296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9phrj\" (UniqueName: \"kubernetes.io/projected/72ee5bfb-647f-4611-890c-8a398a7b94b3-kube-api-access-9phrj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.614447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.614355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.614447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.614419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.614733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.614711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.614828 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.614768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.622316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.622297    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 12:21:38.632989 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.632972    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 12:21:38.643420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.643399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9phrj\" (UniqueName: \"kubernetes.io/projected/72ee5bfb-647f-4611-890c-8a398a7b94b3-kube-api-access-9phrj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:38.774011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.773964    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88lvk\""
Sep 06 12:21:38.781653 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:38.781636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:39.049770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:39.049702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"]
Sep 06 12:21:39.053181 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:21:39.053116    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72ee5bfb_647f_4611_890c_8a398a7b94b3.slice/crio-e63ed186f009b14cc211f13ca9658f0ba2ca47d8f4dab79ab2da01b7ad967c05 WatchSource:0}: Error finding container e63ed186f009b14cc211f13ca9658f0ba2ca47d8f4dab79ab2da01b7ad967c05: Status 404 returned error can't find the container with id e63ed186f009b14cc211f13ca9658f0ba2ca47d8f4dab79ab2da01b7ad967c05
Sep 06 12:21:39.781862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:39.781818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk" event={"ID":"72ee5bfb-647f-4611-890c-8a398a7b94b3","Type":"ContainerStarted","Data":"e63ed186f009b14cc211f13ca9658f0ba2ca47d8f4dab79ab2da01b7ad967c05"}
Sep 06 12:21:45.808428 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:45.808398    2578 generic.go:356] "Generic (PLEG): container finished" podID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerID="b08c804898702cbb2cc6fcfc29707eb796001b2dade76e48e748c35d3c96a8ef" exitCode=0
Sep 06 12:21:45.808809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:45.808439    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk" event={"ID":"72ee5bfb-647f-4611-890c-8a398a7b94b3","Type":"ContainerDied","Data":"b08c804898702cbb2cc6fcfc29707eb796001b2dade76e48e748c35d3c96a8ef"}
Sep 06 12:21:48.822198 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:48.822163    2578 generic.go:356] "Generic (PLEG): container finished" podID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerID="d9cb55b125dd78bf9eb9a9b69e323bb43a94a6758f3797f24990f95a4f78b033" exitCode=0
Sep 06 12:21:48.822635 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:48.822243    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk" event={"ID":"72ee5bfb-647f-4611-890c-8a398a7b94b3","Type":"ContainerDied","Data":"d9cb55b125dd78bf9eb9a9b69e323bb43a94a6758f3797f24990f95a4f78b033"}
Sep 06 12:21:55.860294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:55.860253    2578 generic.go:356] "Generic (PLEG): container finished" podID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerID="aefca1bd88495060c452187214092834bdbb5a3cba34382abefa132120f6e607" exitCode=0
Sep 06 12:21:55.860644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:55.860334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk" event={"ID":"72ee5bfb-647f-4611-890c-8a398a7b94b3","Type":"ContainerDied","Data":"aefca1bd88495060c452187214092834bdbb5a3cba34382abefa132120f6e607"}
Sep 06 12:21:56.983710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:56.983686    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:57.157663 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.157590    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-bundle\") pod \"72ee5bfb-647f-4611-890c-8a398a7b94b3\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") "
Sep 06 12:21:57.157785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.157672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-util\") pod \"72ee5bfb-647f-4611-890c-8a398a7b94b3\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") "
Sep 06 12:21:57.157785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.157710    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9phrj\" (UniqueName: \"kubernetes.io/projected/72ee5bfb-647f-4611-890c-8a398a7b94b3-kube-api-access-9phrj\") pod \"72ee5bfb-647f-4611-890c-8a398a7b94b3\" (UID: \"72ee5bfb-647f-4611-890c-8a398a7b94b3\") "
Sep 06 12:21:57.158236 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.158208    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-bundle" (OuterVolumeSpecName: "bundle") pod "72ee5bfb-647f-4611-890c-8a398a7b94b3" (UID: "72ee5bfb-647f-4611-890c-8a398a7b94b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:21:57.159836 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.159811    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72ee5bfb-647f-4611-890c-8a398a7b94b3-kube-api-access-9phrj" (OuterVolumeSpecName: "kube-api-access-9phrj") pod "72ee5bfb-647f-4611-890c-8a398a7b94b3" (UID: "72ee5bfb-647f-4611-890c-8a398a7b94b3"). InnerVolumeSpecName "kube-api-access-9phrj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:21:57.162143 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.162117    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-util" (OuterVolumeSpecName: "util") pod "72ee5bfb-647f-4611-890c-8a398a7b94b3" (UID: "72ee5bfb-647f-4611-890c-8a398a7b94b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:21:57.258779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.258754    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9phrj\" (UniqueName: \"kubernetes.io/projected/72ee5bfb-647f-4611-890c-8a398a7b94b3-kube-api-access-9phrj\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:21:57.258779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.258779    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-bundle\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:21:57.258907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.258788    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72ee5bfb-647f-4611-890c-8a398a7b94b3-util\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:21:57.871118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.871092    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk"
Sep 06 12:21:57.871275 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.871092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540vz9pk" event={"ID":"72ee5bfb-647f-4611-890c-8a398a7b94b3","Type":"ContainerDied","Data":"e63ed186f009b14cc211f13ca9658f0ba2ca47d8f4dab79ab2da01b7ad967c05"}
Sep 06 12:21:57.871275 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:21:57.871194    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e63ed186f009b14cc211f13ca9658f0ba2ca47d8f4dab79ab2da01b7ad967c05"
Sep 06 12:22:01.187739 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187661    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"]
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187928    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="pull"
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187940    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="pull"
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187953    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="util"
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187959    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="util"
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187971    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="extract"
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.187976    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="extract"
Sep 06 12:22:01.188084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.188038    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="72ee5bfb-647f-4611-890c-8a398a7b94b3" containerName="extract"
Sep 06 12:22:01.199597 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.199579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.203471 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.203448    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 06 12:22:01.204290 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.204267    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-znl5p\""
Sep 06 12:22:01.204370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.204315    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 06 12:22:01.209613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.209592    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"]
Sep 06 12:22:01.286644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.286618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0cbf-386d-4c4f-aba3-f4297ba2126a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z8zc\" (UID: \"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.286740 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.286671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4n2l\" (UniqueName: \"kubernetes.io/projected/3d4d0cbf-386d-4c4f-aba3-f4297ba2126a-kube-api-access-l4n2l\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z8zc\" (UID: \"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.387424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.387398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4n2l\" (UniqueName: \"kubernetes.io/projected/3d4d0cbf-386d-4c4f-aba3-f4297ba2126a-kube-api-access-l4n2l\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z8zc\" (UID: \"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.387525 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.387446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0cbf-386d-4c4f-aba3-f4297ba2126a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z8zc\" (UID: \"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.387792 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.387777    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3d4d0cbf-386d-4c4f-aba3-f4297ba2126a-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z8zc\" (UID: \"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.394942 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.394924    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4n2l\" (UniqueName: \"kubernetes.io/projected/3d4d0cbf-386d-4c4f-aba3-f4297ba2126a-kube-api-access-l4n2l\") pod \"cert-manager-operator-controller-manager-55c444bf86-4z8zc\" (UID: \"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.509261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.509207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"
Sep 06 12:22:01.801917 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.801893    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc"]
Sep 06 12:22:01.804680 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:22:01.804652    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d4d0cbf_386d_4c4f_aba3_f4297ba2126a.slice/crio-ca382e218c8f80b8c5dd8f926260ba0e5db51c531d0fc41c48815223a1b4f498 WatchSource:0}: Error finding container ca382e218c8f80b8c5dd8f926260ba0e5db51c531d0fc41c48815223a1b4f498: Status 404 returned error can't find the container with id ca382e218c8f80b8c5dd8f926260ba0e5db51c531d0fc41c48815223a1b4f498
Sep 06 12:22:01.886159 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:01.886123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc" event={"ID":"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a","Type":"ContainerStarted","Data":"ca382e218c8f80b8c5dd8f926260ba0e5db51c531d0fc41c48815223a1b4f498"}
Sep 06 12:22:07.912650 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:07.912607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc" event={"ID":"3d4d0cbf-386d-4c4f-aba3-f4297ba2126a","Type":"ContainerStarted","Data":"e58d570cb64b378705fc5d71f013c328de5e177fa2b44102aa65fe1ebf4f08f0"}
Sep 06 12:22:07.939009 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:07.938961    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4z8zc" podStartSLOduration=1.589150283 podStartE2EDuration="6.93894677s" totalImagesPullingTime="5.349796487s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:22:07.937144174 +0000 UTC m=+269.750568254" watchObservedRunningTime="2026-09-06 12:22:07.93894677 +0000 UTC m=+269.752370848"
Sep 06 12:22:08.918083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:08.918052    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xx5cz"]
Sep 06 12:22:08.920983 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:08.920961    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:08.923478 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:08.923461    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 06 12:22:08.924447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:08.924432    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-7p5cv\""
Sep 06 12:22:08.924518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:08.924432    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 06 12:22:08.930972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:08.930953    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xx5cz"]
Sep 06 12:22:09.044267 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.044246    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/333afeec-1339-4c9c-8e60-19d552c22f95-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xx5cz\" (UID: \"333afeec-1339-4c9c-8e60-19d552c22f95\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.044372 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.044281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6ksw\" (UniqueName: \"kubernetes.io/projected/333afeec-1339-4c9c-8e60-19d552c22f95-kube-api-access-p6ksw\") pod \"cert-manager-webhook-6486ffd997-xx5cz\" (UID: \"333afeec-1339-4c9c-8e60-19d552c22f95\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.145085 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.145059    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/333afeec-1339-4c9c-8e60-19d552c22f95-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xx5cz\" (UID: \"333afeec-1339-4c9c-8e60-19d552c22f95\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.145213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.145092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6ksw\" (UniqueName: \"kubernetes.io/projected/333afeec-1339-4c9c-8e60-19d552c22f95-kube-api-access-p6ksw\") pod \"cert-manager-webhook-6486ffd997-xx5cz\" (UID: \"333afeec-1339-4c9c-8e60-19d552c22f95\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.173785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.173727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/333afeec-1339-4c9c-8e60-19d552c22f95-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-xx5cz\" (UID: \"333afeec-1339-4c9c-8e60-19d552c22f95\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.173905 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.173886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6ksw\" (UniqueName: \"kubernetes.io/projected/333afeec-1339-4c9c-8e60-19d552c22f95-kube-api-access-p6ksw\") pod \"cert-manager-webhook-6486ffd997-xx5cz\" (UID: \"333afeec-1339-4c9c-8e60-19d552c22f95\") " pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.248831 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.248807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:09.518621 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.518449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-xx5cz"]
Sep 06 12:22:09.520576 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:22:09.520546    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod333afeec_1339_4c9c_8e60_19d552c22f95.slice/crio-72eed1e0266968e460f2d1ec39a8288aaa0c1383633f27e49d85c25aa18e7823 WatchSource:0}: Error finding container 72eed1e0266968e460f2d1ec39a8288aaa0c1383633f27e49d85c25aa18e7823: Status 404 returned error can't find the container with id 72eed1e0266968e460f2d1ec39a8288aaa0c1383633f27e49d85c25aa18e7823
Sep 06 12:22:09.921897 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:09.921820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz" event={"ID":"333afeec-1339-4c9c-8e60-19d552c22f95","Type":"ContainerStarted","Data":"72eed1e0266968e460f2d1ec39a8288aaa0c1383633f27e49d85c25aa18e7823"}
Sep 06 12:22:12.934493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:12.934457    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz" event={"ID":"333afeec-1339-4c9c-8e60-19d552c22f95","Type":"ContainerStarted","Data":"944f63b086d896c94f5f8352c34c6e729fdd1200d41e72094b03dbfcc8da1b83"}
Sep 06 12:22:12.934866 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:12.934528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:12.951895 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:12.951850    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz" podStartSLOduration=2.202550137 podStartE2EDuration="4.95183694s" totalImagesPullingTime="2.749286803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:22:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:22:12.950438645 +0000 UTC m=+274.763862723" watchObservedRunningTime="2026-09-06 12:22:12.95183694 +0000 UTC m=+274.765261018"
Sep 06 12:22:18.940783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:18.940752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-xx5cz"
Sep 06 12:22:38.609122 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.609086    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:22:38.613799 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.613770    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:22:38.620202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.620179    2578 kubelet.go:1648] "Image garbage collection succeeded"
Sep 06 12:22:38.897404 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.897336    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"]
Sep 06 12:22:38.905440 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.905415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:38.907469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.907446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"]
Sep 06 12:22:38.907774 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.907751    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 12:22:38.907905 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.907754    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88lvk\""
Sep 06 12:22:38.908785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.908768    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 12:22:38.945030 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.945007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6g5v7\" (UniqueName: \"kubernetes.io/projected/74bf1dab-90b2-4b30-9e1b-82b3c091db97-kube-api-access-6g5v7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:38.945118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.945038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:38.945118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:38.945109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.045385 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.045361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.045476 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.045416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.045476 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.045460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6g5v7\" (UniqueName: \"kubernetes.io/projected/74bf1dab-90b2-4b30-9e1b-82b3c091db97-kube-api-access-6g5v7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.045790 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.045772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.045832 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.045776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.052967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.052946    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6g5v7\" (UniqueName: \"kubernetes.io/projected/74bf1dab-90b2-4b30-9e1b-82b3c091db97-kube-api-access-6g5v7\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.216273 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.216254    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:39.485919 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:39.485894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"]
Sep 06 12:22:39.487787 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:22:39.487762    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bf1dab_90b2_4b30_9e1b_82b3c091db97.slice/crio-298265ef7d290d79b3b0c34a3dbe4d6332d05d44dffcd48fde20b7f5dbc38f4c WatchSource:0}: Error finding container 298265ef7d290d79b3b0c34a3dbe4d6332d05d44dffcd48fde20b7f5dbc38f4c: Status 404 returned error can't find the container with id 298265ef7d290d79b3b0c34a3dbe4d6332d05d44dffcd48fde20b7f5dbc38f4c
Sep 06 12:22:40.047672 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:40.047628    2578 generic.go:356] "Generic (PLEG): container finished" podID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerID="fde81536c834c0ca5707025215b8b984f17d27dc8086c1ca98e6ca84d3c63447" exitCode=0
Sep 06 12:22:40.048092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:40.047718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w" event={"ID":"74bf1dab-90b2-4b30-9e1b-82b3c091db97","Type":"ContainerDied","Data":"fde81536c834c0ca5707025215b8b984f17d27dc8086c1ca98e6ca84d3c63447"}
Sep 06 12:22:40.048092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:40.047768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w" event={"ID":"74bf1dab-90b2-4b30-9e1b-82b3c091db97","Type":"ContainerStarted","Data":"298265ef7d290d79b3b0c34a3dbe4d6332d05d44dffcd48fde20b7f5dbc38f4c"}
Sep 06 12:22:40.048207 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:40.048132    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:22:41.054462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:41.054430    2578 generic.go:356] "Generic (PLEG): container finished" podID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerID="d8a6434b5f98377ef506e24ef8eed37dddec038d5e638e212a7a1e65853960f3" exitCode=0
Sep 06 12:22:41.054829 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:41.054508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w" event={"ID":"74bf1dab-90b2-4b30-9e1b-82b3c091db97","Type":"ContainerDied","Data":"d8a6434b5f98377ef506e24ef8eed37dddec038d5e638e212a7a1e65853960f3"}
Sep 06 12:22:42.060642 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:42.060604    2578 generic.go:356] "Generic (PLEG): container finished" podID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerID="c5ea2ca71dfc8506078b53b199f10dc5d580bcc42c103097b5cc9eba8a3e2c73" exitCode=0
Sep 06 12:22:42.061015 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:42.060688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w" event={"ID":"74bf1dab-90b2-4b30-9e1b-82b3c091db97","Type":"ContainerDied","Data":"c5ea2ca71dfc8506078b53b199f10dc5d580bcc42c103097b5cc9eba8a3e2c73"}
Sep 06 12:22:43.191318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.191293    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:43.280185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.280142    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-bundle\") pod \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") "
Sep 06 12:22:43.280313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.280228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6g5v7\" (UniqueName: \"kubernetes.io/projected/74bf1dab-90b2-4b30-9e1b-82b3c091db97-kube-api-access-6g5v7\") pod \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") "
Sep 06 12:22:43.280313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.280248    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-util\") pod \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\" (UID: \"74bf1dab-90b2-4b30-9e1b-82b3c091db97\") "
Sep 06 12:22:43.280828 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.280801    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-bundle" (OuterVolumeSpecName: "bundle") pod "74bf1dab-90b2-4b30-9e1b-82b3c091db97" (UID: "74bf1dab-90b2-4b30-9e1b-82b3c091db97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:22:43.282548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.282521    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74bf1dab-90b2-4b30-9e1b-82b3c091db97-kube-api-access-6g5v7" (OuterVolumeSpecName: "kube-api-access-6g5v7") pod "74bf1dab-90b2-4b30-9e1b-82b3c091db97" (UID: "74bf1dab-90b2-4b30-9e1b-82b3c091db97"). InnerVolumeSpecName "kube-api-access-6g5v7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:22:43.285705 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.285685    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-util" (OuterVolumeSpecName: "util") pod "74bf1dab-90b2-4b30-9e1b-82b3c091db97" (UID: "74bf1dab-90b2-4b30-9e1b-82b3c091db97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:22:43.381344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.381291    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-bundle\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:22:43.381344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.381309    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6g5v7\" (UniqueName: \"kubernetes.io/projected/74bf1dab-90b2-4b30-9e1b-82b3c091db97-kube-api-access-6g5v7\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:22:43.381344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:43.381319    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/74bf1dab-90b2-4b30-9e1b-82b3c091db97-util\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:22:44.072034 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:44.072003    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w"
Sep 06 12:22:44.072034 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:44.072030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwfs5w" event={"ID":"74bf1dab-90b2-4b30-9e1b-82b3c091db97","Type":"ContainerDied","Data":"298265ef7d290d79b3b0c34a3dbe4d6332d05d44dffcd48fde20b7f5dbc38f4c"}
Sep 06 12:22:44.072262 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:44.072066    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="298265ef7d290d79b3b0c34a3dbe4d6332d05d44dffcd48fde20b7f5dbc38f4c"
Sep 06 12:22:55.423516 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423483    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"]
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423773    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="extract"
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423784    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="extract"
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423798    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="util"
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423804    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="util"
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423818    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="pull"
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423824    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="pull"
Sep 06 12:22:55.423958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.423890    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="74bf1dab-90b2-4b30-9e1b-82b3c091db97" containerName="extract"
Sep 06 12:22:55.427693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.427675    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.430477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.430454    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 06 12:22:55.430650 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.430612    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 06 12:22:55.430720 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.430675    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 06 12:22:55.430720 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.430612    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lvcwj\""
Sep 06 12:22:55.430818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.430725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 06 12:22:55.444181 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.444159    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"]
Sep 06 12:22:55.557283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.557245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7hpr\" (UniqueName: \"kubernetes.io/projected/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-kube-api-access-k7hpr\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.557283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.557292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.557459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.557311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-manifests\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.557459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.557409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-tmp\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.557459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.557450    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.658638 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.658605    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-tmp\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.658788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.658647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.658788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.658709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7hpr\" (UniqueName: \"kubernetes.io/projected/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-kube-api-access-k7hpr\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.658904 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.658782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.658904 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.658826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-manifests\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.659228 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.659207    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-manifests\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.660937 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.660917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-tmp\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.661056 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.661039    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.661272 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.661253    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.666182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.666123    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7hpr\" (UniqueName: \"kubernetes.io/projected/3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66-kube-api-access-k7hpr\") pod \"opendatahub-operator-controller-manager-7bf7c58dfb-wbqng\" (UID: \"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66\") " pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:55.737638 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:55.737616    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:22:56.010139 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:56.010113    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"]
Sep 06 12:22:56.012850 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:22:56.012823    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f12b1ae_142c_4f5c_b8fb_9d6734d9bb66.slice/crio-a356b6afea2c5d273923cdb0df50ff39d77ed60d922aa1a725cef6be8ab2e0db WatchSource:0}: Error finding container a356b6afea2c5d273923cdb0df50ff39d77ed60d922aa1a725cef6be8ab2e0db: Status 404 returned error can't find the container with id a356b6afea2c5d273923cdb0df50ff39d77ed60d922aa1a725cef6be8ab2e0db
Sep 06 12:22:56.125365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:56.125336    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng" event={"ID":"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66","Type":"ContainerStarted","Data":"a356b6afea2c5d273923cdb0df50ff39d77ed60d922aa1a725cef6be8ab2e0db"}
Sep 06 12:22:59.141410 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:22:59.141383    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng" event={"ID":"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66","Type":"ContainerStarted","Data":"e1747ae469fa8e4aa6a507ce8b7471b1cea990652144d232a6f5e9c1b16e9bc5"}
Sep 06 12:23:00.147639 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:00.147606    2578 generic.go:356] "Generic (PLEG): container finished" podID="3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66" containerID="e1747ae469fa8e4aa6a507ce8b7471b1cea990652144d232a6f5e9c1b16e9bc5" exitCode=0
Sep 06 12:23:00.147958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:00.147658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng" event={"ID":"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66","Type":"ContainerDied","Data":"e1747ae469fa8e4aa6a507ce8b7471b1cea990652144d232a6f5e9c1b16e9bc5"}
Sep 06 12:23:01.154332 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:01.154298    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng" event={"ID":"3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66","Type":"ContainerStarted","Data":"e5f6a78b6e7a8ea5ccc9ccfefb43312fa38da13674142ba9a756fb0c4fe6c7ba"}
Sep 06 12:23:01.154804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:01.154441    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:23:01.174119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:01.174076    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng" podStartSLOduration=1.7565001059999998 podStartE2EDuration="6.174064007s" totalImagesPullingTime="3.343847839s" totalInitContainerRuntime="1.073716062s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:22:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:01.172857979 +0000 UTC m=+322.986282061" watchObservedRunningTime="2026-09-06 12:23:01.174064007 +0000 UTC m=+322.987488085"
Sep 06 12:23:12.162213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:12.162182    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bf7c58dfb-wbqng"
Sep 06 12:23:14.964064 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:14.964034    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"]
Sep 06 12:23:14.975975 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:14.975948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:14.976515 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:14.976490    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"]
Sep 06 12:23:14.978372 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:14.978349    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 06 12:23:14.978372 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:14.978361    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 06 12:23:15.102680 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.102654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849f80c4-72ad-4050-91f1-ee757d142b08-tmp\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.102795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.102688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnm8t\" (UniqueName: \"kubernetes.io/projected/849f80c4-72ad-4050-91f1-ee757d142b08-kube-api-access-tnm8t\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.102795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.102710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f80c4-72ad-4050-91f1-ee757d142b08-tls-certs\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.203491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.203459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849f80c4-72ad-4050-91f1-ee757d142b08-tmp\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.203491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.203493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnm8t\" (UniqueName: \"kubernetes.io/projected/849f80c4-72ad-4050-91f1-ee757d142b08-kube-api-access-tnm8t\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.203723 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.203517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f80c4-72ad-4050-91f1-ee757d142b08-tls-certs\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.205809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.205779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/849f80c4-72ad-4050-91f1-ee757d142b08-tmp\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.205967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.205951    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/849f80c4-72ad-4050-91f1-ee757d142b08-tls-certs\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.215401 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.215341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnm8t\" (UniqueName: \"kubernetes.io/projected/849f80c4-72ad-4050-91f1-ee757d142b08-kube-api-access-tnm8t\") pod \"kube-auth-proxy-766996c99d-6r5bh\" (UID: \"849f80c4-72ad-4050-91f1-ee757d142b08\") " pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.286177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.286140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"
Sep 06 12:23:15.557456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:15.557335    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-766996c99d-6r5bh"]
Sep 06 12:23:15.560176 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:23:15.560134    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod849f80c4_72ad_4050_91f1_ee757d142b08.slice/crio-9835279e724ae30c367215daaf36fe639f0f036887a255e13bc486dbd7152b77 WatchSource:0}: Error finding container 9835279e724ae30c367215daaf36fe639f0f036887a255e13bc486dbd7152b77: Status 404 returned error can't find the container with id 9835279e724ae30c367215daaf36fe639f0f036887a255e13bc486dbd7152b77
Sep 06 12:23:16.164621 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.164589    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"]
Sep 06 12:23:16.167881 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.167861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.170260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.170216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 06 12:23:16.170383 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.170277    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 12:23:16.170383 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.170294    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 06 12:23:16.170701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.170665    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 06 12:23:16.170701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.170682    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zdlqb\""
Sep 06 12:23:16.180444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.180419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"]
Sep 06 12:23:16.225460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.225425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh" event={"ID":"849f80c4-72ad-4050-91f1-ee757d142b08","Type":"ContainerStarted","Data":"9835279e724ae30c367215daaf36fe639f0f036887a255e13bc486dbd7152b77"}
Sep 06 12:23:16.313482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/420b16cd-f57b-4d9b-9b35-d654518b6ed4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.313630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.313630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67n9z\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-kube-api-access-67n9z\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.313630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.313846 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.313846 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.313846 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.313700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67n9z\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-kube-api-access-67n9z\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414955 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414955 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414955 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414955 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.414955 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.414932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/420b16cd-f57b-4d9b-9b35-d654518b6ed4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.415895 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.415868    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.418312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.418268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.418413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.418399    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.418874 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.418850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/420b16cd-f57b-4d9b-9b35-d654518b6ed4-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.419713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.419621    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.423687 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.423632    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67n9z\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-kube-api-access-67n9z\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.424288 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.424262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-2cmhg\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.479320 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.479295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:16.764914 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:16.764888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"]
Sep 06 12:23:16.767603 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:23:16.767574    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod420b16cd_f57b_4d9b_9b35_d654518b6ed4.slice/crio-53961735bdf047a933b287b02b58f1dcee25fa55ef354fee83d59fe2c292334b WatchSource:0}: Error finding container 53961735bdf047a933b287b02b58f1dcee25fa55ef354fee83d59fe2c292334b: Status 404 returned error can't find the container with id 53961735bdf047a933b287b02b58f1dcee25fa55ef354fee83d59fe2c292334b
Sep 06 12:23:17.232165 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:17.232110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" event={"ID":"420b16cd-f57b-4d9b-9b35-d654518b6ed4","Type":"ContainerStarted","Data":"53961735bdf047a933b287b02b58f1dcee25fa55ef354fee83d59fe2c292334b"}
Sep 06 12:23:19.246109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:19.246057    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh" event={"ID":"849f80c4-72ad-4050-91f1-ee757d142b08","Type":"ContainerStarted","Data":"a8de65d0d7d84bb881a5fb9778ad192571e2d9b6e1f8cdb5d1168e19de282da8"}
Sep 06 12:23:19.263390 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:19.263339    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-766996c99d-6r5bh" podStartSLOduration=2.334327149 podStartE2EDuration="5.263320562s" totalImagesPullingTime="2.928993413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:19.26203652 +0000 UTC m=+341.075460602" watchObservedRunningTime="2026-09-06 12:23:19.263320562 +0000 UTC m=+341.076744641"
Sep 06 12:23:19.818346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:19.818309    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:23:19.818446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:19.818380    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:23:20.253197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:20.253162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" event={"ID":"420b16cd-f57b-4d9b-9b35-d654518b6ed4","Type":"ContainerStarted","Data":"1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19"}
Sep 06 12:23:20.253633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:20.253512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:20.254504 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:20.254480    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-2cmhg container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 12:23:20.254605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:20.254535    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" podUID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 12:23:20.272573 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:20.272531    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" podStartSLOduration=1.2242829 podStartE2EDuration="4.272517424s" totalImagesPullingTime="3.048234524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:20.27027018 +0000 UTC m=+342.083694275" watchObservedRunningTime="2026-09-06 12:23:20.272517424 +0000 UTC m=+342.085941503"
Sep 06 12:23:21.257829 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:21.257800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:34.356265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.356185    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"]
Sep 06 12:23:34.359869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.359847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:34.362686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.362666    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 06 12:23:34.362869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.362850    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-92l6b\""
Sep 06 12:23:34.370434 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.370407    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"]
Sep 06 12:23:34.372325 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.372302    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"]
Sep 06 12:23:34.375538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.375512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.378357 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.378337    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4j7z4\""
Sep 06 12:23:34.378944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.378925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 06 12:23:34.387536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.387514    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"]
Sep 06 12:23:34.460021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.459996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n49nc\" (UniqueName: \"kubernetes.io/projected/127c40ac-2eb4-479d-b783-bb4866eb4047-kube-api-access-n49nc\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:34.460119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.460058    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/127c40ac-2eb4-479d-b783-bb4866eb4047-cert\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:34.561379 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.561353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/127c40ac-2eb4-479d-b783-bb4866eb4047-cert\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:34.561505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.561394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpnhm\" (UniqueName: \"kubernetes.io/projected/d265c7da-ab4e-463e-a791-043b2c25b09c-kube-api-access-bpnhm\") pod \"llmisvc-controller-manager-777c6bd7d5-h54xz\" (UID: \"d265c7da-ab4e-463e-a791-043b2c25b09c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.561505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.561446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n49nc\" (UniqueName: \"kubernetes.io/projected/127c40ac-2eb4-479d-b783-bb4866eb4047-kube-api-access-n49nc\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:34.561505 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:23:34.561485    2578 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 06 12:23:34.561665 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:23:34.561566    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/127c40ac-2eb4-479d-b783-bb4866eb4047-cert podName:127c40ac-2eb4-479d-b783-bb4866eb4047 nodeName:}" failed. No retries permitted until 2026-09-06 12:23:35.061546245 +0000 UTC m=+356.874970307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/127c40ac-2eb4-479d-b783-bb4866eb4047-cert") pod "kserve-controller-manager-d6f4b65b8-9wq4k" (UID: "127c40ac-2eb4-479d-b783-bb4866eb4047") : secret "kserve-webhook-server-cert" not found
Sep 06 12:23:34.561665 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.561631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c7da-ab4e-463e-a791-043b2c25b09c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h54xz\" (UID: \"d265c7da-ab4e-463e-a791-043b2c25b09c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.576464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.576440    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n49nc\" (UniqueName: \"kubernetes.io/projected/127c40ac-2eb4-479d-b783-bb4866eb4047-kube-api-access-n49nc\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:34.662591 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.662502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c7da-ab4e-463e-a791-043b2c25b09c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h54xz\" (UID: \"d265c7da-ab4e-463e-a791-043b2c25b09c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.662591 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.662553    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpnhm\" (UniqueName: \"kubernetes.io/projected/d265c7da-ab4e-463e-a791-043b2c25b09c-kube-api-access-bpnhm\") pod \"llmisvc-controller-manager-777c6bd7d5-h54xz\" (UID: \"d265c7da-ab4e-463e-a791-043b2c25b09c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.665173 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.665121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d265c7da-ab4e-463e-a791-043b2c25b09c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-h54xz\" (UID: \"d265c7da-ab4e-463e-a791-043b2c25b09c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.670593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.670564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpnhm\" (UniqueName: \"kubernetes.io/projected/d265c7da-ab4e-463e-a791-043b2c25b09c-kube-api-access-bpnhm\") pod \"llmisvc-controller-manager-777c6bd7d5-h54xz\" (UID: \"d265c7da-ab4e-463e-a791-043b2c25b09c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.686609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.686587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:34.956445 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:34.956423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"]
Sep 06 12:23:34.958497 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:23:34.958469    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd265c7da_ab4e_463e_a791_043b2c25b09c.slice/crio-60f7831f230f33771fdcd9d1de4fc9289e4066ddae54991d63988da8552f18d8 WatchSource:0}: Error finding container 60f7831f230f33771fdcd9d1de4fc9289e4066ddae54991d63988da8552f18d8: Status 404 returned error can't find the container with id 60f7831f230f33771fdcd9d1de4fc9289e4066ddae54991d63988da8552f18d8
Sep 06 12:23:35.066524 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:35.066493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/127c40ac-2eb4-479d-b783-bb4866eb4047-cert\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:35.068895 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:35.068870    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/127c40ac-2eb4-479d-b783-bb4866eb4047-cert\") pod \"kserve-controller-manager-d6f4b65b8-9wq4k\" (UID: \"127c40ac-2eb4-479d-b783-bb4866eb4047\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:35.271264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:35.271179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:35.328120 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:35.327520    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz" event={"ID":"d265c7da-ab4e-463e-a791-043b2c25b09c","Type":"ContainerStarted","Data":"60f7831f230f33771fdcd9d1de4fc9289e4066ddae54991d63988da8552f18d8"}
Sep 06 12:23:35.543194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:35.543167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"]
Sep 06 12:23:35.545843 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:23:35.545814    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod127c40ac_2eb4_479d_b783_bb4866eb4047.slice/crio-1ec584305cb921caccceb253bdc1e28f37791dcf46fb8c130076543cc7da0565 WatchSource:0}: Error finding container 1ec584305cb921caccceb253bdc1e28f37791dcf46fb8c130076543cc7da0565: Status 404 returned error can't find the container with id 1ec584305cb921caccceb253bdc1e28f37791dcf46fb8c130076543cc7da0565
Sep 06 12:23:36.336534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.336496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k" event={"ID":"127c40ac-2eb4-479d-b783-bb4866eb4047","Type":"ContainerStarted","Data":"1ec584305cb921caccceb253bdc1e28f37791dcf46fb8c130076543cc7da0565"}
Sep 06 12:23:36.423193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.423158    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"]
Sep 06 12:23:36.423415 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.423388    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" podUID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" containerName="discovery" containerID="cri-o://1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19" gracePeriod=30
Sep 06 12:23:36.706665 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.706641    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:36.793122 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67n9z\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-kube-api-access-67n9z\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793122 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793125    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/420b16cd-f57b-4d9b-9b35-d654518b6ed4-local-certs\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793192    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-ca-configmap\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793235    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-cacerts\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-dns-cert\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793289    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-token\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793309    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-kubeconfig\") pod \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\" (UID: \"420b16cd-f57b-4d9b-9b35-d654518b6ed4\") "
Sep 06 12:23:36.793679 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.793635    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:23:36.795490 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.795463    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:23:36.795578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.795519    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-cacerts" (OuterVolumeSpecName: "cacerts") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:23:36.795768 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.795741    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/420b16cd-f57b-4d9b-9b35-d654518b6ed4-local-certs" (OuterVolumeSpecName: "local-certs") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:23:36.795860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.795837    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-kube-api-access-67n9z" (OuterVolumeSpecName: "kube-api-access-67n9z") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "kube-api-access-67n9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:23:36.795909 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.795884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-token" (OuterVolumeSpecName: "istio-token") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:23:36.795944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.795898    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "420b16cd-f57b-4d9b-9b35-d654518b6ed4" (UID: "420b16cd-f57b-4d9b-9b35-d654518b6ed4"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:23:36.894682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894608    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-ca-configmap\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:36.894682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894634    2578 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-cacerts\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:36.894682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894649    2578 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-csr-dns-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:36.894682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894659    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:36.894682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894671    2578 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/420b16cd-f57b-4d9b-9b35-d654518b6ed4-istio-kubeconfig\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:36.894682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894682    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67n9z\" (UniqueName: \"kubernetes.io/projected/420b16cd-f57b-4d9b-9b35-d654518b6ed4-kube-api-access-67n9z\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:36.894953 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:36.894695    2578 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/420b16cd-f57b-4d9b-9b35-d654518b6ed4-local-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:23:37.342666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.342625    2578 generic.go:356] "Generic (PLEG): container finished" podID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" containerID="1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19" exitCode=0
Sep 06 12:23:37.342873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.342683    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"
Sep 06 12:23:37.342873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.342715    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" event={"ID":"420b16cd-f57b-4d9b-9b35-d654518b6ed4","Type":"ContainerDied","Data":"1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19"}
Sep 06 12:23:37.342873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.342803    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg" event={"ID":"420b16cd-f57b-4d9b-9b35-d654518b6ed4","Type":"ContainerDied","Data":"53961735bdf047a933b287b02b58f1dcee25fa55ef354fee83d59fe2c292334b"}
Sep 06 12:23:37.342873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.342832    2578 scope.go:117] "RemoveContainer" containerID="1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19"
Sep 06 12:23:37.367048 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.367020    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"]
Sep 06 12:23:37.373744 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.373717    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-2cmhg"]
Sep 06 12:23:37.650571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.650380    2578 scope.go:117] "RemoveContainer" containerID="1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19"
Sep 06 12:23:37.650764 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:23:37.650739    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19\": container with ID starting with 1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19 not found: ID does not exist" containerID="1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19"
Sep 06 12:23:37.650830 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:37.650779    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19"} err="failed to get container status \"1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19\": rpc error: code = NotFound desc = could not find container \"1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19\": container with ID starting with 1939cb1c3bdc9c8a3d8dfb5dbc34eb87feffce026e156d7b1cd1d9dd2ed24c19 not found: ID does not exist"
Sep 06 12:23:38.348534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:38.348508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k" event={"ID":"127c40ac-2eb4-479d-b783-bb4866eb4047","Type":"ContainerStarted","Data":"8259ba1d0b4d6c584ef16eac0f463d771d2534fd0b5cecff0a6379fd2ea70c74"}
Sep 06 12:23:38.348873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:38.348608    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:23:38.366506 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:38.366463    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k" podStartSLOduration=1.6862502639999999 podStartE2EDuration="4.366447938s" totalImagesPullingTime="2.680197674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:38.364789984 +0000 UTC m=+360.178214085" watchObservedRunningTime="2026-09-06 12:23:38.366447938 +0000 UTC m=+360.179872037"
Sep 06 12:23:38.667591 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:38.667564    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" path="/var/lib/kubelet/pods/420b16cd-f57b-4d9b-9b35-d654518b6ed4/volumes"
Sep 06 12:23:39.357132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:39.357092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz" event={"ID":"d265c7da-ab4e-463e-a791-043b2c25b09c","Type":"ContainerStarted","Data":"442bd910c87ba50a5dba2baaacbb98bf83780001c737ff2222a47446ab58569a"}
Sep 06 12:23:39.357627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:39.357376    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:23:39.373283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:23:39.373228    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz" podStartSLOduration=2.101152692 podStartE2EDuration="5.373207881s" totalImagesPullingTime="3.272055189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:23:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:23:39.371738466 +0000 UTC m=+361.185162545" watchObservedRunningTime="2026-09-06 12:23:39.373207881 +0000 UTC m=+361.186631961"
Sep 06 12:24:09.363013 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:09.362983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-9wq4k"
Sep 06 12:24:10.364023 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:10.363995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-h54xz"
Sep 06 12:24:29.673678 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.673643    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"]
Sep 06 12:24:29.674044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.673965    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" containerName="discovery"
Sep 06 12:24:29.674044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.673976    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" containerName="discovery"
Sep 06 12:24:29.674044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.674032    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="420b16cd-f57b-4d9b-9b35-d654518b6ed4" containerName="discovery"
Sep 06 12:24:29.680414 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.680388    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.682903 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.682879    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 06 12:24:29.683043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.682882    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 06 12:24:29.683867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.683823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"]
Sep 06 12:24:29.683992 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.683952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-88lvk\""
Sep 06 12:24:29.771314 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.771290    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"]
Sep 06 12:24:29.774587 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.774572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.781442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.781419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"]
Sep 06 12:24:29.791270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.791233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.791270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.791261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.791443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.791299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xt4b\" (UniqueName: \"kubernetes.io/projected/6cd58a06-e9c8-4815-8534-36183ae2d3cd-kube-api-access-4xt4b\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.875424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.875402    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"]
Sep 06 12:24:29.878682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.878667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:29.885887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.885865    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"]
Sep 06 12:24:29.892176 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.892282 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.892345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnwhw\" (UniqueName: \"kubernetes.io/projected/803ded08-341f-4d3d-8c9c-c88c1b259878-kube-api-access-dnwhw\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.892345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.892451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.892451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xt4b\" (UniqueName: \"kubernetes.io/projected/6cd58a06-e9c8-4815-8534-36183ae2d3cd-kube-api-access-4xt4b\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.892651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.892738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.892715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.900247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.900228    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xt4b\" (UniqueName: \"kubernetes.io/projected/6cd58a06-e9c8-4815-8534-36183ae2d3cd-kube-api-access-4xt4b\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.975440 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.975418    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"]
Sep 06 12:24:29.978871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.978857    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:29.986024 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.985862    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"]
Sep 06 12:24:29.990829 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.990804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:29.992840 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.992814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:29.992938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.992861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.992938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.992913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hqmm\" (UniqueName: \"kubernetes.io/projected/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-kube-api-access-8hqmm\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:29.993053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.992952    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:29.993053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.992983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnwhw\" (UniqueName: \"kubernetes.io/projected/803ded08-341f-4d3d-8c9c-c88c1b259878-kube-api-access-dnwhw\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.993231 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.993211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.993298 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.993280    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.993519 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.993499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:29.999935 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:29.999910    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnwhw\" (UniqueName: \"kubernetes.io/projected/803ded08-341f-4d3d-8c9c-c88c1b259878-kube-api-access-dnwhw\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:30.083767 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.083731    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:30.094312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.094429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4h9z\" (UniqueName: \"kubernetes.io/projected/19a27ea4-9aaa-4e74-b5d5-66522732ae91-kube-api-access-g4h9z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.094429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.094539 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.094539 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hqmm\" (UniqueName: \"kubernetes.io/projected/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-kube-api-access-8hqmm\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.094640 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.095093 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.094913    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.095093 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.095075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.104120 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.104092    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hqmm\" (UniqueName: \"kubernetes.io/projected/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-kube-api-access-8hqmm\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.187687 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.187651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:30.195317 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.195287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.195460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.195437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.195521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.195484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g4h9z\" (UniqueName: \"kubernetes.io/projected/19a27ea4-9aaa-4e74-b5d5-66522732ae91-kube-api-access-g4h9z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.195645 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.195619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.195827 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.195805    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.203423 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.203404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4h9z\" (UniqueName: \"kubernetes.io/projected/19a27ea4-9aaa-4e74-b5d5-66522732ae91-kube-api-access-g4h9z\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.263273 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.263241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"]
Sep 06 12:24:30.266605 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:30.266573    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cd58a06_e9c8_4815_8534_36183ae2d3cd.slice/crio-11861173d81cf011f3ced12aa0493ae16d3d8e9d554ee45c9a27e329a4656079 WatchSource:0}: Error finding container 11861173d81cf011f3ced12aa0493ae16d3d8e9d554ee45c9a27e329a4656079: Status 404 returned error can't find the container with id 11861173d81cf011f3ced12aa0493ae16d3d8e9d554ee45c9a27e329a4656079
Sep 06 12:24:30.288020 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.287999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:30.368436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.368408    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"]
Sep 06 12:24:30.370585 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:30.370553    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod803ded08_341f_4d3d_8c9c_c88c1b259878.slice/crio-aa147ff26f6ace71f2a12cb91febf8cfa1e73ed2224e47be9b2bbc0769b7396e WatchSource:0}: Error finding container aa147ff26f6ace71f2a12cb91febf8cfa1e73ed2224e47be9b2bbc0769b7396e: Status 404 returned error can't find the container with id aa147ff26f6ace71f2a12cb91febf8cfa1e73ed2224e47be9b2bbc0769b7396e
Sep 06 12:24:30.458898 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.458872    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"]
Sep 06 12:24:30.462737 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:30.462714    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e63c4b0_1d78_4b9b_93f6_f9a43b442c71.slice/crio-f1aedd575853300513690aa78138dbd2bec6aab6dc23ddcc0b78b24dc1ea0e8d WatchSource:0}: Error finding container f1aedd575853300513690aa78138dbd2bec6aab6dc23ddcc0b78b24dc1ea0e8d: Status 404 returned error can't find the container with id f1aedd575853300513690aa78138dbd2bec6aab6dc23ddcc0b78b24dc1ea0e8d
Sep 06 12:24:30.562034 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.561963    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"]
Sep 06 12:24:30.593165 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.593120    2578 generic.go:356] "Generic (PLEG): container finished" podID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerID="0e048d504fb262d5326a385f2500378aef5ce2ba6f54661e1de1f537d34fecb0" exitCode=0
Sep 06 12:24:30.593258 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.593174    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p" event={"ID":"803ded08-341f-4d3d-8c9c-c88c1b259878","Type":"ContainerDied","Data":"0e048d504fb262d5326a385f2500378aef5ce2ba6f54661e1de1f537d34fecb0"}
Sep 06 12:24:30.593258 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.593218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p" event={"ID":"803ded08-341f-4d3d-8c9c-c88c1b259878","Type":"ContainerStarted","Data":"aa147ff26f6ace71f2a12cb91febf8cfa1e73ed2224e47be9b2bbc0769b7396e"}
Sep 06 12:24:30.594882 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.594863    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerID="2c83abfddd262871595ca50674589fe6777010342bf5816da67bea6b46792357" exitCode=0
Sep 06 12:24:30.594976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.594949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf" event={"ID":"6cd58a06-e9c8-4815-8534-36183ae2d3cd","Type":"ContainerDied","Data":"2c83abfddd262871595ca50674589fe6777010342bf5816da67bea6b46792357"}
Sep 06 12:24:30.595076 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.595001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf" event={"ID":"6cd58a06-e9c8-4815-8534-36183ae2d3cd","Type":"ContainerStarted","Data":"11861173d81cf011f3ced12aa0493ae16d3d8e9d554ee45c9a27e329a4656079"}
Sep 06 12:24:30.596554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.596531    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerID="63ac47d70fbc19bbccb3202c752c389bd796d47b246759851a5660e78c889069" exitCode=0
Sep 06 12:24:30.596629 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.596574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7" event={"ID":"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71","Type":"ContainerDied","Data":"63ac47d70fbc19bbccb3202c752c389bd796d47b246759851a5660e78c889069"}
Sep 06 12:24:30.596629 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:30.596607    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7" event={"ID":"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71","Type":"ContainerStarted","Data":"f1aedd575853300513690aa78138dbd2bec6aab6dc23ddcc0b78b24dc1ea0e8d"}
Sep 06 12:24:30.596922 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:30.596903    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a27ea4_9aaa_4e74_b5d5_66522732ae91.slice/crio-6e1c70d1a776b1548a2324c73e31691827cc26d57b0d4d82ae1ee08723d209a8 WatchSource:0}: Error finding container 6e1c70d1a776b1548a2324c73e31691827cc26d57b0d4d82ae1ee08723d209a8: Status 404 returned error can't find the container with id 6e1c70d1a776b1548a2324c73e31691827cc26d57b0d4d82ae1ee08723d209a8
Sep 06 12:24:31.602811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:31.602782    2578 generic.go:356] "Generic (PLEG): container finished" podID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerID="f96acba7519cb5ee11917620f14fe666e1022a1bf2a8e9ec29295d1a633adb09" exitCode=0
Sep 06 12:24:31.603132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:31.602875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s" event={"ID":"19a27ea4-9aaa-4e74-b5d5-66522732ae91","Type":"ContainerDied","Data":"f96acba7519cb5ee11917620f14fe666e1022a1bf2a8e9ec29295d1a633adb09"}
Sep 06 12:24:31.603132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:31.602942    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s" event={"ID":"19a27ea4-9aaa-4e74-b5d5-66522732ae91","Type":"ContainerStarted","Data":"6e1c70d1a776b1548a2324c73e31691827cc26d57b0d4d82ae1ee08723d209a8"}
Sep 06 12:24:31.604824 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:31.604801    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerID="8f1455d1c67273ef8c4e41dc0fea1f69cd810023f46cbfc4655d4f8b7e90d918" exitCode=0
Sep 06 12:24:31.604910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:31.604882    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7" event={"ID":"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71","Type":"ContainerDied","Data":"8f1455d1c67273ef8c4e41dc0fea1f69cd810023f46cbfc4655d4f8b7e90d918"}
Sep 06 12:24:32.612291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:32.612258    2578 generic.go:356] "Generic (PLEG): container finished" podID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerID="8c4e01aa75c60b48972db91ea6beb422362c7ad28df68f076d9b1160b3e1197b" exitCode=0
Sep 06 12:24:32.612637 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:32.612341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p" event={"ID":"803ded08-341f-4d3d-8c9c-c88c1b259878","Type":"ContainerDied","Data":"8c4e01aa75c60b48972db91ea6beb422362c7ad28df68f076d9b1160b3e1197b"}
Sep 06 12:24:32.614422 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:32.614397    2578 generic.go:356] "Generic (PLEG): container finished" podID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerID="2cb6d41e0fff44b7ddbeb93a0561035eb0ce1071f9c277964d2517f1cb015f25" exitCode=0
Sep 06 12:24:32.614547 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:32.614483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s" event={"ID":"19a27ea4-9aaa-4e74-b5d5-66522732ae91","Type":"ContainerDied","Data":"2cb6d41e0fff44b7ddbeb93a0561035eb0ce1071f9c277964d2517f1cb015f25"}
Sep 06 12:24:32.616811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:32.616791    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerID="312172c92ffdb591754d5cb7e8bb6182c73939ca98a7cb056d997a6f45a313e7" exitCode=0
Sep 06 12:24:32.616905 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:32.616818    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7" event={"ID":"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71","Type":"ContainerDied","Data":"312172c92ffdb591754d5cb7e8bb6182c73939ca98a7cb056d997a6f45a313e7"}
Sep 06 12:24:33.627212 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.627182    2578 generic.go:356] "Generic (PLEG): container finished" podID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerID="9a49f13b262d6b0d01dc45e050f405f703a119f9a58bfc61af839c37c89869ac" exitCode=0
Sep 06 12:24:33.627586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.627288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p" event={"ID":"803ded08-341f-4d3d-8c9c-c88c1b259878","Type":"ContainerDied","Data":"9a49f13b262d6b0d01dc45e050f405f703a119f9a58bfc61af839c37c89869ac"}
Sep 06 12:24:33.629593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.629562    2578 generic.go:356] "Generic (PLEG): container finished" podID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerID="d77695ea352ebd72a3932ec63d1cbaffd1b1999e35369707854ae97012273e26" exitCode=0
Sep 06 12:24:33.629708 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.629654    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s" event={"ID":"19a27ea4-9aaa-4e74-b5d5-66522732ae91","Type":"ContainerDied","Data":"d77695ea352ebd72a3932ec63d1cbaffd1b1999e35369707854ae97012273e26"}
Sep 06 12:24:33.757580 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.757556    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:33.926960 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.926887    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-bundle\") pod \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") "
Sep 06 12:24:33.926960 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.926923    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-util\") pod \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") "
Sep 06 12:24:33.927142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.927042    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hqmm\" (UniqueName: \"kubernetes.io/projected/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-kube-api-access-8hqmm\") pod \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\" (UID: \"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71\") "
Sep 06 12:24:33.927369 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.927347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-bundle" (OuterVolumeSpecName: "bundle") pod "2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" (UID: "2e63c4b0-1d78-4b9b-93f6-f9a43b442c71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:33.929072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.929051    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-kube-api-access-8hqmm" (OuterVolumeSpecName: "kube-api-access-8hqmm") pod "2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" (UID: "2e63c4b0-1d78-4b9b-93f6-f9a43b442c71"). InnerVolumeSpecName "kube-api-access-8hqmm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:24:33.931669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:33.931647    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-util" (OuterVolumeSpecName: "util") pod "2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" (UID: "2e63c4b0-1d78-4b9b-93f6-f9a43b442c71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:34.028419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.028396    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hqmm\" (UniqueName: \"kubernetes.io/projected/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-kube-api-access-8hqmm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:34.028419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.028416    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-bundle\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:34.028532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.028426    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e63c4b0-1d78-4b9b-93f6-f9a43b442c71-util\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:34.637010 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.636978    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7"
Sep 06 12:24:34.637010 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.636994    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbwvrn7" event={"ID":"2e63c4b0-1d78-4b9b-93f6-f9a43b442c71","Type":"ContainerDied","Data":"f1aedd575853300513690aa78138dbd2bec6aab6dc23ddcc0b78b24dc1ea0e8d"}
Sep 06 12:24:34.637539 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.637052    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f1aedd575853300513690aa78138dbd2bec6aab6dc23ddcc0b78b24dc1ea0e8d"
Sep 06 12:24:34.782560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.782535    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:34.812529 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.812504    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:34.934462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.934379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-util\") pod \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") "
Sep 06 12:24:34.934586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.934487    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-util\") pod \"803ded08-341f-4d3d-8c9c-c88c1b259878\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") "
Sep 06 12:24:34.934586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.934515    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g4h9z\" (UniqueName: \"kubernetes.io/projected/19a27ea4-9aaa-4e74-b5d5-66522732ae91-kube-api-access-g4h9z\") pod \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") "
Sep 06 12:24:34.934586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.934544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-bundle\") pod \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\" (UID: \"19a27ea4-9aaa-4e74-b5d5-66522732ae91\") "
Sep 06 12:24:34.934586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.934564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnwhw\" (UniqueName: \"kubernetes.io/projected/803ded08-341f-4d3d-8c9c-c88c1b259878-kube-api-access-dnwhw\") pod \"803ded08-341f-4d3d-8c9c-c88c1b259878\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") "
Sep 06 12:24:34.934586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.934584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-bundle\") pod \"803ded08-341f-4d3d-8c9c-c88c1b259878\" (UID: \"803ded08-341f-4d3d-8c9c-c88c1b259878\") "
Sep 06 12:24:34.935286 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.935259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-bundle" (OuterVolumeSpecName: "bundle") pod "19a27ea4-9aaa-4e74-b5d5-66522732ae91" (UID: "19a27ea4-9aaa-4e74-b5d5-66522732ae91"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:34.935286 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.935264    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-bundle" (OuterVolumeSpecName: "bundle") pod "803ded08-341f-4d3d-8c9c-c88c1b259878" (UID: "803ded08-341f-4d3d-8c9c-c88c1b259878"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:34.936780 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.936755    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19a27ea4-9aaa-4e74-b5d5-66522732ae91-kube-api-access-g4h9z" (OuterVolumeSpecName: "kube-api-access-g4h9z") pod "19a27ea4-9aaa-4e74-b5d5-66522732ae91" (UID: "19a27ea4-9aaa-4e74-b5d5-66522732ae91"). InnerVolumeSpecName "kube-api-access-g4h9z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:24:34.937035 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.937009    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/803ded08-341f-4d3d-8c9c-c88c1b259878-kube-api-access-dnwhw" (OuterVolumeSpecName: "kube-api-access-dnwhw") pod "803ded08-341f-4d3d-8c9c-c88c1b259878" (UID: "803ded08-341f-4d3d-8c9c-c88c1b259878"). InnerVolumeSpecName "kube-api-access-dnwhw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:24:34.940877 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.940852    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-util" (OuterVolumeSpecName: "util") pod "19a27ea4-9aaa-4e74-b5d5-66522732ae91" (UID: "19a27ea4-9aaa-4e74-b5d5-66522732ae91"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:34.940981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:34.940962    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-util" (OuterVolumeSpecName: "util") pod "803ded08-341f-4d3d-8c9c-c88c1b259878" (UID: "803ded08-341f-4d3d-8c9c-c88c1b259878"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:35.035560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.035539    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-util\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:35.035560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.035560    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g4h9z\" (UniqueName: \"kubernetes.io/projected/19a27ea4-9aaa-4e74-b5d5-66522732ae91-kube-api-access-g4h9z\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:35.035684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.035569    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-bundle\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:35.035684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.035580    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnwhw\" (UniqueName: \"kubernetes.io/projected/803ded08-341f-4d3d-8c9c-c88c1b259878-kube-api-access-dnwhw\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:35.035684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.035588    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/803ded08-341f-4d3d-8c9c-c88c1b259878-bundle\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:35.035684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.035596    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/19a27ea4-9aaa-4e74-b5d5-66522732ae91-util\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:35.646654 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.646625    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p"
Sep 06 12:24:35.646654 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.646640    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183c4g89p" event={"ID":"803ded08-341f-4d3d-8c9c-c88c1b259878","Type":"ContainerDied","Data":"aa147ff26f6ace71f2a12cb91febf8cfa1e73ed2224e47be9b2bbc0769b7396e"}
Sep 06 12:24:35.647078 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.646688    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa147ff26f6ace71f2a12cb91febf8cfa1e73ed2224e47be9b2bbc0769b7396e"
Sep 06 12:24:35.648579 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.648555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s" event={"ID":"19a27ea4-9aaa-4e74-b5d5-66522732ae91","Type":"ContainerDied","Data":"6e1c70d1a776b1548a2324c73e31691827cc26d57b0d4d82ae1ee08723d209a8"}
Sep 06 12:24:35.648685 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.648596    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e1c70d1a776b1548a2324c73e31691827cc26d57b0d4d82ae1ee08723d209a8"
Sep 06 12:24:35.648685 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:35.648565    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053wtw4s"
Sep 06 12:24:37.660056 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:37.660020    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerID="2a5b3710b0571f6c7e78fce998761fd51bdb39681f051af5fa4d5dcfac03d0d3" exitCode=0
Sep 06 12:24:37.660411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:37.660104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf" event={"ID":"6cd58a06-e9c8-4815-8534-36183ae2d3cd","Type":"ContainerDied","Data":"2a5b3710b0571f6c7e78fce998761fd51bdb39681f051af5fa4d5dcfac03d0d3"}
Sep 06 12:24:38.666796 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:38.666765    2578 generic.go:356] "Generic (PLEG): container finished" podID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerID="580d68cdfbabc74265e4c47144c4f8b8d7c6700d24c6c29ff0c8f79151654e14" exitCode=0
Sep 06 12:24:38.668605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:38.668583    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf" event={"ID":"6cd58a06-e9c8-4815-8534-36183ae2d3cd","Type":"ContainerDied","Data":"580d68cdfbabc74265e4c47144c4f8b8d7c6700d24c6c29ff0c8f79151654e14"}
Sep 06 12:24:39.797591 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.797560    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:39.969846 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.969818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xt4b\" (UniqueName: \"kubernetes.io/projected/6cd58a06-e9c8-4815-8534-36183ae2d3cd-kube-api-access-4xt4b\") pod \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") "
Sep 06 12:24:39.969976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.969866    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-bundle\") pod \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") "
Sep 06 12:24:39.969976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.969896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-util\") pod \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\" (UID: \"6cd58a06-e9c8-4815-8534-36183ae2d3cd\") "
Sep 06 12:24:39.970385 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.970362    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-bundle" (OuterVolumeSpecName: "bundle") pod "6cd58a06-e9c8-4815-8534-36183ae2d3cd" (UID: "6cd58a06-e9c8-4815-8534-36183ae2d3cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:39.971865 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.971840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6cd58a06-e9c8-4815-8534-36183ae2d3cd-kube-api-access-4xt4b" (OuterVolumeSpecName: "kube-api-access-4xt4b") pod "6cd58a06-e9c8-4815-8534-36183ae2d3cd" (UID: "6cd58a06-e9c8-4815-8534-36183ae2d3cd"). InnerVolumeSpecName "kube-api-access-4xt4b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:24:39.974668 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:39.974645    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-util" (OuterVolumeSpecName: "util") pod "6cd58a06-e9c8-4815-8534-36183ae2d3cd" (UID: "6cd58a06-e9c8-4815-8534-36183ae2d3cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:24:40.070521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:40.070497    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-util\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:40.070521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:40.070520    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xt4b\" (UniqueName: \"kubernetes.io/projected/6cd58a06-e9c8-4815-8534-36183ae2d3cd-kube-api-access-4xt4b\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:40.070637 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:40.070530    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6cd58a06-e9c8-4815-8534-36183ae2d3cd-bundle\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:24:40.677742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:40.677718    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf"
Sep 06 12:24:40.677916 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:40.677746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0h8zxf" event={"ID":"6cd58a06-e9c8-4815-8534-36183ae2d3cd","Type":"ContainerDied","Data":"11861173d81cf011f3ced12aa0493ae16d3d8e9d554ee45c9a27e329a4656079"}
Sep 06 12:24:40.677916 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:40.677787    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="11861173d81cf011f3ced12aa0493ae16d3d8e9d554ee45c9a27e329a4656079"
Sep 06 12:24:48.258566 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.258525    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"]
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.258990    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="extract"
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259011    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="extract"
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259037    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="extract"
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259045    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="extract"
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259056    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="pull"
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259064    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="pull"
Sep 06 12:24:48.259072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259076    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259084    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259095    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="pull"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259102    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="pull"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259114    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259124    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259134    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259142    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259169    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="pull"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259176    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="pull"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259192    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259200    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259210    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="pull"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259217    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="pull"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259225    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259234    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259243    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259251    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="util"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259341    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="803ded08-341f-4d3d-8c9c-c88c1b259878" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259354    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e63c4b0-1d78-4b9b-93f6-f9a43b442c71" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259365    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6cd58a06-e9c8-4815-8534-36183ae2d3cd" containerName="extract"
Sep 06 12:24:48.259463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.259375    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19a27ea4-9aaa-4e74-b5d5-66522732ae91" containerName="extract"
Sep 06 12:24:48.262858 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.262838    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:24:48.265757 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.265738    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-n27vn\""
Sep 06 12:24:48.266769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.266751    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 06 12:24:48.266857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.266779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 06 12:24:48.286451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.286430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"]
Sep 06 12:24:48.432070 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.432046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8lqj\" (UniqueName: \"kubernetes.io/projected/d0d3f643-946f-4cf9-b2a2-149981a25b63-kube-api-access-t8lqj\") pod \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" (UID: \"d0d3f643-946f-4cf9-b2a2-149981a25b63\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:24:48.533085 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.533023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8lqj\" (UniqueName: \"kubernetes.io/projected/d0d3f643-946f-4cf9-b2a2-149981a25b63-kube-api-access-t8lqj\") pod \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" (UID: \"d0d3f643-946f-4cf9-b2a2-149981a25b63\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:24:48.540975 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.540953    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8lqj\" (UniqueName: \"kubernetes.io/projected/d0d3f643-946f-4cf9-b2a2-149981a25b63-kube-api-access-t8lqj\") pod \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" (UID: \"d0d3f643-946f-4cf9-b2a2-149981a25b63\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:24:48.573058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.573035    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:24:48.844644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:48.844622    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"]
Sep 06 12:24:48.846345 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:48.846318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d3f643_946f_4cf9_b2a2_149981a25b63.slice/crio-1da8ef7ea2642af9cb5460cb8e91c7a9536936972efd52a961c4f9964f438390 WatchSource:0}: Error finding container 1da8ef7ea2642af9cb5460cb8e91c7a9536936972efd52a961c4f9964f438390: Status 404 returned error can't find the container with id 1da8ef7ea2642af9cb5460cb8e91c7a9536936972efd52a961c4f9964f438390
Sep 06 12:24:49.724941 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:49.724897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb" event={"ID":"d0d3f643-946f-4cf9-b2a2-149981a25b63","Type":"ContainerStarted","Data":"1da8ef7ea2642af9cb5460cb8e91c7a9536936972efd52a961c4f9964f438390"}
Sep 06 12:24:50.252430 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.252394    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"]
Sep 06 12:24:50.256017 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.255994    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:24:50.259804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.259757    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 06 12:24:50.259967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.259831    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hfh7j\""
Sep 06 12:24:50.267224 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.267203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"]
Sep 06 12:24:50.453373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.453341    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grrpd\" (UniqueName: \"kubernetes.io/projected/a2bbbd20-154a-4317-8281-896ab066350e-kube-api-access-grrpd\") pod \"dns-operator-controller-manager-5985564776-vqt2h\" (UID: \"a2bbbd20-154a-4317-8281-896ab066350e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:24:50.554124 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.554043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grrpd\" (UniqueName: \"kubernetes.io/projected/a2bbbd20-154a-4317-8281-896ab066350e-kube-api-access-grrpd\") pod \"dns-operator-controller-manager-5985564776-vqt2h\" (UID: \"a2bbbd20-154a-4317-8281-896ab066350e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:24:50.566742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.566713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grrpd\" (UniqueName: \"kubernetes.io/projected/a2bbbd20-154a-4317-8281-896ab066350e-kube-api-access-grrpd\") pod \"dns-operator-controller-manager-5985564776-vqt2h\" (UID: \"a2bbbd20-154a-4317-8281-896ab066350e\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:24:50.569329 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:50.569280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:24:51.587565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:51.587541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"]
Sep 06 12:24:51.589290 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:51.589263    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2bbbd20_154a_4317_8281_896ab066350e.slice/crio-b5d591f85a44d19eb4036af0b4c292d9d2ec2ae8b07f04d6563640e6d8331ad4 WatchSource:0}: Error finding container b5d591f85a44d19eb4036af0b4c292d9d2ec2ae8b07f04d6563640e6d8331ad4: Status 404 returned error can't find the container with id b5d591f85a44d19eb4036af0b4c292d9d2ec2ae8b07f04d6563640e6d8331ad4
Sep 06 12:24:51.736016 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:51.735981    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb" event={"ID":"d0d3f643-946f-4cf9-b2a2-149981a25b63","Type":"ContainerStarted","Data":"ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818"}
Sep 06 12:24:51.736168 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:51.736048    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:24:51.737373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:51.737348    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h" event={"ID":"a2bbbd20-154a-4317-8281-896ab066350e","Type":"ContainerStarted","Data":"b5d591f85a44d19eb4036af0b4c292d9d2ec2ae8b07f04d6563640e6d8331ad4"}
Sep 06 12:24:51.759319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:51.759276    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb" podStartSLOduration=1.21953713 podStartE2EDuration="3.759262065s" totalImagesPullingTime="2.539724935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:24:51.756453619 +0000 UTC m=+433.569877698" watchObservedRunningTime="2026-09-06 12:24:51.759262065 +0000 UTC m=+433.572686144"
Sep 06 12:24:53.749546 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:53.749455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h" event={"ID":"a2bbbd20-154a-4317-8281-896ab066350e","Type":"ContainerStarted","Data":"7907e5e904702589a7d05cb08eb571bb70c63fb5e4be4c48207da86c114b8221"}
Sep 06 12:24:53.749925 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:53.749558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:24:53.768338 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:53.768279    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h" podStartSLOduration=1.9200115 podStartE2EDuration="3.768260585s" totalImagesPullingTime="1.848249085s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:24:53.768234746 +0000 UTC m=+435.581658825" watchObservedRunningTime="2026-09-06 12:24:53.768260585 +0000 UTC m=+435.581684667"
Sep 06 12:24:54.627784 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.627751    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"]
Sep 06 12:24:54.631274 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.631258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.633762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.633746    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x9427\""
Sep 06 12:24:54.643918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.643895    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"]
Sep 06 12:24:54.685135 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.685107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlnlr\" (UniqueName: \"kubernetes.io/projected/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-kube-api-access-hlnlr\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.685259 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.685141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.785993 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.785967    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlnlr\" (UniqueName: \"kubernetes.io/projected/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-kube-api-access-hlnlr\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.786395 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.786016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.786479 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.786457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.794189 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.794169    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlnlr\" (UniqueName: \"kubernetes.io/projected/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-kube-api-access-hlnlr\") pod \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:54.941665 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:54.941641    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:55.217995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:55.217970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"]
Sep 06 12:24:55.219661 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:55.219630    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbdf7f9_1e7e_48cf_93b0_232ce9c46805.slice/crio-9d6b5d6061f5ad5af6141138490000d9f53e0ba3da8abe31d3cab35153ac242c WatchSource:0}: Error finding container 9d6b5d6061f5ad5af6141138490000d9f53e0ba3da8abe31d3cab35153ac242c: Status 404 returned error can't find the container with id 9d6b5d6061f5ad5af6141138490000d9f53e0ba3da8abe31d3cab35153ac242c
Sep 06 12:24:55.761881 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:55.761847    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6" event={"ID":"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805","Type":"ContainerStarted","Data":"9d6b5d6061f5ad5af6141138490000d9f53e0ba3da8abe31d3cab35153ac242c"}
Sep 06 12:24:57.306483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.306449    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-l7dpz"]
Sep 06 12:24:57.309952 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.309932    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:24:57.312505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.312479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-mlcbg\""
Sep 06 12:24:57.322843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.322817    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-l7dpz"]
Sep 06 12:24:57.405237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.405205    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wh8w\" (UniqueName: \"kubernetes.io/projected/b1b6b814-d694-4ab4-a6c2-8ed8687507b8-kube-api-access-8wh8w\") pod \"authorino-operator-68d88948d8-l7dpz\" (UID: \"b1b6b814-d694-4ab4-a6c2-8ed8687507b8\") " pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:24:57.506632 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.506591    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wh8w\" (UniqueName: \"kubernetes.io/projected/b1b6b814-d694-4ab4-a6c2-8ed8687507b8-kube-api-access-8wh8w\") pod \"authorino-operator-68d88948d8-l7dpz\" (UID: \"b1b6b814-d694-4ab4-a6c2-8ed8687507b8\") " pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:24:57.519215 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.519187    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wh8w\" (UniqueName: \"kubernetes.io/projected/b1b6b814-d694-4ab4-a6c2-8ed8687507b8-kube-api-access-8wh8w\") pod \"authorino-operator-68d88948d8-l7dpz\" (UID: \"b1b6b814-d694-4ab4-a6c2-8ed8687507b8\") " pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:24:57.623988 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:57.623919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:24:59.022023 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:59.022000    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-l7dpz"]
Sep 06 12:24:59.023480 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:24:59.023447    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b6b814_d694_4ab4_a6c2_8ed8687507b8.slice/crio-9c2aacf606f9b523970e5812d5999310a75ad7f8ab3a9979b11863033581e25c WatchSource:0}: Error finding container 9c2aacf606f9b523970e5812d5999310a75ad7f8ab3a9979b11863033581e25c: Status 404 returned error can't find the container with id 9c2aacf606f9b523970e5812d5999310a75ad7f8ab3a9979b11863033581e25c
Sep 06 12:24:59.788912 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:59.788870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6" event={"ID":"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805","Type":"ContainerStarted","Data":"a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e"}
Sep 06 12:24:59.789097 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:59.789046    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:24:59.795219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:59.791305    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz" event={"ID":"b1b6b814-d694-4ab4-a6c2-8ed8687507b8","Type":"ContainerStarted","Data":"9c2aacf606f9b523970e5812d5999310a75ad7f8ab3a9979b11863033581e25c"}
Sep 06 12:24:59.813263 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:24:59.813185    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6" podStartSLOduration=2.205822387 podStartE2EDuration="5.813166815s" totalImagesPullingTime="3.607344428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:24:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:24:59.811269183 +0000 UTC m=+441.624693266" watchObservedRunningTime="2026-09-06 12:24:59.813166815 +0000 UTC m=+441.626590889"
Sep 06 12:25:00.798284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:00.798250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz" event={"ID":"b1b6b814-d694-4ab4-a6c2-8ed8687507b8","Type":"ContainerStarted","Data":"475e4a1005fd5c66dc516972f61e8c6207a0d2837ce42416ece796febcea3d0e"}
Sep 06 12:25:00.798676 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:00.798529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:25:00.814857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:00.814811    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz" podStartSLOduration=2.403705237 podStartE2EDuration="3.814796393s" totalImagesPullingTime="1.411091156s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:25:00.813303377 +0000 UTC m=+442.626727466" watchObservedRunningTime="2026-09-06 12:25:00.814796393 +0000 UTC m=+442.628220471"
Sep 06 12:25:01.385464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.385433    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"]
Sep 06 12:25:01.391841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.391819    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.394115 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.394082    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 06 12:25:01.394294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.394268    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-qztpv\""
Sep 06 12:25:01.394410 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.394343    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 06 12:25:01.395772 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.395739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"]
Sep 06 12:25:01.439005 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.438978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/06aad8dc-bac1-4c34-adc4-7c8971515478-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.439103 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.439034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v95gd\" (UniqueName: \"kubernetes.io/projected/06aad8dc-bac1-4c34-adc4-7c8971515478-kube-api-access-v95gd\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.439103 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.439100    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/06aad8dc-bac1-4c34-adc4-7c8971515478-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.539699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.539670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/06aad8dc-bac1-4c34-adc4-7c8971515478-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.539814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.539711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/06aad8dc-bac1-4c34-adc4-7c8971515478-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.539814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.539754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v95gd\" (UniqueName: \"kubernetes.io/projected/06aad8dc-bac1-4c34-adc4-7c8971515478-kube-api-access-v95gd\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.540383 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.540360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/06aad8dc-bac1-4c34-adc4-7c8971515478-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.542032 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.542011    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/06aad8dc-bac1-4c34-adc4-7c8971515478-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.548620 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.548600    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v95gd\" (UniqueName: \"kubernetes.io/projected/06aad8dc-bac1-4c34-adc4-7c8971515478-kube-api-access-v95gd\") pod \"kuadrant-console-plugin-598f86468b-hmtf4\" (UID: \"06aad8dc-bac1-4c34-adc4-7c8971515478\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.702896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.702871    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"
Sep 06 12:25:01.970796 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:01.970770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4"]
Sep 06 12:25:01.971428 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:25:01.971400    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod06aad8dc_bac1_4c34_adc4_7c8971515478.slice/crio-d956d77ff4d0ce66aeed4d31554baac64890a808aead94a2dc73f48bddcc35cf WatchSource:0}: Error finding container d956d77ff4d0ce66aeed4d31554baac64890a808aead94a2dc73f48bddcc35cf: Status 404 returned error can't find the container with id d956d77ff4d0ce66aeed4d31554baac64890a808aead94a2dc73f48bddcc35cf
Sep 06 12:25:02.745804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:02.745763    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:02.813195 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:02.813138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4" event={"ID":"06aad8dc-bac1-4c34-adc4-7c8971515478","Type":"ContainerStarted","Data":"d956d77ff4d0ce66aeed4d31554baac64890a808aead94a2dc73f48bddcc35cf"}
Sep 06 12:25:04.758668 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:04.758633    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-vqt2h"
Sep 06 12:25:06.845279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:06.845247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4" event={"ID":"06aad8dc-bac1-4c34-adc4-7c8971515478","Type":"ContainerStarted","Data":"a444c938d34a65ef15c6fc3770f0b7438fd9944c3ad871270e8c44c9d2e74023"}
Sep 06 12:25:06.863754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:06.863710    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-hmtf4" podStartSLOduration=1.528485072 podStartE2EDuration="5.86369682s" totalImagesPullingTime="4.335211748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:25:06.862297372 +0000 UTC m=+448.675721455" watchObservedRunningTime="2026-09-06 12:25:06.86369682 +0000 UTC m=+448.677120898"
Sep 06 12:25:10.801083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:10.801049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:11.804385 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:11.804357    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-l7dpz"
Sep 06 12:25:12.159756 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.159683    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"]
Sep 06 12:25:12.163657 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.163638    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.183335 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.183279    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"]
Sep 06 12:25:12.225396 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.225374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw8j9\" (UniqueName: \"kubernetes.io/projected/6b1135c0-8f62-42c6-b477-4434cff6708d-kube-api-access-xw8j9\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.225497 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.225430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b1135c0-8f62-42c6-b477-4434cff6708d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.325918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.325894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw8j9\" (UniqueName: \"kubernetes.io/projected/6b1135c0-8f62-42c6-b477-4434cff6708d-kube-api-access-xw8j9\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.326020 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.325960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b1135c0-8f62-42c6-b477-4434cff6708d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.326339 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.326320    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b1135c0-8f62-42c6-b477-4434cff6708d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.336219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.336192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw8j9\" (UniqueName: \"kubernetes.io/projected/6b1135c0-8f62-42c6-b477-4434cff6708d-kube-api-access-xw8j9\") pod \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.473294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.473270    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:12.755280 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.755256    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"]
Sep 06 12:25:12.756942 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:25:12.756912    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b1135c0_8f62_42c6_b477_4434cff6708d.slice/crio-b5b19172782dceca7b80c16e0c1c297182efd5a9c670d961194f7bdee4256ea1 WatchSource:0}: Error finding container b5b19172782dceca7b80c16e0c1c297182efd5a9c670d961194f7bdee4256ea1: Status 404 returned error can't find the container with id b5b19172782dceca7b80c16e0c1c297182efd5a9c670d961194f7bdee4256ea1
Sep 06 12:25:12.796452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.796428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"]
Sep 06 12:25:12.796628 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.796589    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" containerName="manager" containerID="cri-o://a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e" gracePeriod=2
Sep 06 12:25:12.807703 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.807683    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"]
Sep 06 12:25:12.813630 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:12.813598    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-vfxw6\": pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:12.816125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.816101    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"]
Sep 06 12:25:12.820329 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.820306    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"]
Sep 06 12:25:12.820839 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.820824    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" containerName="manager"
Sep 06 12:25:12.820899 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.820843    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" containerName="manager"
Sep 06 12:25:12.820952 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.820947    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" containerName="manager"
Sep 06 12:25:12.824185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.824167    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:12.826311 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:12.826283    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:12.839897 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.839877    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"]
Sep 06 12:25:12.844543 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.844523    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"]
Sep 06 12:25:12.871432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.871408    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"]
Sep 06 12:25:12.871625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.871589    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" containerName="manager" containerID="cri-o://ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818" gracePeriod=2
Sep 06 12:25:12.880827 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.880805    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"]
Sep 06 12:25:12.882237 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:12.882211    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d0d3f643-946f-4cf9-b2a2-149981a25b63\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-cs6sb\": pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:12.885283 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:12.885251    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:12.922909 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.922882    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"]
Sep 06 12:25:12.923442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.923426    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" containerName="manager"
Sep 06 12:25:12.923498 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.923445    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" containerName="manager"
Sep 06 12:25:12.923498 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.923480    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" containerName="manager"
Sep 06 12:25:12.923498 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.923490    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" containerName="manager"
Sep 06 12:25:12.923593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.923568    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" containerName="manager"
Sep 06 12:25:12.923593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.923579    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" containerName="manager"
Sep 06 12:25:12.926767 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.926747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:12.929554 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:12.929528    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:12.931132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.931112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7b30e54-ca94-4281-8e36-7fd007817839-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8nhk\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:12.931251 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.931236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9l24\" (UniqueName: \"kubernetes.io/projected/a7b30e54-ca94-4281-8e36-7fd007817839-kube-api-access-p9l24\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8nhk\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:12.931784 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:12.931743    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:12.952985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:12.952965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"]
Sep 06 12:25:13.031867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.031783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9l24\" (UniqueName: \"kubernetes.io/projected/a7b30e54-ca94-4281-8e36-7fd007817839-kube-api-access-p9l24\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8nhk\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:13.031867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.031834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7b30e54-ca94-4281-8e36-7fd007817839-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8nhk\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:13.032076 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.031870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhmwd\" (UniqueName: \"kubernetes.io/projected/7116e89e-63a5-4a93-abc3-6abcb57a3c87-kube-api-access-vhmwd\") pod \"limitador-operator-controller-manager-6c549b6d85-fmlzj\" (UID: \"7116e89e-63a5-4a93-abc3-6abcb57a3c87\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:13.032329 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.032296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7b30e54-ca94-4281-8e36-7fd007817839-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8nhk\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:13.048667 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.048642    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9l24\" (UniqueName: \"kubernetes.io/projected/a7b30e54-ca94-4281-8e36-7fd007817839-kube-api-access-p9l24\") pod \"kuadrant-operator-controller-manager-58fc56757c-t8nhk\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:13.109834 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.109812    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.111886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.111869    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.111968 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.111946    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.113760 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.113739    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.115551 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.115530    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.117357 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.117338    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.132727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.132705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhmwd\" (UniqueName: \"kubernetes.io/projected/7116e89e-63a5-4a93-abc3-6abcb57a3c87-kube-api-access-vhmwd\") pod \"limitador-operator-controller-manager-6c549b6d85-fmlzj\" (UID: \"7116e89e-63a5-4a93-abc3-6abcb57a3c87\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:13.140768 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.140742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhmwd\" (UniqueName: \"kubernetes.io/projected/7116e89e-63a5-4a93-abc3-6abcb57a3c87-kube-api-access-vhmwd\") pod \"limitador-operator-controller-manager-6c549b6d85-fmlzj\" (UID: \"7116e89e-63a5-4a93-abc3-6abcb57a3c87\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:13.233482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.233462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t8lqj\" (UniqueName: \"kubernetes.io/projected/d0d3f643-946f-4cf9-b2a2-149981a25b63-kube-api-access-t8lqj\") pod \"d0d3f643-946f-4cf9-b2a2-149981a25b63\" (UID: \"d0d3f643-946f-4cf9-b2a2-149981a25b63\") "
Sep 06 12:25:13.233568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.233510    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-extensions-socket-volume\") pod \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") "
Sep 06 12:25:13.233568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.233531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlnlr\" (UniqueName: \"kubernetes.io/projected/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-kube-api-access-hlnlr\") pod \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\" (UID: \"cdbdf7f9-1e7e-48cf-93b0-232ce9c46805\") "
Sep 06 12:25:13.233981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.233954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" (UID: "cdbdf7f9-1e7e-48cf-93b0-232ce9c46805"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:25:13.235422 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.235401    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0d3f643-946f-4cf9-b2a2-149981a25b63-kube-api-access-t8lqj" (OuterVolumeSpecName: "kube-api-access-t8lqj") pod "d0d3f643-946f-4cf9-b2a2-149981a25b63" (UID: "d0d3f643-946f-4cf9-b2a2-149981a25b63"). InnerVolumeSpecName "kube-api-access-t8lqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:25:13.235564 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.235544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-kube-api-access-hlnlr" (OuterVolumeSpecName: "kube-api-access-hlnlr") pod "cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" (UID: "cdbdf7f9-1e7e-48cf-93b0-232ce9c46805"). InnerVolumeSpecName "kube-api-access-hlnlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:25:13.240677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.240660    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:13.246528 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.246509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:13.334368 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.334342    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t8lqj\" (UniqueName: \"kubernetes.io/projected/d0d3f643-946f-4cf9-b2a2-149981a25b63-kube-api-access-t8lqj\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:13.334456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.334372    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-extensions-socket-volume\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:13.334456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.334384    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlnlr\" (UniqueName: \"kubernetes.io/projected/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805-kube-api-access-hlnlr\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:13.517195 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.517165    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"]
Sep 06 12:25:13.519631 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:25:13.519597    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7116e89e_63a5_4a93_abc3_6abcb57a3c87.slice/crio-93b4fd41e6b877196b3cddb2b103f46607c87c5a5da25067731860030cf31ba9 WatchSource:0}: Error finding container 93b4fd41e6b877196b3cddb2b103f46607c87c5a5da25067731860030cf31ba9: Status 404 returned error can't find the container with id 93b4fd41e6b877196b3cddb2b103f46607c87c5a5da25067731860030cf31ba9
Sep 06 12:25:13.521744 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.521722    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"]
Sep 06 12:25:13.523021 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:25:13.523002    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b30e54_ca94_4281_8e36_7fd007817839.slice/crio-75935c1af2c0f0b1b6d870cc58b349dbb3f3036a47f96ee640dee981379994a9 WatchSource:0}: Error finding container 75935c1af2c0f0b1b6d870cc58b349dbb3f3036a47f96ee640dee981379994a9: Status 404 returned error can't find the container with id 75935c1af2c0f0b1b6d870cc58b349dbb3f3036a47f96ee640dee981379994a9
Sep 06 12:25:13.887505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.887422    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" containerName="manager" containerID="cri-o://f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59" gracePeriod=2
Sep 06 12:25:13.888900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.888873    2578 generic.go:356] "Generic (PLEG): container finished" podID="d0d3f643-946f-4cf9-b2a2-149981a25b63" containerID="ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818" exitCode=0
Sep 06 12:25:13.889044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.888919    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.889044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.888975    2578 scope.go:117] "RemoveContainer" containerID="ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818"
Sep 06 12:25:13.889719 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.889688    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.890990 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.890963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk" event={"ID":"a7b30e54-ca94-4281-8e36-7fd007817839","Type":"ContainerStarted","Data":"44f5b0fc75b78aeecb8af4389ac4677d4fe6870d378b4e95da44381c5c3664a7"}
Sep 06 12:25:13.891110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.891019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk" event={"ID":"a7b30e54-ca94-4281-8e36-7fd007817839","Type":"ContainerStarted","Data":"75935c1af2c0f0b1b6d870cc58b349dbb3f3036a47f96ee640dee981379994a9"}
Sep 06 12:25:13.891110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.891102    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:13.892050 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.891640    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:13.892858 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.892837    2578 generic.go:356] "Generic (PLEG): container finished" podID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" containerID="a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e" exitCode=0
Sep 06 12:25:13.892956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.892884    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.893416 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.893391    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.895091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.895063    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj" event={"ID":"7116e89e-63a5-4a93-abc3-6abcb57a3c87","Type":"ContainerStarted","Data":"49b0b027fb6c268853a4bd6461b0f70ba5035f6349d9f044123307d91c99ed57"}
Sep 06 12:25:13.895209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.895115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj" event={"ID":"7116e89e-63a5-4a93-abc3-6abcb57a3c87","Type":"ContainerStarted","Data":"93b4fd41e6b877196b3cddb2b103f46607c87c5a5da25067731860030cf31ba9"}
Sep 06 12:25:13.895209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.895185    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:13.895343 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.895139    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:13.897055 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.897029    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.898970 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.898947    2578 scope.go:117] "RemoveContainer" containerID="ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818"
Sep 06 12:25:13.899300 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.899270    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.899393 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.899373    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818\": container with ID starting with ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818 not found: ID does not exist" containerID="ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818"
Sep 06 12:25:13.899548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.899404    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818"} err="failed to get container status \"ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818\": rpc error: code = NotFound desc = could not find container \"ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818\": container with ID starting with ef81987d9dffd3529e143647674349f03a70e27f6ef0a53b50390b3125095818 not found: ID does not exist"
Sep 06 12:25:13.899548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.899427    2578 scope.go:117] "RemoveContainer" containerID="a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e"
Sep 06 12:25:13.925969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.925933    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk" podStartSLOduration=1.92591947 podStartE2EDuration="1.92591947s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:25:13.924657879 +0000 UTC m=+455.738081956" watchObservedRunningTime="2026-09-06 12:25:13.92591947 +0000 UTC m=+455.739343550"
Sep 06 12:25:13.943704 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.943683    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:13.943891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.943859    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj" podStartSLOduration=1.943847211 podStartE2EDuration="1.943847211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:25:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:25:13.9415024 +0000 UTC m=+455.754926479" watchObservedRunningTime="2026-09-06 12:25:13.943847211 +0000 UTC m=+455.757271289"
Sep 06 12:25:13.945452 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.945424    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.947217 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.947198    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.960803 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.960777    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:13.962711 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.962686    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:13.964481 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.964459    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:13.999031 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.999013    2578 scope.go:117] "RemoveContainer" containerID="a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e"
Sep 06 12:25:13.999355 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:13.999338    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e\": container with ID starting with a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e not found: ID does not exist" containerID="a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e"
Sep 06 12:25:13.999430 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:13.999362    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e"} err="failed to get container status \"a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e\": rpc error: code = NotFound desc = could not find container \"a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e\": container with ID starting with a27e31a020c0a7dd57fd496b09c1bd5e2b6a4b1d29ea91ff33621c921fd3b21e not found: ID does not exist"
Sep 06 12:25:14.113572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.113539    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:14.115730 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:14.115705    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:14.117658 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:14.117634    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-cs6sb\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-cs6sb"
Sep 06 12:25:14.119431 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:14.119411    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-vfxw6\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-vfxw6"
Sep 06 12:25:14.240914 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.240894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b1135c0-8f62-42c6-b477-4434cff6708d-extensions-socket-volume\") pod \"6b1135c0-8f62-42c6-b477-4434cff6708d\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") "
Sep 06 12:25:14.241010 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.240948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw8j9\" (UniqueName: \"kubernetes.io/projected/6b1135c0-8f62-42c6-b477-4434cff6708d-kube-api-access-xw8j9\") pod \"6b1135c0-8f62-42c6-b477-4434cff6708d\" (UID: \"6b1135c0-8f62-42c6-b477-4434cff6708d\") "
Sep 06 12:25:14.241191 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.241143    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b1135c0-8f62-42c6-b477-4434cff6708d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6b1135c0-8f62-42c6-b477-4434cff6708d" (UID: "6b1135c0-8f62-42c6-b477-4434cff6708d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:25:14.242962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.242937    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b1135c0-8f62-42c6-b477-4434cff6708d-kube-api-access-xw8j9" (OuterVolumeSpecName: "kube-api-access-xw8j9") pod "6b1135c0-8f62-42c6-b477-4434cff6708d" (UID: "6b1135c0-8f62-42c6-b477-4434cff6708d"). InnerVolumeSpecName "kube-api-access-xw8j9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:25:14.342019 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.341995    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw8j9\" (UniqueName: \"kubernetes.io/projected/6b1135c0-8f62-42c6-b477-4434cff6708d-kube-api-access-xw8j9\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:14.342019 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.342019    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6b1135c0-8f62-42c6-b477-4434cff6708d-extensions-socket-volume\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:14.668311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.668240    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" path="/var/lib/kubelet/pods/6b1135c0-8f62-42c6-b477-4434cff6708d/volumes"
Sep 06 12:25:14.668588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.668574    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdbdf7f9-1e7e-48cf-93b0-232ce9c46805" path="/var/lib/kubelet/pods/cdbdf7f9-1e7e-48cf-93b0-232ce9c46805/volumes"
Sep 06 12:25:14.668862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.668843    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0d3f643-946f-4cf9-b2a2-149981a25b63" path="/var/lib/kubelet/pods/d0d3f643-946f-4cf9-b2a2-149981a25b63/volumes"
Sep 06 12:25:14.905316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.905288    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b1135c0-8f62-42c6-b477-4434cff6708d" containerID="f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59" exitCode=2
Sep 06 12:25:14.905661 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.905331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:14.905661 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.905386    2578 scope.go:117] "RemoveContainer" containerID="f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59"
Sep 06 12:25:14.909636 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:14.909613    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-8nxh4\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="6b1135c0-8f62-42c6-b477-4434cff6708d" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-8nxh4"
Sep 06 12:25:14.913964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.913947    2578 scope.go:117] "RemoveContainer" containerID="f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59"
Sep 06 12:25:14.914218 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:25:14.914195    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59\": container with ID starting with f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59 not found: ID does not exist" containerID="f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59"
Sep 06 12:25:14.914301 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:14.914222    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59"} err="failed to get container status \"f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59\": rpc error: code = NotFound desc = could not find container \"f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59\": container with ID starting with f9b16ff5b4d5c34d744a4def4ceb7affa3ab9d92fbb67716e66bca7b4770de59 not found: ID does not exist"
Sep 06 12:25:24.907129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:24.907098    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:24.907614 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:24.907197    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-fmlzj"
Sep 06 12:25:28.863491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:28.863454    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"]
Sep 06 12:25:28.864003 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:28.863897    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk" podUID="a7b30e54-ca94-4281-8e36-7fd007817839" containerName="manager" containerID="cri-o://44f5b0fc75b78aeecb8af4389ac4677d4fe6870d378b4e95da44381c5c3664a7" gracePeriod=10
Sep 06 12:25:28.981841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:28.981814    2578 generic.go:356] "Generic (PLEG): container finished" podID="a7b30e54-ca94-4281-8e36-7fd007817839" containerID="44f5b0fc75b78aeecb8af4389ac4677d4fe6870d378b4e95da44381c5c3664a7" exitCode=0
Sep 06 12:25:28.981902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:28.981878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk" event={"ID":"a7b30e54-ca94-4281-8e36-7fd007817839","Type":"ContainerDied","Data":"44f5b0fc75b78aeecb8af4389ac4677d4fe6870d378b4e95da44381c5c3664a7"}
Sep 06 12:25:29.075364 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.075329    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"]
Sep 06 12:25:29.079874 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.079854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.091985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.091964    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"]
Sep 06 12:25:29.116092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.116038    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:29.154818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.154790    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e01e58-9b88-4df8-9116-0e8c0b831f98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z57pv\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.154905 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.154824    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2vqp\" (UniqueName: \"kubernetes.io/projected/69e01e58-9b88-4df8-9116-0e8c0b831f98-kube-api-access-b2vqp\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z57pv\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.255667 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.255643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9l24\" (UniqueName: \"kubernetes.io/projected/a7b30e54-ca94-4281-8e36-7fd007817839-kube-api-access-p9l24\") pod \"a7b30e54-ca94-4281-8e36-7fd007817839\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") "
Sep 06 12:25:29.255754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.255711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7b30e54-ca94-4281-8e36-7fd007817839-extensions-socket-volume\") pod \"a7b30e54-ca94-4281-8e36-7fd007817839\" (UID: \"a7b30e54-ca94-4281-8e36-7fd007817839\") "
Sep 06 12:25:29.255837 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.255823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e01e58-9b88-4df8-9116-0e8c0b831f98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z57pv\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.255873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.255847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2vqp\" (UniqueName: \"kubernetes.io/projected/69e01e58-9b88-4df8-9116-0e8c0b831f98-kube-api-access-b2vqp\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z57pv\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.256077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.256048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b30e54-ca94-4281-8e36-7fd007817839-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a7b30e54-ca94-4281-8e36-7fd007817839" (UID: "a7b30e54-ca94-4281-8e36-7fd007817839"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:25:29.256220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.256186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e01e58-9b88-4df8-9116-0e8c0b831f98-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z57pv\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.257791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.257765    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b30e54-ca94-4281-8e36-7fd007817839-kube-api-access-p9l24" (OuterVolumeSpecName: "kube-api-access-p9l24") pod "a7b30e54-ca94-4281-8e36-7fd007817839" (UID: "a7b30e54-ca94-4281-8e36-7fd007817839"). InnerVolumeSpecName "kube-api-access-p9l24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:25:29.265829 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.265808    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2vqp\" (UniqueName: \"kubernetes.io/projected/69e01e58-9b88-4df8-9116-0e8c0b831f98-kube-api-access-b2vqp\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-z57pv\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.357022 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.357004    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9l24\" (UniqueName: \"kubernetes.io/projected/a7b30e54-ca94-4281-8e36-7fd007817839-kube-api-access-p9l24\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:29.357022 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.357023    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a7b30e54-ca94-4281-8e36-7fd007817839-extensions-socket-volume\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:25:29.391534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.391476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:29.666179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.666132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"]
Sep 06 12:25:29.668007 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:25:29.667981    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69e01e58_9b88_4df8_9116_0e8c0b831f98.slice/crio-6a586c3afa9206e900c0d0cf84a69ed3b36be63b926bdef01e71652b8e4ea9e9 WatchSource:0}: Error finding container 6a586c3afa9206e900c0d0cf84a69ed3b36be63b926bdef01e71652b8e4ea9e9: Status 404 returned error can't find the container with id 6a586c3afa9206e900c0d0cf84a69ed3b36be63b926bdef01e71652b8e4ea9e9
Sep 06 12:25:29.988563 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.988535    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"
Sep 06 12:25:29.988935 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.988571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk" event={"ID":"a7b30e54-ca94-4281-8e36-7fd007817839","Type":"ContainerDied","Data":"75935c1af2c0f0b1b6d870cc58b349dbb3f3036a47f96ee640dee981379994a9"}
Sep 06 12:25:29.988935 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.988633    2578 scope.go:117] "RemoveContainer" containerID="44f5b0fc75b78aeecb8af4389ac4677d4fe6870d378b4e95da44381c5c3664a7"
Sep 06 12:25:29.990592 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.990566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv" event={"ID":"69e01e58-9b88-4df8-9116-0e8c0b831f98","Type":"ContainerStarted","Data":"dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393"}
Sep 06 12:25:29.990727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.990613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv" event={"ID":"69e01e58-9b88-4df8-9116-0e8c0b831f98","Type":"ContainerStarted","Data":"6a586c3afa9206e900c0d0cf84a69ed3b36be63b926bdef01e71652b8e4ea9e9"}
Sep 06 12:25:29.990727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:29.990644    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:30.012264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:30.012059    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv" podStartSLOduration=1.012043909 podStartE2EDuration="1.012043909s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:25:30.010892199 +0000 UTC m=+471.824316272" watchObservedRunningTime="2026-09-06 12:25:30.012043909 +0000 UTC m=+471.825467990"
Sep 06 12:25:30.025600 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:30.025579    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"]
Sep 06 12:25:30.029068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:30.029047    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-t8nhk"]
Sep 06 12:25:30.668643 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:30.668606    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7b30e54-ca94-4281-8e36-7fd007817839" path="/var/lib/kubelet/pods/a7b30e54-ca94-4281-8e36-7fd007817839/volumes"
Sep 06 12:25:41.000034 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:40.999999    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:25:45.143754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.143713    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"]
Sep 06 12:25:45.144270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.144251    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b30e54-ca94-4281-8e36-7fd007817839" containerName="manager"
Sep 06 12:25:45.144327 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.144273    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b30e54-ca94-4281-8e36-7fd007817839" containerName="manager"
Sep 06 12:25:45.144406 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.144394    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b30e54-ca94-4281-8e36-7fd007817839" containerName="manager"
Sep 06 12:25:45.168060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.168032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"]
Sep 06 12:25:45.168212 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.168137    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.170433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.170410    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-wb7j2\""
Sep 06 12:25:45.170641 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.170626    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 06 12:25:45.278271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27607480-a933-4b89-8a08-4524be8d55d6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qzc7\" (UniqueName: \"kubernetes.io/projected/27607480-a933-4b89-8a08-4524be8d55d6-kube-api-access-2qzc7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278390    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278652 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27607480-a933-4b89-8a08-4524be8d55d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.278652 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.278551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27607480-a933-4b89-8a08-4524be8d55d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27607480-a933-4b89-8a08-4524be8d55d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27607480-a933-4b89-8a08-4524be8d55d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27607480-a933-4b89-8a08-4524be8d55d6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379555 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qzc7\" (UniqueName: \"kubernetes.io/projected/27607480-a933-4b89-8a08-4524be8d55d6-kube-api-access-2qzc7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-istio-data\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379573    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-credential-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-workload-socket\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.379788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-workload-certs\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.380021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.379998    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/27607480-a933-4b89-8a08-4524be8d55d6-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.381736 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.381709    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/27607480-a933-4b89-8a08-4524be8d55d6-istio-envoy\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.381837 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.381818    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/27607480-a933-4b89-8a08-4524be8d55d6-istio-podinfo\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.386961 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.386936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qzc7\" (UniqueName: \"kubernetes.io/projected/27607480-a933-4b89-8a08-4524be8d55d6-kube-api-access-2qzc7\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.387044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.386986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/27607480-a933-4b89-8a08-4524be8d55d6-istio-token\") pod \"maas-default-gateway-openshift-default-78bb78ff78-jkksr\" (UID: \"27607480-a933-4b89-8a08-4524be8d55d6\") " pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.478839 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.478817    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:45.762115 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:45.762091    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"]
Sep 06 12:25:45.764046 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:25:45.764015    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27607480_a933_4b89_8a08_4524be8d55d6.slice/crio-c33540732b99d4a4375c7724e5afde12e42574fc6b5d3adb3f760009a7e0807c WatchSource:0}: Error finding container c33540732b99d4a4375c7724e5afde12e42574fc6b5d3adb3f760009a7e0807c: Status 404 returned error can't find the container with id c33540732b99d4a4375c7724e5afde12e42574fc6b5d3adb3f760009a7e0807c
Sep 06 12:25:46.089761 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:46.089676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" event={"ID":"27607480-a933-4b89-8a08-4524be8d55d6","Type":"ContainerStarted","Data":"c33540732b99d4a4375c7724e5afde12e42574fc6b5d3adb3f760009a7e0807c"}
Sep 06 12:25:48.565442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:48.565405    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:25:48.565717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:48.565479    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:25:48.565717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:48.565508    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:25:49.109194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:49.109159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" event={"ID":"27607480-a933-4b89-8a08-4524be8d55d6","Type":"ContainerStarted","Data":"47a020f36d7c66abfb635166271f814d422ff087e477f6ac0f860b4b09a30b70"}
Sep 06 12:25:49.129666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:49.129615    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" podStartSLOduration=1.331064419 podStartE2EDuration="4.129600903s" totalImagesPullingTime="2.798536484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:25:49.127691746 +0000 UTC m=+490.941115827" watchObservedRunningTime="2026-09-06 12:25:49.129600903 +0000 UTC m=+490.943024982"
Sep 06 12:25:49.479346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:49.479316    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:49.483981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:49.483959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:50.114693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:50.114661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:25:50.115699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:25:50.115680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:26:00.379068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.379033    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:26:00.382942 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.382919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.385724 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.385703    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 06 12:26:00.391550 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.391524    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:26:00.404915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.404890    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2m6h\" (UniqueName: \"kubernetes.io/projected/94515263-e3fd-4ec8-bfc1-af7f5700f406-kube-api-access-x2m6h\") pod \"limitador-limitador-85d9db4d5d-tngqp\" (UID: \"94515263-e3fd-4ec8-bfc1-af7f5700f406\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.405021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.404990    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94515263-e3fd-4ec8-bfc1-af7f5700f406-config-file\") pod \"limitador-limitador-85d9db4d5d-tngqp\" (UID: \"94515263-e3fd-4ec8-bfc1-af7f5700f406\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.417970 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.417941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:26:00.506340 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.506315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94515263-e3fd-4ec8-bfc1-af7f5700f406-config-file\") pod \"limitador-limitador-85d9db4d5d-tngqp\" (UID: \"94515263-e3fd-4ec8-bfc1-af7f5700f406\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.506437 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.506350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2m6h\" (UniqueName: \"kubernetes.io/projected/94515263-e3fd-4ec8-bfc1-af7f5700f406-kube-api-access-x2m6h\") pod \"limitador-limitador-85d9db4d5d-tngqp\" (UID: \"94515263-e3fd-4ec8-bfc1-af7f5700f406\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.506965 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.506948    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/94515263-e3fd-4ec8-bfc1-af7f5700f406-config-file\") pod \"limitador-limitador-85d9db4d5d-tngqp\" (UID: \"94515263-e3fd-4ec8-bfc1-af7f5700f406\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.531713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.531684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2m6h\" (UniqueName: \"kubernetes.io/projected/94515263-e3fd-4ec8-bfc1-af7f5700f406-kube-api-access-x2m6h\") pod \"limitador-limitador-85d9db4d5d-tngqp\" (UID: \"94515263-e3fd-4ec8-bfc1-af7f5700f406\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.693879 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.693852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:00.822709 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.822679    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-b54df94b4-chz9k"]
Sep 06 12:26:00.827499 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.827473    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:00.829795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.829771    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4j2v\""
Sep 06 12:26:00.829883 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.829864    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-chz9k"]
Sep 06 12:26:00.909466 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.909439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhd26\" (UniqueName: \"kubernetes.io/projected/422a36f4-330a-4de6-a786-d5ed93a7b486-kube-api-access-vhd26\") pod \"authorino-b54df94b4-chz9k\" (UID: \"422a36f4-330a-4de6-a786-d5ed93a7b486\") " pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:00.963468 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:00.963449    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:26:00.965681 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:26:00.965657    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94515263_e3fd_4ec8_bfc1_af7f5700f406.slice/crio-98dd6f604a9f3fe64b0582a64191dacaf48d10cfe4a37954549cf2e1db278370 WatchSource:0}: Error finding container 98dd6f604a9f3fe64b0582a64191dacaf48d10cfe4a37954549cf2e1db278370: Status 404 returned error can't find the container with id 98dd6f604a9f3fe64b0582a64191dacaf48d10cfe4a37954549cf2e1db278370
Sep 06 12:26:01.010214 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:01.010188    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhd26\" (UniqueName: \"kubernetes.io/projected/422a36f4-330a-4de6-a786-d5ed93a7b486-kube-api-access-vhd26\") pod \"authorino-b54df94b4-chz9k\" (UID: \"422a36f4-330a-4de6-a786-d5ed93a7b486\") " pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:01.017514 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:01.017495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhd26\" (UniqueName: \"kubernetes.io/projected/422a36f4-330a-4de6-a786-d5ed93a7b486-kube-api-access-vhd26\") pod \"authorino-b54df94b4-chz9k\" (UID: \"422a36f4-330a-4de6-a786-d5ed93a7b486\") " pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:01.138212 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:01.138188    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:01.176433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:01.176399    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp" event={"ID":"94515263-e3fd-4ec8-bfc1-af7f5700f406","Type":"ContainerStarted","Data":"98dd6f604a9f3fe64b0582a64191dacaf48d10cfe4a37954549cf2e1db278370"}
Sep 06 12:26:01.408763 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:01.408707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-b54df94b4-chz9k"]
Sep 06 12:26:01.411287 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:26:01.411259    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod422a36f4_330a_4de6_a786_d5ed93a7b486.slice/crio-b472a5e9df9af911471a9a6cc7813b5868a8d2da09a001ba76cf14dafb80f052 WatchSource:0}: Error finding container b472a5e9df9af911471a9a6cc7813b5868a8d2da09a001ba76cf14dafb80f052: Status 404 returned error can't find the container with id b472a5e9df9af911471a9a6cc7813b5868a8d2da09a001ba76cf14dafb80f052
Sep 06 12:26:02.183675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:02.183603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp" event={"ID":"94515263-e3fd-4ec8-bfc1-af7f5700f406","Type":"ContainerStarted","Data":"6c8bcec620047a4ac844f4b6c9a60d201c1338681b22b809a1d8fe8c3d9c4c08"}
Sep 06 12:26:02.183888 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:02.183755    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:02.184957 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:02.184930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-chz9k" event={"ID":"422a36f4-330a-4de6-a786-d5ed93a7b486","Type":"ContainerStarted","Data":"b472a5e9df9af911471a9a6cc7813b5868a8d2da09a001ba76cf14dafb80f052"}
Sep 06 12:26:02.199969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:02.199926    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp" podStartSLOduration=1.328935947 podStartE2EDuration="2.19991276s" totalImagesPullingTime="870.976813ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:26:02.198482727 +0000 UTC m=+504.011906806" watchObservedRunningTime="2026-09-06 12:26:02.19991276 +0000 UTC m=+504.013336876"
Sep 06 12:26:04.437933 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:04.437898    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-chz9k"]
Sep 06 12:26:06.212208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.212168    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-b54df94b4-chz9k" podUID="422a36f4-330a-4de6-a786-d5ed93a7b486" containerName="authorino" containerID="cri-o://1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46" gracePeriod=30
Sep 06 12:26:06.212208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.212186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-chz9k" event={"ID":"422a36f4-330a-4de6-a786-d5ed93a7b486","Type":"ContainerStarted","Data":"1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46"}
Sep 06 12:26:06.226137 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.226094    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-b54df94b4-chz9k" podStartSLOduration=1.761913808 podStartE2EDuration="6.226080571s" totalImagesPullingTime="4.464166763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:26:06.225284108 +0000 UTC m=+508.038708185" watchObservedRunningTime="2026-09-06 12:26:06.226080571 +0000 UTC m=+508.039504651"
Sep 06 12:26:06.464284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.464228    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:06.555529 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.555496    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhd26\" (UniqueName: \"kubernetes.io/projected/422a36f4-330a-4de6-a786-d5ed93a7b486-kube-api-access-vhd26\") pod \"422a36f4-330a-4de6-a786-d5ed93a7b486\" (UID: \"422a36f4-330a-4de6-a786-d5ed93a7b486\") "
Sep 06 12:26:06.557523 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.557489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/422a36f4-330a-4de6-a786-d5ed93a7b486-kube-api-access-vhd26" (OuterVolumeSpecName: "kube-api-access-vhd26") pod "422a36f4-330a-4de6-a786-d5ed93a7b486" (UID: "422a36f4-330a-4de6-a786-d5ed93a7b486"). InnerVolumeSpecName "kube-api-access-vhd26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:26:06.656086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:06.656058    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhd26\" (UniqueName: \"kubernetes.io/projected/422a36f4-330a-4de6-a786-d5ed93a7b486-kube-api-access-vhd26\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:26:07.218879 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.218841    2578 generic.go:356] "Generic (PLEG): container finished" podID="422a36f4-330a-4de6-a786-d5ed93a7b486" containerID="1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46" exitCode=0
Sep 06 12:26:07.218879 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.218883    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-b54df94b4-chz9k"
Sep 06 12:26:07.219333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.218905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-chz9k" event={"ID":"422a36f4-330a-4de6-a786-d5ed93a7b486","Type":"ContainerDied","Data":"1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46"}
Sep 06 12:26:07.219333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.218952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-b54df94b4-chz9k" event={"ID":"422a36f4-330a-4de6-a786-d5ed93a7b486","Type":"ContainerDied","Data":"b472a5e9df9af911471a9a6cc7813b5868a8d2da09a001ba76cf14dafb80f052"}
Sep 06 12:26:07.219333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.218969    2578 scope.go:117] "RemoveContainer" containerID="1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46"
Sep 06 12:26:07.227526 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.227508    2578 scope.go:117] "RemoveContainer" containerID="1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46"
Sep 06 12:26:07.227786 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:26:07.227768    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46\": container with ID starting with 1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46 not found: ID does not exist" containerID="1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46"
Sep 06 12:26:07.227855 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.227798    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46"} err="failed to get container status \"1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46\": rpc error: code = NotFound desc = could not find container \"1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46\": container with ID starting with 1ffc13f544fade1de3b27ac6a5a5ff075605a5773468ca02b7d8af39bba1aa46 not found: ID does not exist"
Sep 06 12:26:07.234377 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.234354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-b54df94b4-chz9k"]
Sep 06 12:26:07.236371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:07.236353    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-b54df94b4-chz9k"]
Sep 06 12:26:08.674595 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:08.674560    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="422a36f4-330a-4de6-a786-d5ed93a7b486" path="/var/lib/kubelet/pods/422a36f4-330a-4de6-a786-d5ed93a7b486/volumes"
Sep 06 12:26:13.190924 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:13.190894    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"
Sep 06 12:26:29.694915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.694874    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-k55jg"]
Sep 06 12:26:29.695399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.695330    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="422a36f4-330a-4de6-a786-d5ed93a7b486" containerName="authorino"
Sep 06 12:26:29.695399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.695344    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="422a36f4-330a-4de6-a786-d5ed93a7b486" containerName="authorino"
Sep 06 12:26:29.695523 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.695403    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="422a36f4-330a-4de6-a786-d5ed93a7b486" containerName="authorino"
Sep 06 12:26:29.703958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.703934    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-k55jg"]
Sep 06 12:26:29.704087 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.704013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:29.706348 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.706325    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j4j2v\""
Sep 06 12:26:29.830098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.830051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6cqvn\" (UniqueName: \"kubernetes.io/projected/4c6bc3e2-d532-4552-a54a-ef1870ed3d99-kube-api-access-6cqvn\") pod \"authorino-5dc7ccb5f-k55jg\" (UID: \"4c6bc3e2-d532-4552-a54a-ef1870ed3d99\") " pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:29.917722 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.917693    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-k55jg"]
Sep 06 12:26:29.917942 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:26:29.917923    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-6cqvn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-k55jg" podUID="4c6bc3e2-d532-4552-a54a-ef1870ed3d99"
Sep 06 12:26:29.931534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.931506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6cqvn\" (UniqueName: \"kubernetes.io/projected/4c6bc3e2-d532-4552-a54a-ef1870ed3d99-kube-api-access-6cqvn\") pod \"authorino-5dc7ccb5f-k55jg\" (UID: \"4c6bc3e2-d532-4552-a54a-ef1870ed3d99\") " pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:29.939217 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.939196    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6cqvn\" (UniqueName: \"kubernetes.io/projected/4c6bc3e2-d532-4552-a54a-ef1870ed3d99-kube-api-access-6cqvn\") pod \"authorino-5dc7ccb5f-k55jg\" (UID: \"4c6bc3e2-d532-4552-a54a-ef1870ed3d99\") " pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:29.943562 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.943536    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66d84884ff-hqbkm"]
Sep 06 12:26:29.948060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.948016    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:29.951210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:29.951186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66d84884ff-hqbkm"]
Sep 06 12:26:30.032632 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.032606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-clxj5\" (UniqueName: \"kubernetes.io/projected/c3f1108b-d9b8-41ff-849c-03ad8266ade6-kube-api-access-clxj5\") pod \"authorino-66d84884ff-hqbkm\" (UID: \"c3f1108b-d9b8-41ff-849c-03ad8266ade6\") " pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:30.133331 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.133306    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-clxj5\" (UniqueName: \"kubernetes.io/projected/c3f1108b-d9b8-41ff-849c-03ad8266ade6-kube-api-access-clxj5\") pod \"authorino-66d84884ff-hqbkm\" (UID: \"c3f1108b-d9b8-41ff-849c-03ad8266ade6\") " pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:30.140387 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.140367    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-clxj5\" (UniqueName: \"kubernetes.io/projected/c3f1108b-d9b8-41ff-849c-03ad8266ade6-kube-api-access-clxj5\") pod \"authorino-66d84884ff-hqbkm\" (UID: \"c3f1108b-d9b8-41ff-849c-03ad8266ade6\") " pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:30.258370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.258303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:30.337538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.337512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:30.345424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.345403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:30.436061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.436041    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6cqvn\" (UniqueName: \"kubernetes.io/projected/4c6bc3e2-d532-4552-a54a-ef1870ed3d99-kube-api-access-6cqvn\") pod \"4c6bc3e2-d532-4552-a54a-ef1870ed3d99\" (UID: \"4c6bc3e2-d532-4552-a54a-ef1870ed3d99\") "
Sep 06 12:26:30.438062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.438042    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c6bc3e2-d532-4552-a54a-ef1870ed3d99-kube-api-access-6cqvn" (OuterVolumeSpecName: "kube-api-access-6cqvn") pod "4c6bc3e2-d532-4552-a54a-ef1870ed3d99" (UID: "4c6bc3e2-d532-4552-a54a-ef1870ed3d99"). InnerVolumeSpecName "kube-api-access-6cqvn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:26:30.526972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.526951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66d84884ff-hqbkm"]
Sep 06 12:26:30.528583 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:26:30.528559    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3f1108b_d9b8_41ff_849c_03ad8266ade6.slice/crio-e93672c8bdc4cb63402a02d55debef9e57849476286a95447e7e575f9d3ed352 WatchSource:0}: Error finding container e93672c8bdc4cb63402a02d55debef9e57849476286a95447e7e575f9d3ed352: Status 404 returned error can't find the container with id e93672c8bdc4cb63402a02d55debef9e57849476286a95447e7e575f9d3ed352
Sep 06 12:26:30.536674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:30.536653    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6cqvn\" (UniqueName: \"kubernetes.io/projected/4c6bc3e2-d532-4552-a54a-ef1870ed3d99-kube-api-access-6cqvn\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:26:31.345872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.345841    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d84884ff-hqbkm" event={"ID":"c3f1108b-d9b8-41ff-849c-03ad8266ade6","Type":"ContainerStarted","Data":"5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45"}
Sep 06 12:26:31.346216 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.345887    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d84884ff-hqbkm" event={"ID":"c3f1108b-d9b8-41ff-849c-03ad8266ade6","Type":"ContainerStarted","Data":"e93672c8bdc4cb63402a02d55debef9e57849476286a95447e7e575f9d3ed352"}
Sep 06 12:26:31.346216 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.345855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-k55jg"
Sep 06 12:26:31.361067 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.361022    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66d84884ff-hqbkm" podStartSLOduration=1.634630971 podStartE2EDuration="2.361008588s" totalImagesPullingTime="726.377617ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:26:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:26:31.359574927 +0000 UTC m=+533.172999007" watchObservedRunningTime="2026-09-06 12:26:31.361008588 +0000 UTC m=+533.174432667"
Sep 06 12:26:31.382201 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.382165    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-k55jg"]
Sep 06 12:26:31.387420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.387381    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-k55jg"]
Sep 06 12:26:31.456695 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.456647    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-756bb66d97-frhg8"]
Sep 06 12:26:31.460562 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.460543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.462915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.462894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 06 12:26:31.465762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.465740    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-756bb66d97-frhg8"]
Sep 06 12:26:31.545691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.545621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42qxq\" (UniqueName: \"kubernetes.io/projected/d6b6695f-c338-4742-8d19-bc3eb7f99434-kube-api-access-42qxq\") pod \"authorino-756bb66d97-frhg8\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") " pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.545813 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.545708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6b6695f-c338-4742-8d19-bc3eb7f99434-tls-cert\") pod \"authorino-756bb66d97-frhg8\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") " pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.646082 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.646052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6b6695f-c338-4742-8d19-bc3eb7f99434-tls-cert\") pod \"authorino-756bb66d97-frhg8\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") " pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.646275 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.646123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42qxq\" (UniqueName: \"kubernetes.io/projected/d6b6695f-c338-4742-8d19-bc3eb7f99434-kube-api-access-42qxq\") pod \"authorino-756bb66d97-frhg8\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") " pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.648621 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.648599    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6b6695f-c338-4742-8d19-bc3eb7f99434-tls-cert\") pod \"authorino-756bb66d97-frhg8\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") " pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.653189 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.653141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42qxq\" (UniqueName: \"kubernetes.io/projected/d6b6695f-c338-4742-8d19-bc3eb7f99434-kube-api-access-42qxq\") pod \"authorino-756bb66d97-frhg8\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") " pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:31.771047 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:31.771023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:26:32.041279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:32.041253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-756bb66d97-frhg8"]
Sep 06 12:26:32.043425 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:26:32.043396    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6b6695f_c338_4742_8d19_bc3eb7f99434.slice/crio-af7dc6e3af1cc25d6f275e483e4107fb96f5b7ac9ce9184ffe154c9371f11e78 WatchSource:0}: Error finding container af7dc6e3af1cc25d6f275e483e4107fb96f5b7ac9ce9184ffe154c9371f11e78: Status 404 returned error can't find the container with id af7dc6e3af1cc25d6f275e483e4107fb96f5b7ac9ce9184ffe154c9371f11e78
Sep 06 12:26:32.352641 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:32.352606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756bb66d97-frhg8" event={"ID":"d6b6695f-c338-4742-8d19-bc3eb7f99434","Type":"ContainerStarted","Data":"af7dc6e3af1cc25d6f275e483e4107fb96f5b7ac9ce9184ffe154c9371f11e78"}
Sep 06 12:26:32.669203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:32.669101    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c6bc3e2-d532-4552-a54a-ef1870ed3d99" path="/var/lib/kubelet/pods/4c6bc3e2-d532-4552-a54a-ef1870ed3d99/volumes"
Sep 06 12:26:33.360007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.359966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756bb66d97-frhg8" event={"ID":"d6b6695f-c338-4742-8d19-bc3eb7f99434","Type":"ContainerStarted","Data":"32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe"}
Sep 06 12:26:33.375542 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.375496    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-756bb66d97-frhg8" podStartSLOduration=1.949010759 podStartE2EDuration="2.375482068s" totalImagesPullingTime="426.471309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:26:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:26:33.374322773 +0000 UTC m=+535.187746851" watchObservedRunningTime="2026-09-06 12:26:33.375482068 +0000 UTC m=+535.188906147"
Sep 06 12:26:33.398114 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.398042    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66d84884ff-hqbkm"]
Sep 06 12:26:33.398430 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.398265    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-66d84884ff-hqbkm" podUID="c3f1108b-d9b8-41ff-849c-03ad8266ade6" containerName="authorino" containerID="cri-o://5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45" gracePeriod=30
Sep 06 12:26:33.645781 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.645761    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:33.769610 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.769583    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-clxj5\" (UniqueName: \"kubernetes.io/projected/c3f1108b-d9b8-41ff-849c-03ad8266ade6-kube-api-access-clxj5\") pod \"c3f1108b-d9b8-41ff-849c-03ad8266ade6\" (UID: \"c3f1108b-d9b8-41ff-849c-03ad8266ade6\") "
Sep 06 12:26:33.771651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.771625    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f1108b-d9b8-41ff-849c-03ad8266ade6-kube-api-access-clxj5" (OuterVolumeSpecName: "kube-api-access-clxj5") pod "c3f1108b-d9b8-41ff-849c-03ad8266ade6" (UID: "c3f1108b-d9b8-41ff-849c-03ad8266ade6"). InnerVolumeSpecName "kube-api-access-clxj5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:26:33.870805 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:33.870779    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-clxj5\" (UniqueName: \"kubernetes.io/projected/c3f1108b-d9b8-41ff-849c-03ad8266ade6-kube-api-access-clxj5\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:26:34.366779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.366749    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3f1108b-d9b8-41ff-849c-03ad8266ade6" containerID="5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45" exitCode=0
Sep 06 12:26:34.367199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.366790    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66d84884ff-hqbkm"
Sep 06 12:26:34.367199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.366830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d84884ff-hqbkm" event={"ID":"c3f1108b-d9b8-41ff-849c-03ad8266ade6","Type":"ContainerDied","Data":"5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45"}
Sep 06 12:26:34.367199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.366869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66d84884ff-hqbkm" event={"ID":"c3f1108b-d9b8-41ff-849c-03ad8266ade6","Type":"ContainerDied","Data":"e93672c8bdc4cb63402a02d55debef9e57849476286a95447e7e575f9d3ed352"}
Sep 06 12:26:34.367199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.366890    2578 scope.go:117] "RemoveContainer" containerID="5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45"
Sep 06 12:26:34.395347 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.395315    2578 scope.go:117] "RemoveContainer" containerID="5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45"
Sep 06 12:26:34.395706 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:26:34.395667    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45\": container with ID starting with 5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45 not found: ID does not exist" containerID="5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45"
Sep 06 12:26:34.395821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.395713    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45"} err="failed to get container status \"5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45\": rpc error: code = NotFound desc = could not find container \"5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45\": container with ID starting with 5fcc3662fbe4216d312680330570fd64f339e071dfc94f81b744c952b72e9d45 not found: ID does not exist"
Sep 06 12:26:34.404640 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.404616    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-66d84884ff-hqbkm"]
Sep 06 12:26:34.408651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.408629    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-66d84884ff-hqbkm"]
Sep 06 12:26:34.669125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:26:34.669051    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f1108b-d9b8-41ff-849c-03ad8266ade6" path="/var/lib/kubelet/pods/c3f1108b-d9b8-41ff-849c-03ad8266ade6/volumes"
Sep 06 12:27:14.862701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:14.862666    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:27:24.637238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:24.637206    2578 generic.go:356] "Generic (PLEG): container finished" podID="27607480-a933-4b89-8a08-4524be8d55d6" containerID="47a020f36d7c66abfb635166271f814d422ff087e477f6ac0f860b4b09a30b70" exitCode=0
Sep 06 12:27:24.637637 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:24.637279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" event={"ID":"27607480-a933-4b89-8a08-4524be8d55d6","Type":"ContainerDied","Data":"47a020f36d7c66abfb635166271f814d422ff087e477f6ac0f860b4b09a30b70"}
Sep 06 12:27:24.637685 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:24.637651    2578 scope.go:117] "RemoveContainer" containerID="47a020f36d7c66abfb635166271f814d422ff087e477f6ac0f860b4b09a30b70"
Sep 06 12:27:24.638627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:24.638602    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:27:24.638686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:24.638669    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:27:24.638724 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:24.638701    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:27:25.645117 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:25.645084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" event={"ID":"27607480-a933-4b89-8a08-4524be8d55d6","Type":"ContainerStarted","Data":"4a8f09fc59613589408c1be41b85b46120ba50d81799f626603999f7bd90535b"}
Sep 06 12:27:26.479953 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:26.479908    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:27:26.480184 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:26.480114    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jkksr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:27:26.480248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:26.480203    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" podUID="27607480-a933-4b89-8a08-4524be8d55d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 06 12:27:27.479544 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:27.479505    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jkksr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:27:27.480044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:27.479568    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" podUID="27607480-a933-4b89-8a08-4524be8d55d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 06 12:27:28.479813 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:28.479771    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jkksr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:27:28.480220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:28.479839    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" podUID="27607480-a933-4b89-8a08-4524be8d55d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 06 12:27:29.479973 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:29.479932    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jkksr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:27:29.480378 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:29.480011    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" podUID="27607480-a933-4b89-8a08-4524be8d55d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 06 12:27:30.479944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:30.479899    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-78bb78ff78-jkksr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body=
Sep 06 12:27:30.480121 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:30.479969    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr" podUID="27607480-a933-4b89-8a08-4524be8d55d6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused"
Sep 06 12:27:31.483513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:31.483483    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:27:31.483979 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:31.483851    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:27:31.484599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:31.484581    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-78bb78ff78-jkksr"
Sep 06 12:27:38.647111 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:38.647087    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:27:38.648967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:38.648941    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:27:38.901427 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:38.901345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:27:55.101741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.101706    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"]
Sep 06 12:27:55.102366 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.102342    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f1108b-d9b8-41ff-849c-03ad8266ade6" containerName="authorino"
Sep 06 12:27:55.102446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.102370    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f1108b-d9b8-41ff-849c-03ad8266ade6" containerName="authorino"
Sep 06 12:27:55.102545 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.102523    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f1108b-d9b8-41ff-849c-03ad8266ade6" containerName="authorino"
Sep 06 12:27:55.105799 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.105775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.108346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.108321    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rs9bv\""
Sep 06 12:27:55.108346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.108336    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 06 12:27:55.109400 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.109384    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 06 12:27:55.109489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.109444    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 06 12:27:55.116410 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.116382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"]
Sep 06 12:27:55.189799 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.189772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.189911 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.189816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.189911 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.189835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.189985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.189915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.189985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.189944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ck26p\" (UniqueName: \"kubernetes.io/projected/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-kube-api-access-ck26p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.190076 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.190011    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291038 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291009    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291142    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ck26p\" (UniqueName: \"kubernetes.io/projected/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-kube-api-access-ck26p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.291686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.291639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.293373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.293352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.293540 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.293523    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.298336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.298314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ck26p\" (UniqueName: \"kubernetes.io/projected/e31cb97c-82be-4c2b-91ce-b3d36f17b8e0-kube-api-access-ck26p\") pod \"e2e-distinct-simulated-kserve-59975d69f9-hgbld\" (UID: \"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.418562 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.418500    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:27:55.691179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.691140    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"]
Sep 06 12:27:55.692550 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:27:55.692523    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode31cb97c_82be_4c2b_91ce_b3d36f17b8e0.slice/crio-d50de5f59b4eeae89f48619e3c25e98e9e29dc01ec0e2b2c5666ff03c4201432 WatchSource:0}: Error finding container d50de5f59b4eeae89f48619e3c25e98e9e29dc01ec0e2b2c5666ff03c4201432: Status 404 returned error can't find the container with id d50de5f59b4eeae89f48619e3c25e98e9e29dc01ec0e2b2c5666ff03c4201432
Sep 06 12:27:55.694210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.694192    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:27:55.799017 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.798980    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:27:55.811515 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:55.811471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld" event={"ID":"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0","Type":"ContainerStarted","Data":"d50de5f59b4eeae89f48619e3c25e98e9e29dc01ec0e2b2c5666ff03c4201432"}
Sep 06 12:27:56.817690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:56.817662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld" event={"ID":"e31cb97c-82be-4c2b-91ce-b3d36f17b8e0","Type":"ContainerStarted","Data":"251dbf3f1c32adcfe765bb6dabad15b45f1c2810a234afd22ac5ab7b00ecffbe"}
Sep 06 12:27:56.834061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:27:56.833990    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld" podStartSLOduration=0.787343042 podStartE2EDuration="1.833972696s" totalImagesPullingTime="1.046629654s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:27:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:27:56.832218332 +0000 UTC m=+618.645642414" watchObservedRunningTime="2026-09-06 12:27:56.833972696 +0000 UTC m=+618.647396776"
Sep 06 12:28:05.419512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:05.419428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:28:05.419512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:05.419514    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:28:05.431891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:05.431870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:28:05.878525 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:05.878501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-hgbld"
Sep 06 12:28:09.208749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:09.208712    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:28:23.508644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:23.508603    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:28:38.607774 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:38.607737    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:28:56.005857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:28:56.005818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:29:06.512711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:06.512678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:29:55.354380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.354291    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-574b8bccd4-hz2m9"]
Sep 06 12:29:55.357818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.357800    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.362447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.362421    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574b8bccd4-hz2m9"]
Sep 06 12:29:55.425000 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.424973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04ee6c4f-e741-4238-8f70-f037685822d1-tls-cert\") pod \"authorino-574b8bccd4-hz2m9\" (UID: \"04ee6c4f-e741-4238-8f70-f037685822d1\") " pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.425121 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.425033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54vmf\" (UniqueName: \"kubernetes.io/projected/04ee6c4f-e741-4238-8f70-f037685822d1-kube-api-access-54vmf\") pod \"authorino-574b8bccd4-hz2m9\" (UID: \"04ee6c4f-e741-4238-8f70-f037685822d1\") " pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.526493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.526469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04ee6c4f-e741-4238-8f70-f037685822d1-tls-cert\") pod \"authorino-574b8bccd4-hz2m9\" (UID: \"04ee6c4f-e741-4238-8f70-f037685822d1\") " pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.526605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.526525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54vmf\" (UniqueName: \"kubernetes.io/projected/04ee6c4f-e741-4238-8f70-f037685822d1-kube-api-access-54vmf\") pod \"authorino-574b8bccd4-hz2m9\" (UID: \"04ee6c4f-e741-4238-8f70-f037685822d1\") " pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.528807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.528782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/04ee6c4f-e741-4238-8f70-f037685822d1-tls-cert\") pod \"authorino-574b8bccd4-hz2m9\" (UID: \"04ee6c4f-e741-4238-8f70-f037685822d1\") " pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.534486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.534461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54vmf\" (UniqueName: \"kubernetes.io/projected/04ee6c4f-e741-4238-8f70-f037685822d1-kube-api-access-54vmf\") pod \"authorino-574b8bccd4-hz2m9\" (UID: \"04ee6c4f-e741-4238-8f70-f037685822d1\") " pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.669688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.669628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-574b8bccd4-hz2m9"
Sep 06 12:29:55.940669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:55.940646    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-574b8bccd4-hz2m9"]
Sep 06 12:29:55.942356 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:29:55.942328    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod04ee6c4f_e741_4238_8f70_f037685822d1.slice/crio-534302f1bb7d743737aea11718044f7abd33b190b2cb8cd1159907890a5d5bbd WatchSource:0}: Error finding container 534302f1bb7d743737aea11718044f7abd33b190b2cb8cd1159907890a5d5bbd: Status 404 returned error can't find the container with id 534302f1bb7d743737aea11718044f7abd33b190b2cb8cd1159907890a5d5bbd
Sep 06 12:29:56.467825 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:56.467789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574b8bccd4-hz2m9" event={"ID":"04ee6c4f-e741-4238-8f70-f037685822d1","Type":"ContainerStarted","Data":"534302f1bb7d743737aea11718044f7abd33b190b2cb8cd1159907890a5d5bbd"}
Sep 06 12:29:57.477511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.477474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-574b8bccd4-hz2m9" event={"ID":"04ee6c4f-e741-4238-8f70-f037685822d1","Type":"ContainerStarted","Data":"c8a3d972ae090490eaa12d30b97092ad5930fd6f5278478c9d9e0a4cb7b1038d"}
Sep 06 12:29:57.494986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.494934    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-574b8bccd4-hz2m9" podStartSLOduration=1.750494709 podStartE2EDuration="2.494918221s" totalImagesPullingTime="744.423512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:29:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:29:57.493993004 +0000 UTC m=+739.307417076" watchObservedRunningTime="2026-09-06 12:29:57.494918221 +0000 UTC m=+739.308342294"
Sep 06 12:29:57.522638 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.522602    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-756bb66d97-frhg8"]
Sep 06 12:29:57.522815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.522794    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-756bb66d97-frhg8" podUID="d6b6695f-c338-4742-8d19-bc3eb7f99434" containerName="authorino" containerID="cri-o://32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe" gracePeriod=30
Sep 06 12:29:57.782109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.782080    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:29:57.849830 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.849795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-42qxq\" (UniqueName: \"kubernetes.io/projected/d6b6695f-c338-4742-8d19-bc3eb7f99434-kube-api-access-42qxq\") pod \"d6b6695f-c338-4742-8d19-bc3eb7f99434\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") "
Sep 06 12:29:57.850002 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.849916    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6b6695f-c338-4742-8d19-bc3eb7f99434-tls-cert\") pod \"d6b6695f-c338-4742-8d19-bc3eb7f99434\" (UID: \"d6b6695f-c338-4742-8d19-bc3eb7f99434\") "
Sep 06 12:29:57.852418 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.852376    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6b6695f-c338-4742-8d19-bc3eb7f99434-kube-api-access-42qxq" (OuterVolumeSpecName: "kube-api-access-42qxq") pod "d6b6695f-c338-4742-8d19-bc3eb7f99434" (UID: "d6b6695f-c338-4742-8d19-bc3eb7f99434"). InnerVolumeSpecName "kube-api-access-42qxq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:29:57.861070 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.860947    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d6b6695f-c338-4742-8d19-bc3eb7f99434-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "d6b6695f-c338-4742-8d19-bc3eb7f99434" (UID: "d6b6695f-c338-4742-8d19-bc3eb7f99434"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:29:57.960622 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.960586    2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d6b6695f-c338-4742-8d19-bc3eb7f99434-tls-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:29:57.960622 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:57.960616    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-42qxq\" (UniqueName: \"kubernetes.io/projected/d6b6695f-c338-4742-8d19-bc3eb7f99434-kube-api-access-42qxq\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:29:58.484291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.484250    2578 generic.go:356] "Generic (PLEG): container finished" podID="d6b6695f-c338-4742-8d19-bc3eb7f99434" containerID="32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe" exitCode=0
Sep 06 12:29:58.484732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.484309    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-756bb66d97-frhg8"
Sep 06 12:29:58.484732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.484339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756bb66d97-frhg8" event={"ID":"d6b6695f-c338-4742-8d19-bc3eb7f99434","Type":"ContainerDied","Data":"32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe"}
Sep 06 12:29:58.484732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.484387    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-756bb66d97-frhg8" event={"ID":"d6b6695f-c338-4742-8d19-bc3eb7f99434","Type":"ContainerDied","Data":"af7dc6e3af1cc25d6f275e483e4107fb96f5b7ac9ce9184ffe154c9371f11e78"}
Sep 06 12:29:58.484732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.484405    2578 scope.go:117] "RemoveContainer" containerID="32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe"
Sep 06 12:29:58.494219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.494202    2578 scope.go:117] "RemoveContainer" containerID="32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe"
Sep 06 12:29:58.494523 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:29:58.494503    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe\": container with ID starting with 32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe not found: ID does not exist" containerID="32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe"
Sep 06 12:29:58.494578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.494532    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe"} err="failed to get container status \"32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe\": rpc error: code = NotFound desc = could not find container \"32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe\": container with ID starting with 32dc65f1615375e9ff39f1e1cf74a24cccba876042ce8438cd29d942b6744fbe not found: ID does not exist"
Sep 06 12:29:58.505298 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.505275    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-756bb66d97-frhg8"]
Sep 06 12:29:58.509183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.509142    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-756bb66d97-frhg8"]
Sep 06 12:29:58.668894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:29:58.668863    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6b6695f-c338-4742-8d19-bc3eb7f99434" path="/var/lib/kubelet/pods/d6b6695f-c338-4742-8d19-bc3eb7f99434/volumes"
Sep 06 12:30:00.141097 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.141064    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"]
Sep 06 12:30:00.141468 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.141444    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d6b6695f-c338-4742-8d19-bc3eb7f99434" containerName="authorino"
Sep 06 12:30:00.141468 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.141457    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d6b6695f-c338-4742-8d19-bc3eb7f99434" containerName="authorino"
Sep 06 12:30:00.141540 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.141532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d6b6695f-c338-4742-8d19-bc3eb7f99434" containerName="authorino"
Sep 06 12:30:00.145463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.145447    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"
Sep 06 12:30:00.148283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.148234    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:30:00.149014 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.148991    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"]
Sep 06 12:30:00.158456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.158437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"
Sep 06 12:30:00.432316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.432287    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"]
Sep 06 12:30:00.433536 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:00.433511    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f939144_4784_48a7_9776_69bae2a68fb8.slice/crio-7a4b2133ae0d49e4b00602756d357d17513eee62c1bd8598501aeef2d7e62faa WatchSource:0}: Error finding container 7a4b2133ae0d49e4b00602756d357d17513eee62c1bd8598501aeef2d7e62faa: Status 404 returned error can't find the container with id 7a4b2133ae0d49e4b00602756d357d17513eee62c1bd8598501aeef2d7e62faa
Sep 06 12:30:00.497361 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:00.497331    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr" event={"ID":"0f939144-4784-48a7-9776-69bae2a68fb8","Type":"ContainerStarted","Data":"7a4b2133ae0d49e4b00602756d357d17513eee62c1bd8598501aeef2d7e62faa"}
Sep 06 12:30:03.518441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:03.518410    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr" event={"ID":"0f939144-4784-48a7-9776-69bae2a68fb8","Type":"ContainerStarted","Data":"c4751ed1dab53489257a4e56357b76262bb85be01fd1a1f45b9fb4be6b703545"}
Sep 06 12:30:03.531732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:03.531675    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr" podStartSLOduration=1.235111743 podStartE2EDuration="3.531654561s" totalImagesPullingTime="2.296542818s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:03.530587603 +0000 UTC m=+745.344011682" watchObservedRunningTime="2026-09-06 12:30:03.531654561 +0000 UTC m=+745.345078641"
Sep 06 12:30:04.526218 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:04.526183    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f939144-4784-48a7-9776-69bae2a68fb8" containerID="c4751ed1dab53489257a4e56357b76262bb85be01fd1a1f45b9fb4be6b703545" exitCode=0
Sep 06 12:30:04.526627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:04.526275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr" event={"ID":"0f939144-4784-48a7-9776-69bae2a68fb8","Type":"ContainerDied","Data":"c4751ed1dab53489257a4e56357b76262bb85be01fd1a1f45b9fb4be6b703545"}
Sep 06 12:30:05.668930 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:05.668908    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"
Sep 06 12:30:06.539638 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:06.539610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr"
Sep 06 12:30:06.539638 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:06.539625    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29811630-9z5zr" event={"ID":"0f939144-4784-48a7-9776-69bae2a68fb8","Type":"ContainerDied","Data":"7a4b2133ae0d49e4b00602756d357d17513eee62c1bd8598501aeef2d7e62faa"}
Sep 06 12:30:06.539843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:06.539665    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a4b2133ae0d49e4b00602756d357d17513eee62c1bd8598501aeef2d7e62faa"
Sep 06 12:30:14.572674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.567672    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"]
Sep 06 12:30:14.572674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.568554    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f939144-4784-48a7-9776-69bae2a68fb8" containerName="cleanup"
Sep 06 12:30:14.572674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.568576    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f939144-4784-48a7-9776-69bae2a68fb8" containerName="cleanup"
Sep 06 12:30:14.572674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.568737    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f939144-4784-48a7-9776-69bae2a68fb8" containerName="cleanup"
Sep 06 12:30:14.573160 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.572876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.575415 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.575388    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-36bcab-openshift-default-dockercfg-bjwx2\""
Sep 06 12:30:14.581572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.581546    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"]
Sep 06 12:30:14.694414 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-credential-socket\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694414 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-data\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-socket\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/741d231f-d4d5-423b-a241-e0fbb4c18b48-istiod-ca-cert\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-envoy\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-token\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-certs\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-podinfo\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.694700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.694690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc5hq\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-kube-api-access-bc5hq\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.795742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795713    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/741d231f-d4d5-423b-a241-e0fbb4c18b48-istiod-ca-cert\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.795923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-envoy\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.795923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795780    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-token\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.795923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-certs\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.795923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-podinfo\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.795923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc5hq\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-kube-api-access-bc5hq\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-credential-socket\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.795981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-data\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.796014    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-socket\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796368 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.796304    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-certs\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796427 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.796408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-credential-socket\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.796426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-socket\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796537 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.796483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-data\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.796713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.796693    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/741d231f-d4d5-423b-a241-e0fbb4c18b48-istiod-ca-cert\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.798374 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.798349    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-envoy\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.798798 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.798772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-podinfo\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.803681 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.803663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-token\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.803770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.803750    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc5hq\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-kube-api-access-bc5hq\") pod \"e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") " pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:14.887129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:14.887060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:15.171702 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.171673    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"]
Sep 06 12:30:15.173660 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:15.173635    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod741d231f_d4d5_423b_a241_e0fbb4c18b48.slice/crio-be30252b44d3483c68a73bec88e18bd422bc6734ed0cb9056c636bc93e950258 WatchSource:0}: Error finding container be30252b44d3483c68a73bec88e18bd422bc6734ed0cb9056c636bc93e950258: Status 404 returned error can't find the container with id be30252b44d3483c68a73bec88e18bd422bc6734ed0cb9056c636bc93e950258
Sep 06 12:30:15.176216 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.176183    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:15.176284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.176251    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:15.176284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.176279    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:15.592184 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.592135    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" event={"ID":"741d231f-d4d5-423b-a241-e0fbb4c18b48","Type":"ContainerStarted","Data":"cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"}
Sep 06 12:30:15.592605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.592205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" event={"ID":"741d231f-d4d5-423b-a241-e0fbb4c18b48","Type":"ContainerStarted","Data":"be30252b44d3483c68a73bec88e18bd422bc6734ed0cb9056c636bc93e950258"}
Sep 06 12:30:15.617824 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.617776    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podStartSLOduration=1.617761002 podStartE2EDuration="1.617761002s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:15.615554311 +0000 UTC m=+757.428978390" watchObservedRunningTime="2026-09-06 12:30:15.617761002 +0000 UTC m=+757.431185082"
Sep 06 12:30:15.887939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:15.887863    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:16.087610 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.087566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:16.091187 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.091134    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:16.093467 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.093440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qfdls\""
Sep 06 12:30:16.094272 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.094252    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:16.210884 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.210854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pbkl\" (UniqueName: \"kubernetes.io/projected/dccd8ae1-deb8-4104-931f-c65487799ddf-kube-api-access-5pbkl\") pod \"test-curl-7766-140592164060976\" (UID: \"dccd8ae1-deb8-4104-931f-c65487799ddf\") " pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:16.312175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.312132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pbkl\" (UniqueName: \"kubernetes.io/projected/dccd8ae1-deb8-4104-931f-c65487799ddf-kube-api-access-5pbkl\") pod \"test-curl-7766-140592164060976\" (UID: \"dccd8ae1-deb8-4104-931f-c65487799ddf\") " pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:16.320095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.320068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pbkl\" (UniqueName: \"kubernetes.io/projected/dccd8ae1-deb8-4104-931f-c65487799ddf-kube-api-access-5pbkl\") pod \"test-curl-7766-140592164060976\" (UID: \"dccd8ae1-deb8-4104-931f-c65487799ddf\") " pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:16.402959 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.402931    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:16.675751 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.675726    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:16.678397 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:16.678362    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddccd8ae1_deb8_4104_931f_c65487799ddf.slice/crio-cb3501bc1f81d57d068fbf35f89cbbe7b2539fe5aead063b2206987df45b5dea WatchSource:0}: Error finding container cb3501bc1f81d57d068fbf35f89cbbe7b2539fe5aead063b2206987df45b5dea: Status 404 returned error can't find the container with id cb3501bc1f81d57d068fbf35f89cbbe7b2539fe5aead063b2206987df45b5dea
Sep 06 12:30:16.892363 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:16.892296    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:17.608865 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:17.608822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7766-140592164060976" event={"ID":"dccd8ae1-deb8-4104-931f-c65487799ddf","Type":"ContainerStarted","Data":"cb3501bc1f81d57d068fbf35f89cbbe7b2539fe5aead063b2206987df45b5dea"}
Sep 06 12:30:17.609182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:17.609140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:17.610228 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:17.610205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:18.118590 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:18.118549    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:30:19.623116 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:19.623079    2578 generic.go:356] "Generic (PLEG): container finished" podID="dccd8ae1-deb8-4104-931f-c65487799ddf" containerID="3857d6397b934947c1ea56b288a54c539e323d48927295d285963ad2d6c42480" exitCode=0
Sep 06 12:30:19.623498 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:19.623177    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7766-140592164060976" event={"ID":"dccd8ae1-deb8-4104-931f-c65487799ddf","Type":"ContainerDied","Data":"3857d6397b934947c1ea56b288a54c539e323d48927295d285963ad2d6c42480"}
Sep 06 12:30:20.776401 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.776379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:20.810331 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.810305    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7766-140592164060976_dccd8ae1-deb8-4104-931f-c65487799ddf/test-curl-7766-140592164060976/0.log"
Sep 06 12:30:20.830916 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.830892    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:20.833032 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.833011    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:20.855345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.855322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5pbkl\" (UniqueName: \"kubernetes.io/projected/dccd8ae1-deb8-4104-931f-c65487799ddf-kube-api-access-5pbkl\") pod \"dccd8ae1-deb8-4104-931f-c65487799ddf\" (UID: \"dccd8ae1-deb8-4104-931f-c65487799ddf\") "
Sep 06 12:30:20.857349 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.857325    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dccd8ae1-deb8-4104-931f-c65487799ddf-kube-api-access-5pbkl" (OuterVolumeSpecName: "kube-api-access-5pbkl") pod "dccd8ae1-deb8-4104-931f-c65487799ddf" (UID: "dccd8ae1-deb8-4104-931f-c65487799ddf"). InnerVolumeSpecName "kube-api-access-5pbkl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:30:20.938771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.938749    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:20.939221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.939193    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dccd8ae1-deb8-4104-931f-c65487799ddf" containerName="test-curl-7766-140592164060976"
Sep 06 12:30:20.939221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.939222    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="dccd8ae1-deb8-4104-931f-c65487799ddf" containerName="test-curl-7766-140592164060976"
Sep 06 12:30:20.939376 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.939313    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="dccd8ae1-deb8-4104-931f-c65487799ddf" containerName="test-curl-7766-140592164060976"
Sep 06 12:30:20.942360 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.942345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:20.946512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.946491    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:20.956804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:20.956783    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5pbkl\" (UniqueName: \"kubernetes.io/projected/dccd8ae1-deb8-4104-931f-c65487799ddf-kube-api-access-5pbkl\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:30:21.057635 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.057607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmkfh\" (UniqueName: \"kubernetes.io/projected/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1-kube-api-access-mmkfh\") pod \"test-curl-7766-140592164060976\" (UID: \"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1\") " pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:21.158319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.158290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmkfh\" (UniqueName: \"kubernetes.io/projected/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1-kube-api-access-mmkfh\") pod \"test-curl-7766-140592164060976\" (UID: \"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1\") " pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:21.168791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.168766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmkfh\" (UniqueName: \"kubernetes.io/projected/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1-kube-api-access-mmkfh\") pod \"test-curl-7766-140592164060976\" (UID: \"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1\") " pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:21.253070 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.252992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:21.523472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.523443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:21.524848 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:21.524819    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf0dbc837_06d8_4cdc_85fb_441f1cb6d9f1.slice/crio-55250d556d687a6f1c7d527ec129592ddcd3a4614cd8b087a16968a81300bafd WatchSource:0}: Error finding container 55250d556d687a6f1c7d527ec129592ddcd3a4614cd8b087a16968a81300bafd: Status 404 returned error can't find the container with id 55250d556d687a6f1c7d527ec129592ddcd3a4614cd8b087a16968a81300bafd
Sep 06 12:30:21.634869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.634846    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:21.634988 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.634857    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cb3501bc1f81d57d068fbf35f89cbbe7b2539fe5aead063b2206987df45b5dea"
Sep 06 12:30:21.636206 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.636174    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7766-140592164060976" event={"ID":"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1","Type":"ContainerStarted","Data":"55250d556d687a6f1c7d527ec129592ddcd3a4614cd8b087a16968a81300bafd"}
Sep 06 12:30:21.646388 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:21.646363    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7766-140592164060976" oldPodUID="dccd8ae1-deb8-4104-931f-c65487799ddf" podUID="f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1"
Sep 06 12:30:22.308292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.308260    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"]
Sep 06 12:30:22.313229 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.313208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.315758 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.315737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8f9eca99-openshift-default-dockercfg-q29d4\""
Sep 06 12:30:22.321560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.321308    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"]
Sep 06 12:30:22.470037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-envoy\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470141 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-socket\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470141 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-podinfo\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470141 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtwx\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-kube-api-access-jvtwx\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470192    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-credential-socket\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-token\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470231    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istiod-ca-cert\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470282    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-certs\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.470358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.470346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-data\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571031 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.570953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-certs\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571031 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.570998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-data\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-envoy\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-socket\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-podinfo\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtwx\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-kube-api-access-jvtwx\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-credential-socket\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571362    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-token\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istiod-ca-cert\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.571946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.571916    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-socket\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.572296 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.572225    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istiod-ca-cert\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.572296 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.572241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-certs\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.572473 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.572454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-credential-socket\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.572644 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.572592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-data\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.574326 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.574306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-envoy\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.574972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.574947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-podinfo\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.581538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.581514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtwx\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-kube-api-access-jvtwx\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.581538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.581532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-token\") pod \"e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") " pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.626258 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.626236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:22.644599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.644568    2578 generic.go:356] "Generic (PLEG): container finished" podID="f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1" containerID="ede67515e13f7cf0db3edf88250e07c89690891cfe144d4c9e5b5bed93f31c75" exitCode=0
Sep 06 12:30:22.644716 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.644604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7766-140592164060976" event={"ID":"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1","Type":"ContainerDied","Data":"ede67515e13f7cf0db3edf88250e07c89690891cfe144d4c9e5b5bed93f31c75"}
Sep 06 12:30:22.670682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.670647    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dccd8ae1-deb8-4104-931f-c65487799ddf" path="/var/lib/kubelet/pods/dccd8ae1-deb8-4104-931f-c65487799ddf/volumes"
Sep 06 12:30:22.907845 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.907815    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"]
Sep 06 12:30:22.909058 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:22.909036    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ed3b6b_f9cd_4f4a_9728_9aea41162a66.slice/crio-0002f61d0b10889ca47441501daf9567d83ca874d8e16f35549bbe06f8d55a12 WatchSource:0}: Error finding container 0002f61d0b10889ca47441501daf9567d83ca874d8e16f35549bbe06f8d55a12: Status 404 returned error can't find the container with id 0002f61d0b10889ca47441501daf9567d83ca874d8e16f35549bbe06f8d55a12
Sep 06 12:30:22.911441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.911404    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:22.911516 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.911487    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:22.911553 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:22.911538    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:23.652349 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.652313    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" event={"ID":"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66","Type":"ContainerStarted","Data":"5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"}
Sep 06 12:30:23.652779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.652370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" event={"ID":"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66","Type":"ContainerStarted","Data":"0002f61d0b10889ca47441501daf9567d83ca874d8e16f35549bbe06f8d55a12"}
Sep 06 12:30:23.674159 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.674081    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podStartSLOduration=1.674058578 podStartE2EDuration="1.674058578s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:23.669995529 +0000 UTC m=+765.483419621" watchObservedRunningTime="2026-09-06 12:30:23.674058578 +0000 UTC m=+765.487482658"
Sep 06 12:30:23.796248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.796219    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:23.813906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.813884    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7766-140592164060976_f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1/test-curl-7766-140592164060976/0.log"
Sep 06 12:30:23.834842 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.834815    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:23.838810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.838785    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7766-140592164060976"]
Sep 06 12:30:23.883346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.883323    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmkfh\" (UniqueName: \"kubernetes.io/projected/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1-kube-api-access-mmkfh\") pod \"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1\" (UID: \"f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1\") "
Sep 06 12:30:23.885340 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.885312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1-kube-api-access-mmkfh" (OuterVolumeSpecName: "kube-api-access-mmkfh") pod "f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1" (UID: "f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1"). InnerVolumeSpecName "kube-api-access-mmkfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:30:23.984675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:23.984650    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmkfh\" (UniqueName: \"kubernetes.io/projected/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1-kube-api-access-mmkfh\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:30:24.571947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.571909    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"]
Sep 06 12:30:24.572530 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.572512    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1" containerName="test-curl-7766-140592164060976"
Sep 06 12:30:24.572530 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.572534    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1" containerName="test-curl-7766-140592164060976"
Sep 06 12:30:24.572666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.572654    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1" containerName="test-curl-7766-140592164060976"
Sep 06 12:30:24.582496 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.577423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.582496 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.580865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-autores-0e6ab1-openshift-default-dockercfg-j5hdd\""
Sep 06 12:30:24.590460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.590429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"]
Sep 06 12:30:24.627039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.627011    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:24.632213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.632192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:24.663219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.663196    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7766-140592164060976"
Sep 06 12:30:24.679166 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.679116    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1" path="/var/lib/kubelet/pods/f0dbc837-06d8-4cdc-85fb-441f1cb6d9f1/volumes"
Sep 06 12:30:24.679674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.679653    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:24.679788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.679722    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:24.679788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.679754    2578 scope.go:117] "RemoveContainer" containerID="ede67515e13f7cf0db3edf88250e07c89690891cfe144d4c9e5b5bed93f31c75"
Sep 06 12:30:24.691452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.691409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df78032c-0fae-4784-bd4f-eb91dca88173-istio-podinfo\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.691807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.691787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-data\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-credential-socket\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df78032c-0fae-4784-bd4f-eb91dca88173-istiod-ca-cert\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692457 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-socket\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-certs\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-envoy\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-istio-token\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.692701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.692644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q94jw\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-kube-api-access-q94jw\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793254 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793221    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-envoy\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-istio-token\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q94jw\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-kube-api-access-q94jw\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793595 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df78032c-0fae-4784-bd4f-eb91dca88173-istio-podinfo\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793653 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793619    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-data\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793761 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-credential-socket\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793829 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793809    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df78032c-0fae-4784-bd4f-eb91dca88173-istiod-ca-cert\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-socket\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-certs\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.793997 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.793929    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-data\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.794236 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.794209    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-certs\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.794385 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.794258    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-credential-socket\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.794456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.794405    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-socket\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.794538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.794508    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df78032c-0fae-4784-bd4f-eb91dca88173-istiod-ca-cert\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.795761 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.795739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-envoy\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.796182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.796138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df78032c-0fae-4784-bd4f-eb91dca88173-istio-podinfo\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.800996 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.800972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-istio-token\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.801127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.801109    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q94jw\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-kube-api-access-q94jw\") pod \"e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") " pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:24.896811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:24.896462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:25.196319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.196290    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"]
Sep 06 12:30:25.197697 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:25.197666    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf78032c_0fae_4784_bd4f_eb91dca88173.slice/crio-40cda3bd07956f88aab2a64593d2acb230e56f9f4d53dbdddd9a67239753e514 WatchSource:0}: Error finding container 40cda3bd07956f88aab2a64593d2acb230e56f9f4d53dbdddd9a67239753e514: Status 404 returned error can't find the container with id 40cda3bd07956f88aab2a64593d2acb230e56f9f4d53dbdddd9a67239753e514
Sep 06 12:30:25.200185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.200119    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:25.200265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.200234    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:25.200316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.200299    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:25.674486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.674394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" event={"ID":"df78032c-0fae-4784-bd4f-eb91dca88173","Type":"ContainerStarted","Data":"f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"}
Sep 06 12:30:25.674486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.674451    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" event={"ID":"df78032c-0fae-4784-bd4f-eb91dca88173","Type":"ContainerStarted","Data":"40cda3bd07956f88aab2a64593d2acb230e56f9f4d53dbdddd9a67239753e514"}
Sep 06 12:30:25.699350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.699301    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podStartSLOduration=1.699286629 podStartE2EDuration="1.699286629s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:25.696556074 +0000 UTC m=+767.509980190" watchObservedRunningTime="2026-09-06 12:30:25.699286629 +0000 UTC m=+767.512710708"
Sep 06 12:30:25.897340 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:25.897310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:26.811947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.811913    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"]
Sep 06 12:30:26.816598 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.816577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:26.819201 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.819178    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8f9eca99\""
Sep 06 12:30:26.819328 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.819239    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8f9eca99-dockercfg-b4prh\""
Sep 06 12:30:26.824944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.824926    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"]
Sep 06 12:30:26.906821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.906784    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:26.917260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.917228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv7gl\" (UniqueName: \"kubernetes.io/projected/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-kube-api-access-vv7gl\") pod \"payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") " pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:26.917380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:26.917298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-plugins-config-volume\") pod \"payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") " pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:27.018431 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.018396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-plugins-config-volume\") pod \"payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") " pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:27.018599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.018515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv7gl\" (UniqueName: \"kubernetes.io/projected/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-kube-api-access-vv7gl\") pod \"payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") " pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:27.019114 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.019095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-plugins-config-volume\") pod \"payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") " pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:27.025988 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.025967    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv7gl\" (UniqueName: \"kubernetes.io/projected/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-kube-api-access-vv7gl\") pod \"payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") " pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:27.128556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.128458    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:27.428596 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.428570    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"]
Sep 06 12:30:27.429724 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:27.429694    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c9a42e2_9cd5_4e96_8401_0aac2abe0b58.slice/crio-3a03f86b248e5b12a0add71d279675a8e967d99a18161477eccb7fa487d18b2f WatchSource:0}: Error finding container 3a03f86b248e5b12a0add71d279675a8e967d99a18161477eccb7fa487d18b2f: Status 404 returned error can't find the container with id 3a03f86b248e5b12a0add71d279675a8e967d99a18161477eccb7fa487d18b2f
Sep 06 12:30:27.699480 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.699445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm" event={"ID":"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58","Type":"ContainerStarted","Data":"3a03f86b248e5b12a0add71d279675a8e967d99a18161477eccb7fa487d18b2f"}
Sep 06 12:30:27.699788 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.699768    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:27.700706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:27.700683    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:29.713926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:29.713891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm" event={"ID":"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58","Type":"ContainerStarted","Data":"94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf"}
Sep 06 12:30:29.714574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:29.714180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:33.412722 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:33.412653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm" podStartSLOduration=5.315313526 podStartE2EDuration="7.412630058s" totalImagesPullingTime="2.097316532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:29.732879555 +0000 UTC m=+771.546303627" watchObservedRunningTime="2026-09-06 12:30:33.412630058 +0000 UTC m=+775.226054140"
Sep 06 12:30:33.413967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:33.413944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:30:33.651333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:33.651287    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:30:33.651546 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:33.651365    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:30:35.760489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:35.760443    2578 generic.go:356] "Generic (PLEG): container finished" podID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerID="cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1" exitCode=0
Sep 06 12:30:35.761025 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:35.760546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" event={"ID":"741d231f-d4d5-423b-a241-e0fbb4c18b48","Type":"ContainerDied","Data":"cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"}
Sep 06 12:30:35.761102 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:35.761054    2578 scope.go:117] "RemoveContainer" containerID="cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"
Sep 06 12:30:35.762894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:35.762835    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:35.763008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:35.762959    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:35.763073 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:35.763022    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:36.772775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:36.772735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" event={"ID":"741d231f-d4d5-423b-a241-e0fbb4c18b48","Type":"ContainerStarted","Data":"0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104"}
Sep 06 12:30:36.887917 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:36.887887    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:36.888595 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:36.888567    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:36.888826 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:36.888799    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:37.888325 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:37.888276    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:37.888841 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:37.888346    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:38.888322 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:38.888286    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:38.888593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:38.888565    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:39.888533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:39.888498    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:39.888845 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:39.888802    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:40.722092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:40.722055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:40.887527 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:40.887491    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:40.887780 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:40.887759    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:41.888237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:41.887756    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:41.888237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:41.887825    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:42.887837 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:42.887792    2578 patch_prober.go:28] interesting pod/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 06 12:30:42.888039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:42.887844    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 06 12:30:43.741332 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:43.741289    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:30:43.741733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:43.741368    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:30:43.891649 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:43.891620    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:43.891963 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:43.891938    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:43.892716 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:43.892696    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:30:44.834240 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.834164    2578 generic.go:356] "Generic (PLEG): container finished" podID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerID="5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7" exitCode=0
Sep 06 12:30:44.834240 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.834175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" event={"ID":"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66","Type":"ContainerDied","Data":"5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"}
Sep 06 12:30:44.834735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.834600    2578 scope.go:117] "RemoveContainer" containerID="5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"
Sep 06 12:30:44.835771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.835747    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:44.835870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.835814    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:44.835870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.835859    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:44.835992 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.835976    2578 generic.go:356] "Generic (PLEG): container finished" podID="df78032c-0fae-4784-bd4f-eb91dca88173" containerID="f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e" exitCode=0
Sep 06 12:30:44.836075 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.836056    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" event={"ID":"df78032c-0fae-4784-bd4f-eb91dca88173","Type":"ContainerDied","Data":"f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"}
Sep 06 12:30:44.836543 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.836526    2578 scope.go:117] "RemoveContainer" containerID="f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"
Sep 06 12:30:44.837589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.837565    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:44.837656 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.837625    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:44.837695 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:44.837664    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:45.843558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:45.843504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" event={"ID":"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66","Type":"ContainerStarted","Data":"d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c"}
Sep 06 12:30:45.845611 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:45.845587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" event={"ID":"df78032c-0fae-4784-bd4f-eb91dca88173","Type":"ContainerStarted","Data":"54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4"}
Sep 06 12:30:45.898022 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:45.897980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:45.898247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:45.898108    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 06 12:30:45.898247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:45.898171    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 06 12:30:46.627555 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:46.627522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:46.627727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:46.627633    2578 patch_prober.go:28] interesting pod/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 12:30:46.627727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:46.627667    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 12:30:46.898741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:46.898252    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 06 12:30:46.898741 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:46.898315    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 06 12:30:47.626933 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:47.626895    2578 patch_prober.go:28] interesting pod/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 12:30:47.627086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:47.626956    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 12:30:47.898065 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:47.897952    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 06 12:30:47.898065 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:47.898022    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 06 12:30:48.626861 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:48.626828    2578 patch_prober.go:28] interesting pod/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 12:30:48.627289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:48.626893    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 12:30:48.897567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:48.897468    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 06 12:30:48.897567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:48.897535    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 06 12:30:49.627250 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:49.627209    2578 patch_prober.go:28] interesting pod/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 12:30:49.627620 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:49.627266    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 12:30:49.898185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:49.898055    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 06 12:30:49.898185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:49.898125    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 06 12:30:50.399664 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.399624    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"]
Sep 06 12:30:50.407793 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.407759    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:50.408636 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.408615    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"]
Sep 06 12:30:50.410673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.410654    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:30:50.410881 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.410657    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:30:50.529080 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.529039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aecd41a-d945-4f6b-9710-c42c9611e025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz\" (UID: \"6aecd41a-d945-4f6b-9710-c42c9611e025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:50.626594 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.626558    2578 patch_prober.go:28] interesting pod/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 06 12:30:50.626819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.626800    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 06 12:30:50.629632 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.629592    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aecd41a-d945-4f6b-9710-c42c9611e025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz\" (UID: \"6aecd41a-d945-4f6b-9710-c42c9611e025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:50.630332 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.630298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aecd41a-d945-4f6b-9710-c42c9611e025-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz\" (UID: \"6aecd41a-d945-4f6b-9710-c42c9611e025\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:50.720639 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.720604    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:50.897238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.897207    2578 patch_prober.go:28] interesting pod/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body=
Sep 06 12:30:50.897402 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:50.897264    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused"
Sep 06 12:30:51.031511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.031480    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"]
Sep 06 12:30:51.033110 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:51.033083    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aecd41a_d945_4f6b_9710_c42c9611e025.slice/crio-ee434567e4b67a492e587aae85b9d27f52acfb0dc143ddc6968eeaceb9af752c WatchSource:0}: Error finding container ee434567e4b67a492e587aae85b9d27f52acfb0dc143ddc6968eeaceb9af752c: Status 404 returned error can't find the container with id ee434567e4b67a492e587aae85b9d27f52acfb0dc143ddc6968eeaceb9af752c
Sep 06 12:30:51.630579 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.630504    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:51.630926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.630777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:51.631609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.631588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:30:51.896704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.896608    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz" event={"ID":"6aecd41a-d945-4f6b-9710-c42c9611e025","Type":"ContainerStarted","Data":"ecb18fcee53bf06891cc3efcf1708c86945088e703556781361a609c904ff8af"}
Sep 06 12:30:51.896704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.896666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz" event={"ID":"6aecd41a-d945-4f6b-9710-c42c9611e025","Type":"ContainerStarted","Data":"ee434567e4b67a492e587aae85b9d27f52acfb0dc143ddc6968eeaceb9af752c"}
Sep 06 12:30:51.900619 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.900593    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:51.900872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.900851    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:51.901676 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.901656    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:30:51.916999 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:51.916952    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz" podStartSLOduration=1.9169402679999998 podStartE2EDuration="1.916940268s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:51.916082836 +0000 UTC m=+793.729507119" watchObservedRunningTime="2026-09-06 12:30:51.916940268 +0000 UTC m=+793.730364353"
Sep 06 12:30:52.607471 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:52.607436    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:30:52.914712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:52.914628    2578 generic.go:356] "Generic (PLEG): container finished" podID="6aecd41a-d945-4f6b-9710-c42c9611e025" containerID="ecb18fcee53bf06891cc3efcf1708c86945088e703556781361a609c904ff8af" exitCode=0
Sep 06 12:30:52.914712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:52.914685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz" event={"ID":"6aecd41a-d945-4f6b-9710-c42c9611e025","Type":"ContainerDied","Data":"ecb18fcee53bf06891cc3efcf1708c86945088e703556781361a609c904ff8af"}
Sep 06 12:30:54.090742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.090714    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:54.267503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.267465    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aecd41a-d945-4f6b-9710-c42c9611e025-maas-api-service-ca\") pod \"6aecd41a-d945-4f6b-9710-c42c9611e025\" (UID: \"6aecd41a-d945-4f6b-9710-c42c9611e025\") "
Sep 06 12:30:54.267816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.267791    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6aecd41a-d945-4f6b-9710-c42c9611e025-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6aecd41a-d945-4f6b-9710-c42c9611e025" (UID: "6aecd41a-d945-4f6b-9710-c42c9611e025"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:30:54.368183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.368155    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6aecd41a-d945-4f6b-9710-c42c9611e025-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:30:54.932693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.932605    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"
Sep 06 12:30:54.932693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.932635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz" event={"ID":"6aecd41a-d945-4f6b-9710-c42c9611e025","Type":"ContainerDied","Data":"ee434567e4b67a492e587aae85b9d27f52acfb0dc143ddc6968eeaceb9af752c"}
Sep 06 12:30:54.932693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:54.932683    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ee434567e4b67a492e587aae85b9d27f52acfb0dc143ddc6968eeaceb9af752c"
Sep 06 12:30:56.965814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:56.965780    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"]
Sep 06 12:30:56.966308 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:56.966074    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm" podUID="9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" containerName="payload-processing" containerID="cri-o://94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf" gracePeriod=30
Sep 06 12:30:57.125945 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.125911    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"]
Sep 06 12:30:57.129242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.129220    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8f9eca99-md8rz"]
Sep 06 12:30:57.252651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.252352    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:57.258779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.258747    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"]
Sep 06 12:30:57.258995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.258970    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy" containerID="cri-o://d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c" gracePeriod=30
Sep 06 12:30:57.398570 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.398538    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv7gl\" (UniqueName: \"kubernetes.io/projected/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-kube-api-access-vv7gl\") pod \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") "
Sep 06 12:30:57.398826 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.398807    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-plugins-config-volume\") pod \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\" (UID: \"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58\") "
Sep 06 12:30:57.399536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.399480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" (UID: "9c9a42e2-9cd5-4e96-8401-0aac2abe0b58"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:30:57.400701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.400677    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-plugins-config-volume\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:30:57.401658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.401600    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-kube-api-access-vv7gl" (OuterVolumeSpecName: "kube-api-access-vv7gl") pod "9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" (UID: "9c9a42e2-9cd5-4e96-8401-0aac2abe0b58"). InnerVolumeSpecName "kube-api-access-vv7gl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:30:57.501733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.501664    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv7gl\" (UniqueName: \"kubernetes.io/projected/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58-kube-api-access-vv7gl\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:30:57.954440 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.954396    2578 generic.go:356] "Generic (PLEG): container finished" podID="9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" containerID="94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf" exitCode=0
Sep 06 12:30:57.954440 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.954436    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"
Sep 06 12:30:57.954647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.954466    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm" event={"ID":"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58","Type":"ContainerDied","Data":"94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf"}
Sep 06 12:30:57.954647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.954521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm" event={"ID":"9c9a42e2-9cd5-4e96-8401-0aac2abe0b58","Type":"ContainerDied","Data":"3a03f86b248e5b12a0add71d279675a8e967d99a18161477eccb7fa487d18b2f"}
Sep 06 12:30:57.954647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.954554    2578 scope.go:117] "RemoveContainer" containerID="94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf"
Sep 06 12:30:57.964528 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.964510    2578 scope.go:117] "RemoveContainer" containerID="94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf"
Sep 06 12:30:57.964784 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:30:57.964764    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf\": container with ID starting with 94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf not found: ID does not exist" containerID="94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf"
Sep 06 12:30:57.964850 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.964791    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf"} err="failed to get container status \"94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf\": rpc error: code = NotFound desc = could not find container \"94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf\": container with ID starting with 94222886919e2ef1428f26ff1e724659069ecfe19e1e16d4a8082e647d411bbf not found: ID does not exist"
Sep 06 12:30:57.980222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.980202    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"]
Sep 06 12:30:57.988592 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:57.988571    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8f9eca99-775ddbf9c5-7gkvm"]
Sep 06 12:30:58.201834 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.201801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"]
Sep 06 12:30:58.202321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.202305    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" containerName="payload-processing"
Sep 06 12:30:58.202384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.202322    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" containerName="payload-processing"
Sep 06 12:30:58.202384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.202332    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6aecd41a-d945-4f6b-9710-c42c9611e025" containerName="revoke-keys"
Sep 06 12:30:58.202384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.202338    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6aecd41a-d945-4f6b-9710-c42c9611e025" containerName="revoke-keys"
Sep 06 12:30:58.202501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.202429    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6aecd41a-d945-4f6b-9710-c42c9611e025" containerName="revoke-keys"
Sep 06 12:30:58.202501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.202441    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" containerName="payload-processing"
Sep 06 12:30:58.206835 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.206775    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.209343 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.209320    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-924ef9c2-gw-openshift-default-dockercfg-6g6sg\""
Sep 06 12:30:58.220271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.220248    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"]
Sep 06 12:30:58.307486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-credential-socket\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmv9c\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-kube-api-access-kmv9c\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-data\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istiod-ca-cert\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307849 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307696    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-token\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307849 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-envoy\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307849 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307776    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-podinfo\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307859    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-certs\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.307951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.307931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-socket\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-certs\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-socket\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-credential-socket\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmv9c\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-kube-api-access-kmv9c\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-data\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istiod-ca-cert\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.408891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-token\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-envoy\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-podinfo\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408941    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-certs\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.408968    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-credential-socket\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.409027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-socket\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409317 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.409299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-data\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.409569 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.409541    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istiod-ca-cert\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.411208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.411183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-envoy\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.411334 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.411318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-podinfo\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.417735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.417711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-token\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.417887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.417866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmv9c\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-kube-api-access-kmv9c\") pod \"e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") " pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.518278 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.518211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:58.668830 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.668793    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6aecd41a-d945-4f6b-9710-c42c9611e025" path="/var/lib/kubelet/pods/6aecd41a-d945-4f6b-9710-c42c9611e025/volumes"
Sep 06 12:30:58.669231 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.669213    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c9a42e2-9cd5-4e96-8401-0aac2abe0b58" path="/var/lib/kubelet/pods/9c9a42e2-9cd5-4e96-8401-0aac2abe0b58/volumes"
Sep 06 12:30:58.801269 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.801245    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"]
Sep 06 12:30:58.802137 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:30:58.802115    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d572b8c_c69a_4dc2_acd4_d198bc87ffbe.slice/crio-eee80e8d5117dd54c0bf3d38c916f13a4a07ab855037247043b782d4801dd175 WatchSource:0}: Error finding container eee80e8d5117dd54c0bf3d38c916f13a4a07ab855037247043b782d4801dd175: Status 404 returned error can't find the container with id eee80e8d5117dd54c0bf3d38c916f13a4a07ab855037247043b782d4801dd175
Sep 06 12:30:58.804342 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.804305    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:58.804422 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.804390    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:58.804462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.804444    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:30:58.964519 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.964485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" event={"ID":"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe","Type":"ContainerStarted","Data":"2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"}
Sep 06 12:30:58.964675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.964544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" event={"ID":"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe","Type":"ContainerStarted","Data":"eee80e8d5117dd54c0bf3d38c916f13a4a07ab855037247043b782d4801dd175"}
Sep 06 12:30:58.986324 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:58.986277    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podStartSLOduration=0.986261952 podStartE2EDuration="986.261952ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:30:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:30:58.983524954 +0000 UTC m=+800.796949068" watchObservedRunningTime="2026-09-06 12:30:58.986261952 +0000 UTC m=+800.799686434"
Sep 06 12:30:59.518892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:59.518859    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:59.523807 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:59.523781    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:59.969904 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:59.969877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:30:59.970887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:30:59.970865    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:02.514021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.513995    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:31:02.539505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvtwx\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-kube-api-access-jvtwx\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539472    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istiod-ca-cert\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539547    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-socket\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539593    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-credential-socket\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539634    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-envoy\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539672    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-podinfo\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539930 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539735    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-certs\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539930 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-data\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539930 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539806    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-token\") pod \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\" (UID: \"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66\") "
Sep 06 12:31:02.539930 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:02.540174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.539936    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:31:02.540174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.540044    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:02.540308 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.540275    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.540308 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.540295    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.540407 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.540309    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.540506 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.540471    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:02.540506 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.540498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-data" (OuterVolumeSpecName: "istio-data") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:02.543011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.542983    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-kube-api-access-jvtwx" (OuterVolumeSpecName: "kube-api-access-jvtwx") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "kube-api-access-jvtwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:31:02.543109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.543011    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:31:02.543199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.543124    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:02.543199 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.543138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" (UID: "e3ed3b6b-f9cd-4f4a-9728-9aea41162a66"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:31:02.641540 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.641513    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvtwx\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-kube-api-access-jvtwx\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.641540 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.641537    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.641689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.641547    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.641689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.641555    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.641689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.641564    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.641689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.641571    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:02.988237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.988198    2578 generic.go:356] "Generic (PLEG): container finished" podID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerID="d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c" exitCode=0
Sep 06 12:31:02.988375 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.988266    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"
Sep 06 12:31:02.988375 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.988283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" event={"ID":"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66","Type":"ContainerDied","Data":"d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c"}
Sep 06 12:31:02.988375 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.988340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7" event={"ID":"e3ed3b6b-f9cd-4f4a-9728-9aea41162a66","Type":"ContainerDied","Data":"0002f61d0b10889ca47441501daf9567d83ca874d8e16f35549bbe06f8d55a12"}
Sep 06 12:31:02.988375 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.988363    2578 scope.go:117] "RemoveContainer" containerID="d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c"
Sep 06 12:31:02.997631 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:02.997615    2578 scope.go:117] "RemoveContainer" containerID="5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"
Sep 06 12:31:03.004460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:03.004432    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"]
Sep 06 12:31:03.006495 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:03.006479    2578 scope.go:117] "RemoveContainer" containerID="d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c"
Sep 06 12:31:03.006755 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:31:03.006738    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c\": container with ID starting with d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c not found: ID does not exist" containerID="d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c"
Sep 06 12:31:03.006822 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:03.006763    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c"} err="failed to get container status \"d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c\": rpc error: code = NotFound desc = could not find container \"d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c\": container with ID starting with d0f4fd4b5d1dcd88a26ff94b5be484458530bf11817381917e6d24c0e038183c not found: ID does not exist"
Sep 06 12:31:03.006822 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:03.006779    2578 scope.go:117] "RemoveContainer" containerID="5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"
Sep 06 12:31:03.007035 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:31:03.007017    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7\": container with ID starting with 5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7 not found: ID does not exist" containerID="5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"
Sep 06 12:31:03.007093 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:03.007044    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7"} err="failed to get container status \"5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7\": rpc error: code = NotFound desc = could not find container \"5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7\": container with ID starting with 5ab51aef20f4e5f404a828b6a3024af7a5a7e43cf84843cbba3297d5994f07b7 not found: ID does not exist"
Sep 06 12:31:03.007135 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:03.007100    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8f9eca99-openshift-default-db9896768-hmmv7"]
Sep 06 12:31:04.668076 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:04.668045    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" path="/var/lib/kubelet/pods/e3ed3b6b-f9cd-4f4a-9728-9aea41162a66/volumes"
Sep 06 12:31:10.208900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:10.208869    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:31:21.114968 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:21.114935    2578 generic.go:356] "Generic (PLEG): container finished" podID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerID="2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9" exitCode=0
Sep 06 12:31:21.115407 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:21.115007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" event={"ID":"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe","Type":"ContainerDied","Data":"2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"}
Sep 06 12:31:21.115459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:21.115410    2578 scope.go:117] "RemoveContainer" containerID="2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"
Sep 06 12:31:21.116547 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:21.116520    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:21.116620 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:21.116604    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:21.116658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:21.116645    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:22.123001 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:22.122970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" event={"ID":"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe","Type":"ContainerStarted","Data":"b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce"}
Sep 06 12:31:22.519141 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:22.519104    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:22.519383 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:22.519356    2578 patch_prober.go:28] interesting pod/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 06 12:31:22.519467 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:22.519418    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 06 12:31:23.519475 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:23.519438    2578 patch_prober.go:28] interesting pod/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 06 12:31:23.519867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:23.519505    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 06 12:31:24.519159 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:24.519122    2578 patch_prober.go:28] interesting pod/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 06 12:31:24.519337 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:24.519206    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 06 12:31:25.365962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.365925    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"]
Sep 06 12:31:25.366592 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.366568    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy"
Sep 06 12:31:25.366675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.366594    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy"
Sep 06 12:31:25.366675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.366631    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy"
Sep 06 12:31:25.366675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.366642    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy"
Sep 06 12:31:25.366860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.366734    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy"
Sep 06 12:31:25.370341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.370319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:25.373380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.373355    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:31:25.373677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.373654    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:31:25.374705 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.374675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"]
Sep 06 12:31:25.457107 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.457074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f876bfc6-7cc8-4503-b0fc-de2a160b6d26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg\" (UID: \"f876bfc6-7cc8-4503-b0fc-de2a160b6d26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:25.519449 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.519412    2578 patch_prober.go:28] interesting pod/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 06 12:31:25.519630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.519498    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 06 12:31:25.557886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.557848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f876bfc6-7cc8-4503-b0fc-de2a160b6d26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg\" (UID: \"f876bfc6-7cc8-4503-b0fc-de2a160b6d26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:25.558783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.558752    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f876bfc6-7cc8-4503-b0fc-de2a160b6d26-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg\" (UID: \"f876bfc6-7cc8-4503-b0fc-de2a160b6d26\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:25.686362 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.686275    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:25.963189 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:25.963137    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"]
Sep 06 12:31:26.147069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:26.147036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg" event={"ID":"f876bfc6-7cc8-4503-b0fc-de2a160b6d26","Type":"ContainerStarted","Data":"29299d14b3dc30965a0d84f4b1cb2a85ae769ce9d12a40434f558fc7e8736199"}
Sep 06 12:31:26.519588 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:26.519541    2578 patch_prober.go:28] interesting pod/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 06 12:31:26.520050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:26.520023    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 06 12:31:26.909585 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:26.909541    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:31:27.155989 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:27.155951    2578 generic.go:356] "Generic (PLEG): container finished" podID="f876bfc6-7cc8-4503-b0fc-de2a160b6d26" containerID="d35907acdf58f62a343eb380c1d7d6a9fc7404aef179d65f976189f6ff225ff7" exitCode=0
Sep 06 12:31:27.156230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:27.156034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg" event={"ID":"f876bfc6-7cc8-4503-b0fc-de2a160b6d26","Type":"ContainerDied","Data":"d35907acdf58f62a343eb380c1d7d6a9fc7404aef179d65f976189f6ff225ff7"}
Sep 06 12:31:27.523462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:27.523430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:27.523910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:27.523712    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:27.524512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:27.524497    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:28.307926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:28.307900    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:28.387575 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:28.387544    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f876bfc6-7cc8-4503-b0fc-de2a160b6d26-maas-api-service-ca\") pod \"f876bfc6-7cc8-4503-b0fc-de2a160b6d26\" (UID: \"f876bfc6-7cc8-4503-b0fc-de2a160b6d26\") "
Sep 06 12:31:28.387941 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:28.387911    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f876bfc6-7cc8-4503-b0fc-de2a160b6d26-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f876bfc6-7cc8-4503-b0fc-de2a160b6d26" (UID: "f876bfc6-7cc8-4503-b0fc-de2a160b6d26"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:31:28.488550 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:28.488503    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f876bfc6-7cc8-4503-b0fc-de2a160b6d26-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:29.169931 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:29.169902    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"
Sep 06 12:31:29.170335 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:29.169937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg" event={"ID":"f876bfc6-7cc8-4503-b0fc-de2a160b6d26","Type":"ContainerDied","Data":"29299d14b3dc30965a0d84f4b1cb2a85ae769ce9d12a40434f558fc7e8736199"}
Sep 06 12:31:29.170335 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:29.169982    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29299d14b3dc30965a0d84f4b1cb2a85ae769ce9d12a40434f558fc7e8736199"
Sep 06 12:31:31.637108 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:31.637072    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"]
Sep 06 12:31:31.639522 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:31.639495    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-924ef9c2-ww6vg"]
Sep 06 12:31:31.798411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:31.798378    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"]
Sep 06 12:31:31.798616 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:31.798591    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy" containerID="cri-o://b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce" gracePeriod=30
Sep 06 12:31:32.475112 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.475077    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"]
Sep 06 12:31:32.475524 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.475510    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f876bfc6-7cc8-4503-b0fc-de2a160b6d26" containerName="revoke-keys"
Sep 06 12:31:32.475585 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.475526    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f876bfc6-7cc8-4503-b0fc-de2a160b6d26" containerName="revoke-keys"
Sep 06 12:31:32.475626 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.475606    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f876bfc6-7cc8-4503-b0fc-de2a160b6d26" containerName="revoke-keys"
Sep 06 12:31:32.475626 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.475616    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3ed3b6b-f9cd-4f4a-9728-9aea41162a66" containerName="istio-proxy"
Sep 06 12:31:32.478816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.478798    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.481496 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.481477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c85cb5d0-openshift-default-dockercfg-wffqw\""
Sep 06 12:31:32.493894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.493870    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"]
Sep 06 12:31:32.630267 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630232    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-credential-socket\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630267 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-data\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630474 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5nf\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-kube-api-access-lx5nf\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630474 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-envoy\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630474 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0efbb89b-4913-417f-9510-2037f5a85d50-istiod-ca-cert\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630474 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630466    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-istio-token\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630606 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630493    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0efbb89b-4913-417f-9510-2037f5a85d50-istio-podinfo\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630606 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-socket\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.630606 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.630584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-certs\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.669856 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.669816    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f876bfc6-7cc8-4503-b0fc-de2a160b6d26" path="/var/lib/kubelet/pods/f876bfc6-7cc8-4503-b0fc-de2a160b6d26/volumes"
Sep 06 12:31:32.731054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.730973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-istio-token\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0efbb89b-4913-417f-9510-2037f5a85d50-istio-podinfo\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-socket\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-certs\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731274    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-credential-socket\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-data\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5nf\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-kube-api-access-lx5nf\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-envoy\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-socket\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731547    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0efbb89b-4913-417f-9510-2037f5a85d50-istiod-ca-cert\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-certs\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731765 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-credential-socket\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.731824 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.731790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-data\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.732218 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.732193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0efbb89b-4913-417f-9510-2037f5a85d50-istiod-ca-cert\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.733631 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.733607    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-envoy\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.733727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.733613    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0efbb89b-4913-417f-9510-2037f5a85d50-istio-podinfo\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.738555 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.738536    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-istio-token\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.738665 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.738612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5nf\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-kube-api-access-lx5nf\") pod \"e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") " pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:32.789659 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:32.789636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:33.066250 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.066220    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"]
Sep 06 12:31:33.067377 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:31:33.067351    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efbb89b_4913_417f_9510_2037f5a85d50.slice/crio-4521ff96c191edcd9d1e0e52b8fb7c498d1f651f93a03d134846064f442cc679 WatchSource:0}: Error finding container 4521ff96c191edcd9d1e0e52b8fb7c498d1f651f93a03d134846064f442cc679: Status 404 returned error can't find the container with id 4521ff96c191edcd9d1e0e52b8fb7c498d1f651f93a03d134846064f442cc679
Sep 06 12:31:33.069603 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.069574    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:33.069686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.069640    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:33.069686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.069667    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:33.196848 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.196805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" event={"ID":"0efbb89b-4913-417f-9510-2037f5a85d50","Type":"ContainerStarted","Data":"05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"}
Sep 06 12:31:33.197022 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.196868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" event={"ID":"0efbb89b-4913-417f-9510-2037f5a85d50","Type":"ContainerStarted","Data":"4521ff96c191edcd9d1e0e52b8fb7c498d1f651f93a03d134846064f442cc679"}
Sep 06 12:31:33.216033 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.215989    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podStartSLOduration=1.215973522 podStartE2EDuration="1.215973522s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:31:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:31:33.21445894 +0000 UTC m=+835.027883033" watchObservedRunningTime="2026-09-06 12:31:33.215973522 +0000 UTC m=+835.029397668"
Sep 06 12:31:33.790597 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:33.790551    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:34.795800 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:34.795767    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:35.209804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:35.209779    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:35.210668 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:35.210649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:37.068704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.068643    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:37.176204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176138    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-credential-socket\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-podinfo\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176282    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kmv9c\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-kube-api-access-kmv9c\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176311    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istiod-ca-cert\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176343    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-envoy\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:37.176560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-data\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176429    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-socket\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176482    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-token\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-certs\") pod \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\" (UID: \"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe\") "
Sep 06 12:31:37.176833 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176631    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-data" (OuterVolumeSpecName: "istio-data") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:37.176833 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176745    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:31:37.176944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176838    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:37.176944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176917    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.177050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176933    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:37.177050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176952    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.177050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.176982    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.178717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.178678    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:31:37.178717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.178697    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-kube-api-access-kmv9c" (OuterVolumeSpecName: "kube-api-access-kmv9c") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "kube-api-access-kmv9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:31:37.178897 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.178733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-token" (OuterVolumeSpecName: "istio-token") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:31:37.178897 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.178863    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" (UID: "7d572b8c-c69a-4dc2-acd4-d198bc87ffbe"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:31:37.222428 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.222403    2578 generic.go:356] "Generic (PLEG): container finished" podID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerID="b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce" exitCode=0
Sep 06 12:31:37.222541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.222457    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"
Sep 06 12:31:37.222541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.222486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" event={"ID":"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe","Type":"ContainerDied","Data":"b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce"}
Sep 06 12:31:37.222647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.222563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c" event={"ID":"7d572b8c-c69a-4dc2-acd4-d198bc87ffbe","Type":"ContainerDied","Data":"eee80e8d5117dd54c0bf3d38c916f13a4a07ab855037247043b782d4801dd175"}
Sep 06 12:31:37.222647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.222588    2578 scope.go:117] "RemoveContainer" containerID="b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce"
Sep 06 12:31:37.231991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.231973    2578 scope.go:117] "RemoveContainer" containerID="2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"
Sep 06 12:31:37.240210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.240192    2578 scope.go:117] "RemoveContainer" containerID="b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce"
Sep 06 12:31:37.240514 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:31:37.240488    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce\": container with ID starting with b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce not found: ID does not exist" containerID="b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce"
Sep 06 12:31:37.240625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.240525    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce"} err="failed to get container status \"b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce\": rpc error: code = NotFound desc = could not find container \"b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce\": container with ID starting with b151c485ce2c72724886da637d8ee376c12205aca2caa0962182897c9e79a5ce not found: ID does not exist"
Sep 06 12:31:37.240625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.240548    2578 scope.go:117] "RemoveContainer" containerID="2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"
Sep 06 12:31:37.240885 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:31:37.240828    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9\": container with ID starting with 2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9 not found: ID does not exist" containerID="2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"
Sep 06 12:31:37.240885 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.240860    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9"} err="failed to get container status \"2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9\": rpc error: code = NotFound desc = could not find container \"2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9\": container with ID starting with 2e5fe320b4c106c4127cc579b93959165589f193253e3bb96f13191b53b8daa9 not found: ID does not exist"
Sep 06 12:31:37.243516 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.243497    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"]
Sep 06 12:31:37.247266 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.247243    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-924ef9c2-gw-openshift-default-79787b4cc6-qn45c"]
Sep 06 12:31:37.277921 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.277900    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.277921 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.277920    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.278039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.277930    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kmv9c\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-kube-api-access-kmv9c\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.278039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.277940    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.278039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.277949    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:37.278039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:37.277957    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:31:38.669811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:38.669776    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" path="/var/lib/kubelet/pods/7d572b8c-c69a-4dc2-acd4-d198bc87ffbe/volumes"
Sep 06 12:31:39.290476 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.290440    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"]
Sep 06 12:31:39.290980 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.290960    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy"
Sep 06 12:31:39.290980 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.290982    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy"
Sep 06 12:31:39.291138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.291000    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy"
Sep 06 12:31:39.291138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.291006    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy"
Sep 06 12:31:39.291138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.291073    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy"
Sep 06 12:31:39.291138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.291082    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d572b8c-c69a-4dc2-acd4-d198bc87ffbe" containerName="istio-proxy"
Sep 06 12:31:39.295726 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.295710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.298211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.298194    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-conflict-a-cf61fce7-kserve-self-signed-certs\""
Sep 06 12:31:39.302793 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.302772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"]
Sep 06 12:31:39.394926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.394898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tls-certs\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.395059 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.394955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tmp-dir\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.395059 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.395014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-home\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.395173 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.395061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pt9ns\" (UniqueName: \"kubernetes.io/projected/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-kube-api-access-pt9ns\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.395173 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.395097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-model-cache\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.395173 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.395165    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-dshm\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496214 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pt9ns\" (UniqueName: \"kubernetes.io/projected/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-kube-api-access-pt9ns\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-model-cache\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-dshm\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tls-certs\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tmp-dir\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-home\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-model-cache\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496780 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tmp-dir\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.496845 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.496827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-home\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.498531 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.498506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-dshm\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.498627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.498612    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tls-certs\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.503684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.503662    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pt9ns\" (UniqueName: \"kubernetes.io/projected/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-kube-api-access-pt9ns\") pod \"e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") " pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.606367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.606298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:39.878536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:39.878508    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"]
Sep 06 12:31:39.880370 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:31:39.880342    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0dbf8e15_4898_42f3_aec1_4e2906fab5ac.slice/crio-a3dc89520bcef268a56be92fce163afdf6d306d1287447b8cef780dd871d03f3 WatchSource:0}: Error finding container a3dc89520bcef268a56be92fce163afdf6d306d1287447b8cef780dd871d03f3: Status 404 returned error can't find the container with id a3dc89520bcef268a56be92fce163afdf6d306d1287447b8cef780dd871d03f3
Sep 06 12:31:40.242559 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:40.242521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6" event={"ID":"0dbf8e15-4898-42f3-aec1-4e2906fab5ac","Type":"ContainerStarted","Data":"92f97becd8e995398f2ff8ad030ed72cf5b6f6823e53874f9093e13f5c8d1464"}
Sep 06 12:31:40.242754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:40.242569    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6" event={"ID":"0dbf8e15-4898-42f3-aec1-4e2906fab5ac","Type":"ContainerStarted","Data":"a3dc89520bcef268a56be92fce163afdf6d306d1287447b8cef780dd871d03f3"}
Sep 06 12:31:40.260000 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:40.259947    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6" podStartSLOduration=1.259931222 podStartE2EDuration="1.259931222s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:31:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:31:40.257593046 +0000 UTC m=+842.071017123" watchObservedRunningTime="2026-09-06 12:31:40.259931222 +0000 UTC m=+842.073355651"
Sep 06 12:31:41.716193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:41.716161    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:31:49.607283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:49.607242    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:49.607705 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:49.607317    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:49.620233 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:49.620207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:50.325290 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:50.325258    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:31:51.252323 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:51.252280    2578 patch_prober.go:28] interesting pod/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:31:51.252786 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:51.252361    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:31:52.329662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:52.329575    2578 generic.go:356] "Generic (PLEG): container finished" podID="0efbb89b-4913-417f-9510-2037f5a85d50" containerID="05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083" exitCode=0
Sep 06 12:31:52.329662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:52.329648    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" event={"ID":"0efbb89b-4913-417f-9510-2037f5a85d50","Type":"ContainerDied","Data":"05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"}
Sep 06 12:31:52.330223 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:52.330206    2578 scope.go:117] "RemoveContainer" containerID="05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"
Sep 06 12:31:52.331439 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:52.331409    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:52.331503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:52.331488    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:52.331543 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:52.331525    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:31:53.337706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:53.337669    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" event={"ID":"0efbb89b-4913-417f-9510-2037f5a85d50","Type":"ContainerStarted","Data":"48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5"}
Sep 06 12:31:53.790233 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:53.790195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:53.790443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:53.790418    2578 patch_prober.go:28] interesting pod/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 12:31:53.790501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:53.790481    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 12:31:54.789957 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:54.789918    2578 patch_prober.go:28] interesting pod/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 12:31:54.790460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:54.789990    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 12:31:55.790006 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:55.789968    2578 patch_prober.go:28] interesting pod/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 12:31:55.790410 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:55.790027    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 12:31:56.790643 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:56.790606    2578 patch_prober.go:28] interesting pod/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 12:31:56.791040 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:56.790659    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 12:31:57.790098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:57.790065    2578 patch_prober.go:28] interesting pod/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused" start-of-body=
Sep 06 12:31:57.790318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:57.790124    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.63:15021/healthz/ready\": dial tcp 10.132.0.63:15021: connect: connection refused"
Sep 06 12:31:58.793320 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:58.793290    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:58.793756 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:58.793688    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:31:58.794434 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:31:58.794414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:32:00.170187 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.169030    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"]
Sep 06 12:32:00.175560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.175529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:00.178951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.178093    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:32:00.178951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.178450    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:32:00.178951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.178810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"]
Sep 06 12:32:00.297021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.296991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/238b393b-bc2e-47b1-b813-2533ab934665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj\" (UID: \"238b393b-bc2e-47b1-b813-2533ab934665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:00.397513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.397487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/238b393b-bc2e-47b1-b813-2533ab934665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj\" (UID: \"238b393b-bc2e-47b1-b813-2533ab934665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:00.398063 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.398043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/238b393b-bc2e-47b1-b813-2533ab934665-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj\" (UID: \"238b393b-bc2e-47b1-b813-2533ab934665\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:00.487901 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.487882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:00.759873 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:00.759739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"]
Sep 06 12:32:00.762241 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:32:00.762206    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod238b393b_bc2e_47b1_b813_2533ab934665.slice/crio-93f2127c5903ffd8d3a70a606e143379918d2d33e33794dbd6d44b6672dddaa6 WatchSource:0}: Error finding container 93f2127c5903ffd8d3a70a606e143379918d2d33e33794dbd6d44b6672dddaa6: Status 404 returned error can't find the container with id 93f2127c5903ffd8d3a70a606e143379918d2d33e33794dbd6d44b6672dddaa6
Sep 06 12:32:01.395738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:01.395653    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj" event={"ID":"238b393b-bc2e-47b1-b813-2533ab934665","Type":"ContainerStarted","Data":"934d1d8bcc7816b60b05ab67e4e0b64b5ff3fab276cc16f61ce350ba1c56ffae"}
Sep 06 12:32:01.395738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:01.395718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj" event={"ID":"238b393b-bc2e-47b1-b813-2533ab934665","Type":"ContainerStarted","Data":"93f2127c5903ffd8d3a70a606e143379918d2d33e33794dbd6d44b6672dddaa6"}
Sep 06 12:32:01.409193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:01.409142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:32:01.409655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:01.409612    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj" podStartSLOduration=1.409598784 podStartE2EDuration="1.409598784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:32:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:32:01.408784991 +0000 UTC m=+863.222209073" watchObservedRunningTime="2026-09-06 12:32:01.409598784 +0000 UTC m=+863.223022863"
Sep 06 12:32:02.402671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:02.402639    2578 generic.go:356] "Generic (PLEG): container finished" podID="238b393b-bc2e-47b1-b813-2533ab934665" containerID="934d1d8bcc7816b60b05ab67e4e0b64b5ff3fab276cc16f61ce350ba1c56ffae" exitCode=0
Sep 06 12:32:02.403035 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:02.402734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj" event={"ID":"238b393b-bc2e-47b1-b813-2533ab934665","Type":"ContainerDied","Data":"934d1d8bcc7816b60b05ab67e4e0b64b5ff3fab276cc16f61ce350ba1c56ffae"}
Sep 06 12:32:03.549103 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:03.549074    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:03.625892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:03.625864    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/238b393b-bc2e-47b1-b813-2533ab934665-maas-api-service-ca\") pod \"238b393b-bc2e-47b1-b813-2533ab934665\" (UID: \"238b393b-bc2e-47b1-b813-2533ab934665\") "
Sep 06 12:32:03.626215 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:03.626190    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/238b393b-bc2e-47b1-b813-2533ab934665-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "238b393b-bc2e-47b1-b813-2533ab934665" (UID: "238b393b-bc2e-47b1-b813-2533ab934665"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:03.727456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:03.727426    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/238b393b-bc2e-47b1-b813-2533ab934665-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:04.415988 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:04.415955    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"
Sep 06 12:32:04.416168 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:04.415989    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj" event={"ID":"238b393b-bc2e-47b1-b813-2533ab934665","Type":"ContainerDied","Data":"93f2127c5903ffd8d3a70a606e143379918d2d33e33794dbd6d44b6672dddaa6"}
Sep 06 12:32:04.416168 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:04.416059    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93f2127c5903ffd8d3a70a606e143379918d2d33e33794dbd6d44b6672dddaa6"
Sep 06 12:32:06.336339 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:06.336310    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"]
Sep 06 12:32:06.338621 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:06.338600    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-c85cb5d0-hzjgj"]
Sep 06 12:32:06.668343 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:06.668262    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="238b393b-bc2e-47b1-b813-2533ab934665" path="/var/lib/kubelet/pods/238b393b-bc2e-47b1-b813-2533ab934665/volumes"
Sep 06 12:32:07.393477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:07.393438    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"]
Sep 06 12:32:07.393963 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:07.393693    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy" containerID="cri-o://48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5" gracePeriod=30
Sep 06 12:32:08.116160 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.116115    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"]
Sep 06 12:32:08.116557 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.116542    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="238b393b-bc2e-47b1-b813-2533ab934665" containerName="revoke-keys"
Sep 06 12:32:08.116616 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.116559    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="238b393b-bc2e-47b1-b813-2533ab934665" containerName="revoke-keys"
Sep 06 12:32:08.116655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.116626    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="238b393b-bc2e-47b1-b813-2533ab934665" containerName="revoke-keys"
Sep 06 12:32:08.119870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.119847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.122358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.122338    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-ff8cf183-openshift-default-dockercfg-sqxvn\""
Sep 06 12:32:08.133990 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.133964    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"]
Sep 06 12:32:08.165859 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.165833    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-certs\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.165972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.165898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-podinfo\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.165972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.165936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-token\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.165972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.165964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-data\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.166086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.165981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e39890b-8560-4e9c-acf0-9d110778d6d8-istiod-ca-cert\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.166086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.166071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-socket\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.166179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.166103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-envoy\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.166179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.166123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-credential-socket\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.166252 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.166208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-kube-api-access-dx7v5\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-credential-socket\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-kube-api-access-dx7v5\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267757    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-certs\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-podinfo\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-token\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-data\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.267976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e39890b-8560-4e9c-acf0-9d110778d6d8-istiod-ca-cert\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268126 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.267992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-socket\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268126 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.268054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-envoy\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268126 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.268084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-credential-socket\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.268122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-certs\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268360 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.268319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-data\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268485 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.268463    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-socket\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.268730 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.268714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e39890b-8560-4e9c-acf0-9d110778d6d8-istiod-ca-cert\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.270183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.270160    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-envoy\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.270433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.270411    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-podinfo\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.280271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.280249    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-kube-api-access-dx7v5\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.280967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.280945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-token\") pod \"e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") " pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.430472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.430377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:08.710785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.710756    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"]
Sep 06 12:32:08.711993 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:32:08.711961    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e39890b_8560_4e9c_acf0_9d110778d6d8.slice/crio-6441b408c0d8ce4602d4f14c98568e63360ec6ddab36642dffcbaf363a427f88 WatchSource:0}: Error finding container 6441b408c0d8ce4602d4f14c98568e63360ec6ddab36642dffcbaf363a427f88: Status 404 returned error can't find the container with id 6441b408c0d8ce4602d4f14c98568e63360ec6ddab36642dffcbaf363a427f88
Sep 06 12:32:08.713953 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.713920    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:32:08.714019 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.713994    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:32:08.714057 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:08.714021    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:32:09.450790 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:09.450756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" event={"ID":"5e39890b-8560-4e9c-acf0-9d110778d6d8","Type":"ContainerStarted","Data":"3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"}
Sep 06 12:32:09.451296 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:09.450856    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" event={"ID":"5e39890b-8560-4e9c-acf0-9d110778d6d8","Type":"ContainerStarted","Data":"6441b408c0d8ce4602d4f14c98568e63360ec6ddab36642dffcbaf363a427f88"}
Sep 06 12:32:09.471698 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:09.471650    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podStartSLOduration=1.471636795 podStartE2EDuration="1.471636795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:32:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:32:09.4689503 +0000 UTC m=+871.282374376" watchObservedRunningTime="2026-09-06 12:32:09.471636795 +0000 UTC m=+871.285060874"
Sep 06 12:32:10.431259 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:10.431227    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:10.436435 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:10.436411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:10.458769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:10.458729    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:10.459650 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:10.459629    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:12.660893 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.660836    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:32:12.811746 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-credential-socket\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.811746 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811751    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-envoy\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.811956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811789    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-istio-token\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.811956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0efbb89b-4913-417f-9510-2037f5a85d50-istiod-ca-cert\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.811956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811901    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0efbb89b-4913-417f-9510-2037f5a85d50-istio-podinfo\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.811956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-data\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.812179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.811978    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:12.812179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812014    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-certs\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.812179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lx5nf\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-kube-api-access-lx5nf\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.812179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812080    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-socket\") pod \"0efbb89b-4913-417f-9510-2037f5a85d50\" (UID: \"0efbb89b-4913-417f-9510-2037f5a85d50\") "
Sep 06 12:32:12.812398 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812227    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-data" (OuterVolumeSpecName: "istio-data") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:12.812462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812392    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0efbb89b-4913-417f-9510-2037f5a85d50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:12.812521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812397    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:12.812521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812514    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.812630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812532    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.812630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812546    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0efbb89b-4913-417f-9510-2037f5a85d50-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.812630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.812577    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:12.813967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.813942    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:12.814130 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.814112    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-istio-token" (OuterVolumeSpecName: "istio-token") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:12.814444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.814420    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-kube-api-access-lx5nf" (OuterVolumeSpecName: "kube-api-access-lx5nf") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "kube-api-access-lx5nf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:12.814514 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.814492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0efbb89b-4913-417f-9510-2037f5a85d50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0efbb89b-4913-417f-9510-2037f5a85d50" (UID: "0efbb89b-4913-417f-9510-2037f5a85d50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:32:12.913549 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.913479    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.913549 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.913503    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lx5nf\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-kube-api-access-lx5nf\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.913549 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.913513    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.913549 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.913525    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0efbb89b-4913-417f-9510-2037f5a85d50-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.913549 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.913533    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0efbb89b-4913-417f-9510-2037f5a85d50-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:12.913549 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:12.913540    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0efbb89b-4913-417f-9510-2037f5a85d50-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:13.478238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.478203    2578 generic.go:356] "Generic (PLEG): container finished" podID="0efbb89b-4913-417f-9510-2037f5a85d50" containerID="48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5" exitCode=0
Sep 06 12:32:13.478436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.478273    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"
Sep 06 12:32:13.478436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.478288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" event={"ID":"0efbb89b-4913-417f-9510-2037f5a85d50","Type":"ContainerDied","Data":"48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5"}
Sep 06 12:32:13.478436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.478369    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b" event={"ID":"0efbb89b-4913-417f-9510-2037f5a85d50","Type":"ContainerDied","Data":"4521ff96c191edcd9d1e0e52b8fb7c498d1f651f93a03d134846064f442cc679"}
Sep 06 12:32:13.478436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.478393    2578 scope.go:117] "RemoveContainer" containerID="48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5"
Sep 06 12:32:13.488125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.488108    2578 scope.go:117] "RemoveContainer" containerID="05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"
Sep 06 12:32:13.498244 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.498127    2578 scope.go:117] "RemoveContainer" containerID="48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5"
Sep 06 12:32:13.498718 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:32:13.498528    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5\": container with ID starting with 48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5 not found: ID does not exist" containerID="48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5"
Sep 06 12:32:13.498718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.498563    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5"} err="failed to get container status \"48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5\": rpc error: code = NotFound desc = could not find container \"48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5\": container with ID starting with 48b258f80bbbf56ab99a93f7fa59ec366aa8d0cbfdacfe1000d45ee1598c1fd5 not found: ID does not exist"
Sep 06 12:32:13.498718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.498589    2578 scope.go:117] "RemoveContainer" containerID="05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"
Sep 06 12:32:13.503492 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:32:13.503458    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083\": container with ID starting with 05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083 not found: ID does not exist" containerID="05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"
Sep 06 12:32:13.503600 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.503501    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083"} err="failed to get container status \"05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083\": rpc error: code = NotFound desc = could not find container \"05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083\": container with ID starting with 05d7888c5f6e4c489f832ca6f2bfc51de7bf9a2ef0f04ec47cc7822610dc5083 not found: ID does not exist"
Sep 06 12:32:13.503600 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.503565    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"]
Sep 06 12:32:13.506978 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:13.506957    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c85cb5d0-openshift-default-dbb7b878d-x825b"]
Sep 06 12:32:14.669129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:14.669099    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" path="/var/lib/kubelet/pods/0efbb89b-4913-417f-9510-2037f5a85d50/volumes"
Sep 06 12:32:21.715080 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:21.715041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:32:31.601775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.601695    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"]
Sep 06 12:32:31.602382 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.602361    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy"
Sep 06 12:32:31.602431 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.602385    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy"
Sep 06 12:32:31.602431 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.602403    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy"
Sep 06 12:32:31.602431 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.602411    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy"
Sep 06 12:32:31.602536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.602522    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy"
Sep 06 12:32:31.607631 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.607610    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:31.611833 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.611812    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:32:31.612009 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.611994    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:32:31.621533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.621506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"]
Sep 06 12:32:31.791646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.791576    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de56945-804e-4deb-93af-545445cb9c3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn\" (UID: \"1de56945-804e-4deb-93af-545445cb9c3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:31.892675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.892471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de56945-804e-4deb-93af-545445cb9c3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn\" (UID: \"1de56945-804e-4deb-93af-545445cb9c3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:31.893283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.893256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de56945-804e-4deb-93af-545445cb9c3a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn\" (UID: \"1de56945-804e-4deb-93af-545445cb9c3a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:31.918432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:31.918405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:32.199637 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.199294    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"]
Sep 06 12:32:32.200418 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:32:32.200391    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1de56945_804e_4deb_93af_545445cb9c3a.slice/crio-300960b09c899065496af6e42ec254ae150c2c3cf95d9192855f272f6a5ce623 WatchSource:0}: Error finding container 300960b09c899065496af6e42ec254ae150c2c3cf95d9192855f272f6a5ce623: Status 404 returned error can't find the container with id 300960b09c899065496af6e42ec254ae150c2c3cf95d9192855f272f6a5ce623
Sep 06 12:32:32.606290 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.606260    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerID="3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6" exitCode=0
Sep 06 12:32:32.606671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.606335    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" event={"ID":"5e39890b-8560-4e9c-acf0-9d110778d6d8","Type":"ContainerDied","Data":"3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"}
Sep 06 12:32:32.606771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.606756    2578 scope.go:117] "RemoveContainer" containerID="3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"
Sep 06 12:32:32.607962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.607934    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:32:32.608051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.608011    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:32:32.608051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.608048    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:32:32.608226 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.608207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn" event={"ID":"1de56945-804e-4deb-93af-545445cb9c3a","Type":"ContainerStarted","Data":"a66fe6cdd76e2d9ff64fbb3c5070b9bdb3be156390d7c663baa7582a012c57fe"}
Sep 06 12:32:32.608270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.608257    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn" event={"ID":"1de56945-804e-4deb-93af-545445cb9c3a","Type":"ContainerStarted","Data":"300960b09c899065496af6e42ec254ae150c2c3cf95d9192855f272f6a5ce623"}
Sep 06 12:32:32.646250 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:32.646200    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn" podStartSLOduration=1.6461809509999998 podStartE2EDuration="1.646180951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:32:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:32:32.642497199 +0000 UTC m=+894.455921280" watchObservedRunningTime="2026-09-06 12:32:32.646180951 +0000 UTC m=+894.459605031"
Sep 06 12:32:33.616085 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:33.616045    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" event={"ID":"5e39890b-8560-4e9c-acf0-9d110778d6d8","Type":"ContainerStarted","Data":"7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28"}
Sep 06 12:32:33.617654 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:33.617625    2578 generic.go:356] "Generic (PLEG): container finished" podID="1de56945-804e-4deb-93af-545445cb9c3a" containerID="a66fe6cdd76e2d9ff64fbb3c5070b9bdb3be156390d7c663baa7582a012c57fe" exitCode=0
Sep 06 12:32:33.617764 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:33.617701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn" event={"ID":"1de56945-804e-4deb-93af-545445cb9c3a","Type":"ContainerDied","Data":"a66fe6cdd76e2d9ff64fbb3c5070b9bdb3be156390d7c663baa7582a012c57fe"}
Sep 06 12:32:34.431179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.431132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:34.431352 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.431333    2578 patch_prober.go:28] interesting pod/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 06 12:32:34.431403 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.431381    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 06 12:32:34.807242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.807219    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:34.826961 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.826930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de56945-804e-4deb-93af-545445cb9c3a-maas-api-service-ca\") pod \"1de56945-804e-4deb-93af-545445cb9c3a\" (UID: \"1de56945-804e-4deb-93af-545445cb9c3a\") "
Sep 06 12:32:34.827333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.827307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1de56945-804e-4deb-93af-545445cb9c3a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1de56945-804e-4deb-93af-545445cb9c3a" (UID: "1de56945-804e-4deb-93af-545445cb9c3a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:34.928544 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:34.928517    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1de56945-804e-4deb-93af-545445cb9c3a-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:35.430687 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.430649    2578 patch_prober.go:28] interesting pod/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 06 12:32:35.430887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.430706    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 06 12:32:35.611297 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.611266    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"]
Sep 06 12:32:35.611701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.611688    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1de56945-804e-4deb-93af-545445cb9c3a" containerName="revoke-keys"
Sep 06 12:32:35.611753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.611703    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1de56945-804e-4deb-93af-545445cb9c3a" containerName="revoke-keys"
Sep 06 12:32:35.611786 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.611764    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1de56945-804e-4deb-93af-545445cb9c3a" containerName="revoke-keys"
Sep 06 12:32:35.611786 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.611779    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0efbb89b-4913-417f-9510-2037f5a85d50" containerName="istio-proxy"
Sep 06 12:32:35.622409 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.622384    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"]
Sep 06 12:32:35.622557 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.622497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:35.635193 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.635173    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"
Sep 06 12:32:35.635316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.635193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn" event={"ID":"1de56945-804e-4deb-93af-545445cb9c3a","Type":"ContainerDied","Data":"300960b09c899065496af6e42ec254ae150c2c3cf95d9192855f272f6a5ce623"}
Sep 06 12:32:35.635316 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.635258    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="300960b09c899065496af6e42ec254ae150c2c3cf95d9192855f272f6a5ce623"
Sep 06 12:32:35.735747 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.735716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1babfb2a-02f9-484e-b5ed-9502ddb42f5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb\" (UID: \"1babfb2a-02f9-484e-b5ed-9502ddb42f5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:35.836490 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.836455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1babfb2a-02f9-484e-b5ed-9502ddb42f5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb\" (UID: \"1babfb2a-02f9-484e-b5ed-9502ddb42f5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:35.837035 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.837012    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1babfb2a-02f9-484e-b5ed-9502ddb42f5c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb\" (UID: \"1babfb2a-02f9-484e-b5ed-9502ddb42f5c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:35.935789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:35.935757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:36.234633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:36.234608    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"]
Sep 06 12:32:36.236089 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:32:36.236056    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1babfb2a_02f9_484e_b5ed_9502ddb42f5c.slice/crio-b41cffb09425cfb7bdb21c247be8d17fd1165c72424eebf996fe2689f1e733e3 WatchSource:0}: Error finding container b41cffb09425cfb7bdb21c247be8d17fd1165c72424eebf996fe2689f1e733e3: Status 404 returned error can't find the container with id b41cffb09425cfb7bdb21c247be8d17fd1165c72424eebf996fe2689f1e733e3
Sep 06 12:32:36.430738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:36.430705    2578 patch_prober.go:28] interesting pod/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 06 12:32:36.430899 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:36.430758    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 06 12:32:36.642315 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:36.642283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb" event={"ID":"1babfb2a-02f9-484e-b5ed-9502ddb42f5c","Type":"ContainerStarted","Data":"b41cffb09425cfb7bdb21c247be8d17fd1165c72424eebf996fe2689f1e733e3"}
Sep 06 12:32:37.431426 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:37.431393    2578 patch_prober.go:28] interesting pod/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 06 12:32:37.431773 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:37.431449    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 06 12:32:37.650074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:37.649981    2578 generic.go:356] "Generic (PLEG): container finished" podID="1babfb2a-02f9-484e-b5ed-9502ddb42f5c" containerID="720b6002f7a9509437b0f1d205ccd7b43f6f60a31390be294e388cb383a7d9e7" exitCode=0
Sep 06 12:32:37.650074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:37.650034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb" event={"ID":"1babfb2a-02f9-484e-b5ed-9502ddb42f5c","Type":"ContainerDied","Data":"720b6002f7a9509437b0f1d205ccd7b43f6f60a31390be294e388cb383a7d9e7"}
Sep 06 12:32:38.431282 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.431245    2578 patch_prober.go:28] interesting pod/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 06 12:32:38.431456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.431307    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 06 12:32:38.729511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.729482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:32:38.729777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.729755    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:32:38.825883 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.825852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:32:38.849371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.849338    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:38.973659 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.973624    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1babfb2a-02f9-484e-b5ed-9502ddb42f5c-maas-api-service-ca\") pod \"1babfb2a-02f9-484e-b5ed-9502ddb42f5c\" (UID: \"1babfb2a-02f9-484e-b5ed-9502ddb42f5c\") "
Sep 06 12:32:38.974071 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:38.974045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1babfb2a-02f9-484e-b5ed-9502ddb42f5c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1babfb2a-02f9-484e-b5ed-9502ddb42f5c" (UID: "1babfb2a-02f9-484e-b5ed-9502ddb42f5c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:39.075325 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.075287    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1babfb2a-02f9-484e-b5ed-9502ddb42f5c-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:39.435411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.435322    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:39.435866 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.435830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:39.436422 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.436400    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:39.690436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.690409    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"
Sep 06 12:32:39.690436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.690415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb" event={"ID":"1babfb2a-02f9-484e-b5ed-9502ddb42f5c","Type":"ContainerDied","Data":"b41cffb09425cfb7bdb21c247be8d17fd1165c72424eebf996fe2689f1e733e3"}
Sep 06 12:32:39.690669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:39.690463    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b41cffb09425cfb7bdb21c247be8d17fd1165c72424eebf996fe2689f1e733e3"
Sep 06 12:32:42.574875 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.574844    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"]
Sep 06 12:32:42.578759 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.578726    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-ff8cf183-ctkmb"]
Sep 06 12:32:42.668824 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.668790    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1babfb2a-02f9-484e-b5ed-9502ddb42f5c" path="/var/lib/kubelet/pods/1babfb2a-02f9-484e-b5ed-9502ddb42f5c/volumes"
Sep 06 12:32:42.707217 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.707189    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"]
Sep 06 12:32:42.707424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.707400    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy" containerID="cri-o://7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28" gracePeriod=30
Sep 06 12:32:42.796421 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.796361    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"]
Sep 06 12:32:42.798608 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:42.798582    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-0e6ab1-sdhhn"]
Sep 06 12:32:44.671571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:44.671521    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1de56945-804e-4deb-93af-545445cb9c3a" path="/var/lib/kubelet/pods/1de56945-804e-4deb-93af-545445cb9c3a/volumes"
Sep 06 12:32:47.968268 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:47.968242    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:48.060279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060208    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-kube-api-access-dx7v5\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-certs\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060268    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-socket\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060487 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060285    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-data\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060487 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060438    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-token\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060487 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-envoy\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060555    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-credential-socket\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:48.060646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060572    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:48.060646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-podinfo\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060652    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:48.060857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e39890b-8560-4e9c-acf0-9d110778d6d8-istiod-ca-cert\") pod \"5e39890b-8560-4e9c-acf0-9d110778d6d8\" (UID: \"5e39890b-8560-4e9c-acf0-9d110778d6d8\") "
Sep 06 12:32:48.060857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.060832    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:48.061046 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.061026    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.061175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.061052    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.061175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.061064    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.061175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.061072    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.061175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.061046    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e39890b-8560-4e9c-acf0-9d110778d6d8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:32:48.062732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.062708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:48.063074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.063045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:32:48.063182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.063061    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:32:48.063280 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.063258    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-kube-api-access-dx7v5" (OuterVolumeSpecName: "kube-api-access-dx7v5") pod "5e39890b-8560-4e9c-acf0-9d110778d6d8" (UID: "5e39890b-8560-4e9c-acf0-9d110778d6d8"). InnerVolumeSpecName "kube-api-access-dx7v5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:32:48.161852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.161826    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.161852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.161849    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e39890b-8560-4e9c-acf0-9d110778d6d8-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.162008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.161858    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dx7v5\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-kube-api-access-dx7v5\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.162008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.161868    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.162008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.161877    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e39890b-8560-4e9c-acf0-9d110778d6d8-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:32:48.746812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.746779    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerID="7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28" exitCode=0
Sep 06 12:32:48.746947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.746831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" event={"ID":"5e39890b-8560-4e9c-acf0-9d110778d6d8","Type":"ContainerDied","Data":"7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28"}
Sep 06 12:32:48.746947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.746837    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"
Sep 06 12:32:48.746947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.746899    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq" event={"ID":"5e39890b-8560-4e9c-acf0-9d110778d6d8","Type":"ContainerDied","Data":"6441b408c0d8ce4602d4f14c98568e63360ec6ddab36642dffcbaf363a427f88"}
Sep 06 12:32:48.746947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.746922    2578 scope.go:117] "RemoveContainer" containerID="7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28"
Sep 06 12:32:48.758160 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.758125    2578 scope.go:117] "RemoveContainer" containerID="3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"
Sep 06 12:32:48.766770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.766728    2578 scope.go:117] "RemoveContainer" containerID="7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28"
Sep 06 12:32:48.767252 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:32:48.767187    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28\": container with ID starting with 7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28 not found: ID does not exist" containerID="7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28"
Sep 06 12:32:48.767392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.767224    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28"} err="failed to get container status \"7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28\": rpc error: code = NotFound desc = could not find container \"7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28\": container with ID starting with 7104ee450f926f08a786562d4e3a93d048f2885ab3d0e6a97200f2b5699eef28 not found: ID does not exist"
Sep 06 12:32:48.767392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.767394    2578 scope.go:117] "RemoveContainer" containerID="3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"
Sep 06 12:32:48.767769 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:32:48.767744    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6\": container with ID starting with 3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6 not found: ID does not exist" containerID="3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"
Sep 06 12:32:48.767852 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.767777    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6"} err="failed to get container status \"3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6\": rpc error: code = NotFound desc = could not find container \"3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6\": container with ID starting with 3070cd87f4f7f62983826438f5286545fad9b3d9062f80492a38b3ea6be95fc6 not found: ID does not exist"
Sep 06 12:32:48.769935 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.769916    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"]
Sep 06 12:32:48.777290 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:48.777269    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-ff8cf183-openshift-default-7446797c48-vhmsq"]
Sep 06 12:32:50.670355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:50.670321    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" path="/var/lib/kubelet/pods/5e39890b-8560-4e9c-acf0-9d110778d6d8/volumes"
Sep 06 12:32:55.539679 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:32:55.539636    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:33:13.150459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:13.150419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:33:22.894625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:22.894590    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"]
Sep 06 12:33:26.210081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.210048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:33:26.292810 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.292777    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"]
Sep 06 12:33:26.293032 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.293009    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy" containerID="cri-o://54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4" gracePeriod=30
Sep 06 12:33:26.991458 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.991374    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"]
Sep 06 12:33:26.991902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.991874    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy"
Sep 06 12:33:26.991902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.991897    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy"
Sep 06 12:33:26.992081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.991918    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1babfb2a-02f9-484e-b5ed-9502ddb42f5c" containerName="revoke-keys"
Sep 06 12:33:26.992081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.991926    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1babfb2a-02f9-484e-b5ed-9502ddb42f5c" containerName="revoke-keys"
Sep 06 12:33:26.992081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.992036    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy"
Sep 06 12:33:26.992081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.992047    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy"
Sep 06 12:33:26.992081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.992058    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1babfb2a-02f9-484e-b5ed-9502ddb42f5c" containerName="revoke-keys"
Sep 06 12:33:26.995757 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.995737    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:26.998356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:26.998335    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-1655f5-openshift-default-dockercfg-p59hp\""
Sep 06 12:33:27.008547 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.008520    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"]
Sep 06 12:33:27.113374 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113347    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-token\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-socket\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-data\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-podinfo\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-envoy\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9309af67-bb9e-45aa-9e69-9f3e45a26008-istiod-ca-cert\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-certs\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tprwn\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-kube-api-access-tprwn\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.113662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.113631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-credential-socket\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.214766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-certs\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.214766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tprwn\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-kube-api-access-tprwn\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-credential-socket\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-token\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-socket\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-data\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-podinfo\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-envoy\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.214980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9309af67-bb9e-45aa-9e69-9f3e45a26008-istiod-ca-cert\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215312 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.215216    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-certs\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.215464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-socket\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.215564    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-credential-socket\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.215705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-data\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.215779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.215724    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9309af67-bb9e-45aa-9e69-9f3e45a26008-istiod-ca-cert\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.217379 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.217357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-envoy\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.217585 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.217565    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-podinfo\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.224382 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.224351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-token\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.224909 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.224889    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tprwn\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-kube-api-access-tprwn\") pod \"e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") " pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.307073 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.306992    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:27.595039 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.595012    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"]
Sep 06 12:33:27.597306 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:33:27.597274    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9309af67_bb9e_45aa_9e69_9f3e45a26008.slice/crio-f19450c3d514e78f06cb26e6641a62a55482d96303d7c420eff08260ccdf2e3c WatchSource:0}: Error finding container f19450c3d514e78f06cb26e6641a62a55482d96303d7c420eff08260ccdf2e3c: Status 404 returned error can't find the container with id f19450c3d514e78f06cb26e6641a62a55482d96303d7c420eff08260ccdf2e3c
Sep 06 12:33:27.599757 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.599722    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:33:27.599856 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.599802    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:33:27.599856 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.599848    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:33:27.987189 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.987131    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" event={"ID":"9309af67-bb9e-45aa-9e69-9f3e45a26008","Type":"ContainerStarted","Data":"1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"}
Sep 06 12:33:27.987355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:27.987212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" event={"ID":"9309af67-bb9e-45aa-9e69-9f3e45a26008","Type":"ContainerStarted","Data":"f19450c3d514e78f06cb26e6641a62a55482d96303d7c420eff08260ccdf2e3c"}
Sep 06 12:33:28.010130 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:28.010080    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podStartSLOduration=2.010065093 podStartE2EDuration="2.010065093s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:33:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:33:28.008696258 +0000 UTC m=+949.822120337" watchObservedRunningTime="2026-09-06 12:33:28.010065093 +0000 UTC m=+949.823489221"
Sep 06 12:33:28.308242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:28.308141    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:28.313178 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:28.313125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:28.993168 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:28.993120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:28.994040 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:28.994015    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:31.556286 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.556221    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:33:31.657458 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-envoy\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657636 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657492    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-socket\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657636 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657539    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df78032c-0fae-4784-bd4f-eb91dca88173-istiod-ca-cert\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657636 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657628    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q94jw\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-kube-api-access-q94jw\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657671    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-credential-socket\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-istio-token\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df78032c-0fae-4784-bd4f-eb91dca88173-istio-podinfo\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-certs\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.657812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.657809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-data\") pod \"df78032c-0fae-4784-bd4f-eb91dca88173\" (UID: \"df78032c-0fae-4784-bd4f-eb91dca88173\") "
Sep 06 12:33:31.658486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.658316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df78032c-0fae-4784-bd4f-eb91dca88173-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:33:31.659117 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.658418    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-data" (OuterVolumeSpecName: "istio-data") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:31.659117 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.658474    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:31.659117 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.658641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:31.659117 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.659049    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:31.660327 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.660176    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:31.662965 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.662882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-istio-token" (OuterVolumeSpecName: "istio-token") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:33:31.663071 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.662964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-kube-api-access-q94jw" (OuterVolumeSpecName: "kube-api-access-q94jw") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "kube-api-access-q94jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:33:31.663071 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.663027    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/df78032c-0fae-4784-bd4f-eb91dca88173-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "df78032c-0fae-4784-bd4f-eb91dca88173" (UID: "df78032c-0fae-4784-bd4f-eb91dca88173"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:33:31.758906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758877    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.758906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758902    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.758906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758911    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/df78032c-0fae-4784-bd4f-eb91dca88173-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.759119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758919    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.759119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758927    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.759119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758935    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.759119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758943    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/df78032c-0fae-4784-bd4f-eb91dca88173-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.759119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758951    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/df78032c-0fae-4784-bd4f-eb91dca88173-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:31.759119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:31.758990    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q94jw\" (UniqueName: \"kubernetes.io/projected/df78032c-0fae-4784-bd4f-eb91dca88173-kube-api-access-q94jw\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:32.013516 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.013472    2578 generic.go:356] "Generic (PLEG): container finished" podID="df78032c-0fae-4784-bd4f-eb91dca88173" containerID="54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4" exitCode=0
Sep 06 12:33:32.013690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.013545    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"
Sep 06 12:33:32.013690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.013543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" event={"ID":"df78032c-0fae-4784-bd4f-eb91dca88173","Type":"ContainerDied","Data":"54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4"}
Sep 06 12:33:32.013690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.013637    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn" event={"ID":"df78032c-0fae-4784-bd4f-eb91dca88173","Type":"ContainerDied","Data":"40cda3bd07956f88aab2a64593d2acb230e56f9f4d53dbdddd9a67239753e514"}
Sep 06 12:33:32.013690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.013668    2578 scope.go:117] "RemoveContainer" containerID="54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4"
Sep 06 12:33:32.025612 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.025594    2578 scope.go:117] "RemoveContainer" containerID="f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"
Sep 06 12:33:32.034647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.034631    2578 scope.go:117] "RemoveContainer" containerID="54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4"
Sep 06 12:33:32.034936 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:33:32.034912    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4\": container with ID starting with 54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4 not found: ID does not exist" containerID="54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4"
Sep 06 12:33:32.035063 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.034948    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4"} err="failed to get container status \"54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4\": rpc error: code = NotFound desc = could not find container \"54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4\": container with ID starting with 54fa275669ab70cefa6e88583ecfc27219da9fb47cdb877434e3f49a433369c4 not found: ID does not exist"
Sep 06 12:33:32.035063 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.034971    2578 scope.go:117] "RemoveContainer" containerID="f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"
Sep 06 12:33:32.035356 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:33:32.035335    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e\": container with ID starting with f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e not found: ID does not exist" containerID="f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"
Sep 06 12:33:32.035449 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.035362    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e"} err="failed to get container status \"f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e\": rpc error: code = NotFound desc = could not find container \"f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e\": container with ID starting with f33770b43640aa8bd6cddd95ab1648e81d5a5e0f0fae3b7ca5f97ab6bed45a7e not found: ID does not exist"
Sep 06 12:33:32.047183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.039680    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"]
Sep 06 12:33:32.062745 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.062716    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-autores-0e6ab1-openshift-default-7c9c78f8d-gbmnn"]
Sep 06 12:33:32.669166 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:32.669119    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" path="/var/lib/kubelet/pods/df78032c-0fae-4784-bd4f-eb91dca88173/volumes"
Sep 06 12:33:37.914297 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:37.914239    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6" podUID="0dbf8e15-4898-42f3-aec1-4e2906fab5ac" containerName="main" containerID="cri-o://92f97becd8e995398f2ff8ad030ed72cf5b6f6823e53874f9093e13f5c8d1464" gracePeriod=45
Sep 06 12:33:38.084087 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.083844    2578 generic.go:356] "Generic (PLEG): container finished" podID="0dbf8e15-4898-42f3-aec1-4e2906fab5ac" containerID="92f97becd8e995398f2ff8ad030ed72cf5b6f6823e53874f9093e13f5c8d1464" exitCode=0
Sep 06 12:33:38.084087 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.084032    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6" event={"ID":"0dbf8e15-4898-42f3-aec1-4e2906fab5ac","Type":"ContainerDied","Data":"92f97becd8e995398f2ff8ad030ed72cf5b6f6823e53874f9093e13f5c8d1464"}
Sep 06 12:33:38.216023 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.215994    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:33:38.318219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318188    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pt9ns\" (UniqueName: \"kubernetes.io/projected/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-kube-api-access-pt9ns\") pod \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") "
Sep 06 12:33:38.318413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318264    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-dshm\") pod \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") "
Sep 06 12:33:38.318413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-model-cache\") pod \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") "
Sep 06 12:33:38.318413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318333    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-home\") pod \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") "
Sep 06 12:33:38.318413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tmp-dir\") pod \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") "
Sep 06 12:33:38.318646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tls-certs\") pod \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\" (UID: \"0dbf8e15-4898-42f3-aec1-4e2906fab5ac\") "
Sep 06 12:33:38.318646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318555    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-home" (OuterVolumeSpecName: "home") pod "0dbf8e15-4898-42f3-aec1-4e2906fab5ac" (UID: "0dbf8e15-4898-42f3-aec1-4e2906fab5ac"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:38.318646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-model-cache" (OuterVolumeSpecName: "model-cache") pod "0dbf8e15-4898-42f3-aec1-4e2906fab5ac" (UID: "0dbf8e15-4898-42f3-aec1-4e2906fab5ac"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:38.318762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "0dbf8e15-4898-42f3-aec1-4e2906fab5ac" (UID: "0dbf8e15-4898-42f3-aec1-4e2906fab5ac"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:38.318762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318741    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-model-cache\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:38.318762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.318756    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-home\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:38.320576 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.320548    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "0dbf8e15-4898-42f3-aec1-4e2906fab5ac" (UID: "0dbf8e15-4898-42f3-aec1-4e2906fab5ac"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:33:38.320576 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.320571    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-dshm" (OuterVolumeSpecName: "dshm") pod "0dbf8e15-4898-42f3-aec1-4e2906fab5ac" (UID: "0dbf8e15-4898-42f3-aec1-4e2906fab5ac"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:33:38.320763 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.320586    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-kube-api-access-pt9ns" (OuterVolumeSpecName: "kube-api-access-pt9ns") pod "0dbf8e15-4898-42f3-aec1-4e2906fab5ac" (UID: "0dbf8e15-4898-42f3-aec1-4e2906fab5ac"). InnerVolumeSpecName "kube-api-access-pt9ns". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:33:38.420112 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.420074    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tmp-dir\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:38.420112 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.420115    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-tls-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:38.420314 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.420129    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pt9ns\" (UniqueName: \"kubernetes.io/projected/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-kube-api-access-pt9ns\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:38.420314 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:38.420141    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0dbf8e15-4898-42f3-aec1-4e2906fab5ac-dshm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:33:39.090562 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:39.090530    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"
Sep 06 12:33:39.091111 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:39.090570    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6" event={"ID":"0dbf8e15-4898-42f3-aec1-4e2906fab5ac","Type":"ContainerDied","Data":"a3dc89520bcef268a56be92fce163afdf6d306d1287447b8cef780dd871d03f3"}
Sep 06 12:33:39.091111 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:39.090632    2578 scope.go:117] "RemoveContainer" containerID="92f97becd8e995398f2ff8ad030ed72cf5b6f6823e53874f9093e13f5c8d1464"
Sep 06 12:33:39.106927 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:39.106907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"]
Sep 06 12:33:39.109116 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:39.109098    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-conflict-a-cf61fce7-kserve-7967cfc5fb-hbwr6"]
Sep 06 12:33:40.673037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:40.673001    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0dbf8e15-4898-42f3-aec1-4e2906fab5ac" path="/var/lib/kubelet/pods/0dbf8e15-4898-42f3-aec1-4e2906fab5ac/volumes"
Sep 06 12:33:44.602843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:44.602796    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:33:45.034337 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:45.034295    2578 patch_prober.go:28] interesting pod/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:33:45.034520 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:45.034385    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:33:46.139036 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:46.138959    2578 generic.go:356] "Generic (PLEG): container finished" podID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerID="1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4" exitCode=0
Sep 06 12:33:46.139036 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:46.139003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" event={"ID":"9309af67-bb9e-45aa-9e69-9f3e45a26008","Type":"ContainerDied","Data":"1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"}
Sep 06 12:33:46.139478 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:46.139383    2578 scope.go:117] "RemoveContainer" containerID="1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"
Sep 06 12:33:46.140651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:46.140624    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:33:46.140723 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:46.140692    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:33:46.140769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:46.140721    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:33:47.147038 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:47.147002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" event={"ID":"9309af67-bb9e-45aa-9e69-9f3e45a26008","Type":"ContainerStarted","Data":"38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1"}
Sep 06 12:33:47.307573 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:47.307534    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:47.307769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:47.307751    2578 patch_prober.go:28] interesting pod/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 06 12:33:47.307815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:47.307793    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 06 12:33:48.307718 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:48.307680    2578 patch_prober.go:28] interesting pod/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 06 12:33:48.308129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:48.307738    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 06 12:33:49.308173 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:49.308106    2578 patch_prober.go:28] interesting pod/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 06 12:33:49.308662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:49.308198    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 06 12:33:50.308161 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:50.308121    2578 patch_prober.go:28] interesting pod/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 06 12:33:50.308351 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:50.308210    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 06 12:33:51.308053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:51.307999    2578 patch_prober.go:28] interesting pod/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body=
Sep 06 12:33:51.308270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:51.308073    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused"
Sep 06 12:33:52.315371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:52.315338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:52.315837 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:52.315742    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:33:52.316400 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:33:52.316379    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:34:01.605268 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:01.605186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:34:06.094640 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.094597    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"]
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.094973    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy"
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.094984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy"
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095003    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0dbf8e15-4898-42f3-aec1-4e2906fab5ac" containerName="main"
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095008    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0dbf8e15-4898-42f3-aec1-4e2906fab5ac" containerName="main"
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095022    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy"
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095027    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e39890b-8560-4e9c-acf0-9d110778d6d8" containerName="istio-proxy"
Sep 06 12:34:06.095091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095090    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy"
Sep 06 12:34:06.095437 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095098    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0dbf8e15-4898-42f3-aec1-4e2906fab5ac" containerName="main"
Sep 06 12:34:06.095437 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.095105    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy"
Sep 06 12:34:06.099049 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.099015    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.103649 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.103625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-1655f5\"/\"default-dockercfg-wm8gp\""
Sep 06 12:34:06.104835 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.104784    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-1655f5\"/\"kube-root-ca.crt\""
Sep 06 12:34:06.105100 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.105079    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-explicit-1655f5\"/\"openshift-service-ca.crt\""
Sep 06 12:34:06.105319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.105210    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-explicit-1655f5\"/\"explicit-model-1655f5-kserve-self-signed-certs\""
Sep 06 12:34:06.108819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.108794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"]
Sep 06 12:34:06.200091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.200062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-model-cache\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.200227 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.200108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-home\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.200227 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.200131    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-dshm\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.200306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.200234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfdnk\" (UniqueName: \"kubernetes.io/projected/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-kube-api-access-tfdnk\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.200306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.200287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tls-certs\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.200376 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.200344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tmp-dir\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301042 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301008    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfdnk\" (UniqueName: \"kubernetes.io/projected/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-kube-api-access-tfdnk\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tls-certs\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301090    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tmp-dir\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-model-cache\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-home\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301238 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-dshm\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301597 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301483    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tmp-dir\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301597 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301546    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-model-cache\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.301597 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.301557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-home\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.303477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.303456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-dshm\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.303669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.303649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tls-certs\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.309038 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.309015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfdnk\" (UniqueName: \"kubernetes.io/projected/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-kube-api-access-tfdnk\") pod \"explicit-model-1655f5-kserve-59fd7d885-vc2n7\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") " pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.414995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.414939    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:06.687753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:06.687729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"]
Sep 06 12:34:06.689076 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:34:06.689049    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22a3d364_8aa2_4155_bb52_4a88f45ffa0c.slice/crio-d2a710be64b680234aed9c65d64e2eeaed529a811989ace07b41958571bff9ac WatchSource:0}: Error finding container d2a710be64b680234aed9c65d64e2eeaed529a811989ace07b41958571bff9ac: Status 404 returned error can't find the container with id d2a710be64b680234aed9c65d64e2eeaed529a811989ace07b41958571bff9ac
Sep 06 12:34:07.283983 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:07.283943    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7" event={"ID":"22a3d364-8aa2-4155-bb52-4a88f45ffa0c","Type":"ContainerStarted","Data":"d0ce4320893ad933ce25dcde8ccc93dd2dee682c23f684527e6d091f6da557ee"}
Sep 06 12:34:07.284427 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:07.283992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7" event={"ID":"22a3d364-8aa2-4155-bb52-4a88f45ffa0c","Type":"ContainerStarted","Data":"d2a710be64b680234aed9c65d64e2eeaed529a811989ace07b41958571bff9ac"}
Sep 06 12:34:07.301370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:07.301325    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7" podStartSLOduration=1.3013096499999999 podStartE2EDuration="1.30130965s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:07.299575261 +0000 UTC m=+989.112999341" watchObservedRunningTime="2026-09-06 12:34:07.30130965 +0000 UTC m=+989.114733728"
Sep 06 12:34:16.415857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:16.415820    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:16.416382 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:16.415869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:16.428276 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:16.428252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:17.365259 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:17.365226    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:18.238501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.238463    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"]
Sep 06 12:34:18.239222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.239198    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy"
Sep 06 12:34:18.239222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.239221    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df78032c-0fae-4784-bd4f-eb91dca88173" containerName="istio-proxy"
Sep 06 12:34:18.242658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.242639    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.245538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.245521    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-b57cd363-openshift-default-dockercfg-b4pv8\""
Sep 06 12:34:18.255675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.255653    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"]
Sep 06 12:34:18.403772 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-token\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.403910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-data\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.403910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-credential-socket\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.403910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-kube-api-access-6fdtn\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.403910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403853    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-podinfo\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.403910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-socket\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.403910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.403891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca65a36-0f56-498d-9494-1fbbd84400f4-istiod-ca-cert\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.404228 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.404004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-certs\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.404228 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.404081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-envoy\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-token\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-data\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-credential-socket\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-kube-api-access-6fdtn\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-podinfo\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505643    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-socket\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca65a36-0f56-498d-9494-1fbbd84400f4-istiod-ca-cert\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-certs\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.505918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505739    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-envoy\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.506197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.505970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-data\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.506197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.506014    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-credential-socket\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.506197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.506175    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-certs\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.506339 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.506244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-socket\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.506419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.506401    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca65a36-0f56-498d-9494-1fbbd84400f4-istiod-ca-cert\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.507896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.507876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-envoy\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.508240 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.508219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-podinfo\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.513357 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.513330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-token\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.513685 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.513665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-kube-api-access-6fdtn\") pod \"e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") " pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.555554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.555535    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:18.836127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.836095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"]
Sep 06 12:34:18.837309 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:34:18.837281    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeca65a36_0f56_498d_9494_1fbbd84400f4.slice/crio-6e30199bc118f88059b7ce14ae7ecaff454f95e98de51b3b81a02a95d33fd691 WatchSource:0}: Error finding container 6e30199bc118f88059b7ce14ae7ecaff454f95e98de51b3b81a02a95d33fd691: Status 404 returned error can't find the container with id 6e30199bc118f88059b7ce14ae7ecaff454f95e98de51b3b81a02a95d33fd691
Sep 06 12:34:18.839683 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.839642    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:18.839760 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.839728    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:18.839802 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:18.839772    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:19.363527 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:19.363489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" event={"ID":"eca65a36-0f56-498d-9494-1fbbd84400f4","Type":"ContainerStarted","Data":"b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"}
Sep 06 12:34:19.364001 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:19.363553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" event={"ID":"eca65a36-0f56-498d-9494-1fbbd84400f4","Type":"ContainerStarted","Data":"6e30199bc118f88059b7ce14ae7ecaff454f95e98de51b3b81a02a95d33fd691"}
Sep 06 12:34:19.386904 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:19.386861    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podStartSLOduration=1.386847711 podStartE2EDuration="1.386847711s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:19.384833893 +0000 UTC m=+1001.198257971" watchObservedRunningTime="2026-09-06 12:34:19.386847711 +0000 UTC m=+1001.200271790"
Sep 06 12:34:19.556814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:19.556777    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:19.562529 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:19.562503    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:20.369690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:20.369666    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:20.370671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:20.370651    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:21.184681 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.184646    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"]
Sep 06 12:34:21.306134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.306104    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"]
Sep 06 12:34:21.309703 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.309686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:21.312232 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.312197    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:34:21.312232 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.312197    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:34:21.322368 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.322343    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"]
Sep 06 12:34:21.434164 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.434108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4\" (UID: \"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:21.535407 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.535373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4\" (UID: \"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:21.536049 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.536025    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4\" (UID: \"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:21.620728 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.620701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:21.893753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.893729    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"]
Sep 06 12:34:21.895377 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:34:21.895339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9b44ea_20d8_4175_83e7_4364c0b2c7b8.slice/crio-4f47c6b606e21284d6a886a9ab979eecfb1455bf0a99a12be9fcf717ab73f5a3 WatchSource:0}: Error finding container 4f47c6b606e21284d6a886a9ab979eecfb1455bf0a99a12be9fcf717ab73f5a3: Status 404 returned error can't find the container with id 4f47c6b606e21284d6a886a9ab979eecfb1455bf0a99a12be9fcf717ab73f5a3
Sep 06 12:34:21.914251 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:21.914226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:34:22.385647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.385191    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4" event={"ID":"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8","Type":"ContainerStarted","Data":"00b2d72455dbd2ab2341cdec7f298969c433a8b063c6a1c1a4999b738273da36"}
Sep 06 12:34:22.385647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.385261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4" event={"ID":"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8","Type":"ContainerStarted","Data":"4f47c6b606e21284d6a886a9ab979eecfb1455bf0a99a12be9fcf717ab73f5a3"}
Sep 06 12:34:22.388072 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.388046    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"]
Sep 06 12:34:22.392214 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.392196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.394624 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.394596    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-b57cd363-serving-cert\""
Sep 06 12:34:22.394778 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.394759    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 12:34:22.394904 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.394883    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w24cl\""
Sep 06 12:34:22.394967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.394918    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 12:34:22.403995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.403976    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"]
Sep 06 12:34:22.406463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.406424    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4" podStartSLOduration=1.406412242 podStartE2EDuration="1.406412242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:22.403031392 +0000 UTC m=+1004.216455472" watchObservedRunningTime="2026-09-06 12:34:22.406412242 +0000 UTC m=+1004.219836321"
Sep 06 12:34:22.542440 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.542411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed161ae6-a903-4481-a938-5bb5a3ee2963-openshift-service-ca\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.542797 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.542452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-metrics-certs\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.542797 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.542539    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcsnn\" (UniqueName: \"kubernetes.io/projected/ed161ae6-a903-4481-a938-5bb5a3ee2963-kube-api-access-rcsnn\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.542797 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.542760    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-maas-api-tls\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.643772 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.643734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-maas-api-tls\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.643772 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.643776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed161ae6-a903-4481-a938-5bb5a3ee2963-openshift-service-ca\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.643967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.643807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-metrics-certs\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.643967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.643848    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcsnn\" (UniqueName: \"kubernetes.io/projected/ed161ae6-a903-4481-a938-5bb5a3ee2963-kube-api-access-rcsnn\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.644561 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.644528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed161ae6-a903-4481-a938-5bb5a3ee2963-openshift-service-ca\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.646375 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.646352    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-metrics-certs\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.646511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.646489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-maas-api-tls\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.652847 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.652823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcsnn\" (UniqueName: \"kubernetes.io/projected/ed161ae6-a903-4481-a938-5bb5a3ee2963-kube-api-access-rcsnn\") pod \"maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.704838 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.704811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:22.982745 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.982714    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"]
Sep 06 12:34:22.983777 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:34:22.983749    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded161ae6_a903_4481_a938_5bb5a3ee2963.slice/crio-f71f2a6e9852386e7cc71c788f830697bceda1cfd920159990c7e858eaa19af1 WatchSource:0}: Error finding container f71f2a6e9852386e7cc71c788f830697bceda1cfd920159990c7e858eaa19af1: Status 404 returned error can't find the container with id f71f2a6e9852386e7cc71c788f830697bceda1cfd920159990c7e858eaa19af1
Sep 06 12:34:22.985365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:22.985344    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:34:23.393660 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:23.393573    2578 generic.go:356] "Generic (PLEG): container finished" podID="bf9b44ea-20d8-4175-83e7-4364c0b2c7b8" containerID="00b2d72455dbd2ab2341cdec7f298969c433a8b063c6a1c1a4999b738273da36" exitCode=0
Sep 06 12:34:23.393660 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:23.393630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4" event={"ID":"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8","Type":"ContainerDied","Data":"00b2d72455dbd2ab2341cdec7f298969c433a8b063c6a1c1a4999b738273da36"}
Sep 06 12:34:23.395031 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:23.395009    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz" event={"ID":"ed161ae6-a903-4481-a938-5bb5a3ee2963","Type":"ContainerStarted","Data":"f71f2a6e9852386e7cc71c788f830697bceda1cfd920159990c7e858eaa19af1"}
Sep 06 12:34:24.558439 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:24.558413    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:24.665426 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:24.665349    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8-maas-api-service-ca\") pod \"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8\" (UID: \"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8\") "
Sep 06 12:34:24.665716 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:24.665691    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf9b44ea-20d8-4175-83e7-4364c0b2c7b8" (UID: "bf9b44ea-20d8-4175-83e7-4364c0b2c7b8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:34:24.766220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:24.766182    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:25.411465 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:25.411437    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"
Sep 06 12:34:25.411465 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:25.411450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4" event={"ID":"bf9b44ea-20d8-4175-83e7-4364c0b2c7b8","Type":"ContainerDied","Data":"4f47c6b606e21284d6a886a9ab979eecfb1455bf0a99a12be9fcf717ab73f5a3"}
Sep 06 12:34:25.411672 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:25.411492    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f47c6b606e21284d6a886a9ab979eecfb1455bf0a99a12be9fcf717ab73f5a3"
Sep 06 12:34:25.413079 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:25.413052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz" event={"ID":"ed161ae6-a903-4481-a938-5bb5a3ee2963","Type":"ContainerStarted","Data":"961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168"}
Sep 06 12:34:25.413227 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:25.413182    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:25.431885 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:25.431841    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz" podStartSLOduration=1.947000456 podStartE2EDuration="3.431827593s" totalImagesPullingTime="1.484827137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:25.428879397 +0000 UTC m=+1007.242303477" watchObservedRunningTime="2026-09-06 12:34:25.431827593 +0000 UTC m=+1007.245251672"
Sep 06 12:34:31.424060 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:31.424033    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:34:32.422872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:32.422838    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"]
Sep 06 12:34:32.426353 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:32.426318    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-1655f5-m4lc4"]
Sep 06 12:34:32.669242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:32.669135    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf9b44ea-20d8-4175-83e7-4364c0b2c7b8" path="/var/lib/kubelet/pods/bf9b44ea-20d8-4175-83e7-4364c0b2c7b8/volumes"
Sep 06 12:34:36.204196 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.204161    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7" podUID="22a3d364-8aa2-4155-bb52-4a88f45ffa0c" containerName="main" containerID="cri-o://d0ce4320893ad933ce25dcde8ccc93dd2dee682c23f684527e6d091f6da557ee" gracePeriod=45
Sep 06 12:34:36.496557 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.496530    2578 generic.go:356] "Generic (PLEG): container finished" podID="22a3d364-8aa2-4155-bb52-4a88f45ffa0c" containerID="d0ce4320893ad933ce25dcde8ccc93dd2dee682c23f684527e6d091f6da557ee" exitCode=0
Sep 06 12:34:36.496691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.496610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7" event={"ID":"22a3d364-8aa2-4155-bb52-4a88f45ffa0c","Type":"ContainerDied","Data":"d0ce4320893ad933ce25dcde8ccc93dd2dee682c23f684527e6d091f6da557ee"}
Sep 06 12:34:36.496691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.496664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7" event={"ID":"22a3d364-8aa2-4155-bb52-4a88f45ffa0c","Type":"ContainerDied","Data":"d2a710be64b680234aed9c65d64e2eeaed529a811989ace07b41958571bff9ac"}
Sep 06 12:34:36.496691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.496682    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d2a710be64b680234aed9c65d64e2eeaed529a811989ace07b41958571bff9ac"
Sep 06 12:34:36.501682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.501666    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:36.592574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592536    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-model-cache\") pod \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") "
Sep 06 12:34:36.592776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-dshm\") pod \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") "
Sep 06 12:34:36.592776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592677    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tmp-dir\") pod \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") "
Sep 06 12:34:36.592776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592707    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tfdnk\" (UniqueName: \"kubernetes.io/projected/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-kube-api-access-tfdnk\") pod \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") "
Sep 06 12:34:36.592776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592760    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tls-certs\") pod \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") "
Sep 06 12:34:36.592986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-home\") pod \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\" (UID: \"22a3d364-8aa2-4155-bb52-4a88f45ffa0c\") "
Sep 06 12:34:36.592986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592838    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "22a3d364-8aa2-4155-bb52-4a88f45ffa0c" (UID: "22a3d364-8aa2-4155-bb52-4a88f45ffa0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:36.592986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.592899    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "22a3d364-8aa2-4155-bb52-4a88f45ffa0c" (UID: "22a3d364-8aa2-4155-bb52-4a88f45ffa0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:36.593182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.593122    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-model-cache\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:36.593182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.593138    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-home" (OuterVolumeSpecName: "home") pod "22a3d364-8aa2-4155-bb52-4a88f45ffa0c" (UID: "22a3d364-8aa2-4155-bb52-4a88f45ffa0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:36.593284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.593172    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tmp-dir\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:36.594931 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.594902    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-dshm" (OuterVolumeSpecName: "dshm") pod "22a3d364-8aa2-4155-bb52-4a88f45ffa0c" (UID: "22a3d364-8aa2-4155-bb52-4a88f45ffa0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:36.594931 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.594913    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-kube-api-access-tfdnk" (OuterVolumeSpecName: "kube-api-access-tfdnk") pod "22a3d364-8aa2-4155-bb52-4a88f45ffa0c" (UID: "22a3d364-8aa2-4155-bb52-4a88f45ffa0c"). InnerVolumeSpecName "kube-api-access-tfdnk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:34:36.595075 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.594954    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "22a3d364-8aa2-4155-bb52-4a88f45ffa0c" (UID: "22a3d364-8aa2-4155-bb52-4a88f45ffa0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:34:36.694762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.694733    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-tls-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:36.694762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.694759    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-home\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:36.694762 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.694767    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-dshm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:36.694958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:36.694776    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tfdnk\" (UniqueName: \"kubernetes.io/projected/22a3d364-8aa2-4155-bb52-4a88f45ffa0c-kube-api-access-tfdnk\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:37.503105 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:37.503072    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"
Sep 06 12:34:37.519320 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:37.519288    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"]
Sep 06 12:34:37.522446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:37.522420    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-explicit-1655f5/explicit-model-1655f5-kserve-59fd7d885-vc2n7"]
Sep 06 12:34:38.613222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:38.613185    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"]
Sep 06 12:34:38.613659 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:38.613415    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy" containerID="cri-o://38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1" gracePeriod=30
Sep 06 12:34:38.673311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:38.673280    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22a3d364-8aa2-4155-bb52-4a88f45ffa0c" path="/var/lib/kubelet/pods/22a3d364-8aa2-4155-bb52-4a88f45ffa0c/volumes"
Sep 06 12:34:39.310493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.310459    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"]
Sep 06 12:34:39.310957 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.310938    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22a3d364-8aa2-4155-bb52-4a88f45ffa0c" containerName="main"
Sep 06 12:34:39.311043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.310960    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="22a3d364-8aa2-4155-bb52-4a88f45ffa0c" containerName="main"
Sep 06 12:34:39.311043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.310977    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf9b44ea-20d8-4175-83e7-4364c0b2c7b8" containerName="revoke-keys"
Sep 06 12:34:39.311043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.310985    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf9b44ea-20d8-4175-83e7-4364c0b2c7b8" containerName="revoke-keys"
Sep 06 12:34:39.311224 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.311077    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="22a3d364-8aa2-4155-bb52-4a88f45ffa0c" containerName="main"
Sep 06 12:34:39.311224 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.311091    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf9b44ea-20d8-4175-83e7-4364c0b2c7b8" containerName="revoke-keys"
Sep 06 12:34:39.315476 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.315450    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.318021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.317997    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-363819-openshift-default-dockercfg-6p27p\""
Sep 06 12:34:39.325067 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.325043    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"]
Sep 06 12:34:39.427063 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.426978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-socket\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.427063 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.427035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-data\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.428974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.427778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-envoy\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.428974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.427876    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4z9z4\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-kube-api-access-4z9z4\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.428974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.427956    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-token\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.428974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.427986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-podinfo\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.428974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.428053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-credential-socket\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.429603 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.428135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-certs\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.429713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.429678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istiod-ca-cert\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530499 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4z9z4\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-kube-api-access-4z9z4\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-token\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-podinfo\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-credential-socket\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530617    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-certs\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530699 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530650    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istiod-ca-cert\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-socket\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530764    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-data\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.530964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.530843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-envoy\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.531131 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.531041    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-credential-socket\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.531131 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.531069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-certs\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.531259 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.531204    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-socket\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.531367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.531341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-data\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.531510 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.531442    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istiod-ca-cert\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.533119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.533097    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-envoy\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.533337 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.533319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-podinfo\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.538219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.538191    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4z9z4\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-kube-api-access-4z9z4\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.538302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.538227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-token\") pod \"e2e-noten-363819-openshift-default-7779985c48-2vnlt\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") " pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.630655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.630563    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:39.915048 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.915015    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"]
Sep 06 12:34:39.915188 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:34:39.915014    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod089836b5_84f8_4fa7_bc64_78fad7a0d33d.slice/crio-b4c28a4cf93bfae7f4dc5e2359f457032cb4336ab4469c103ee431511124668d WatchSource:0}: Error finding container b4c28a4cf93bfae7f4dc5e2359f457032cb4336ab4469c103ee431511124668d: Status 404 returned error can't find the container with id b4c28a4cf93bfae7f4dc5e2359f457032cb4336ab4469c103ee431511124668d
Sep 06 12:34:39.917848 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.917811    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:39.917937 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.917891    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:39.917994 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:39.917932    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:40.524333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:40.524292    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" event={"ID":"089836b5-84f8-4fa7-bc64-78fad7a0d33d","Type":"ContainerStarted","Data":"52926c534e60b7d57f4be722e92f7073e989d89dc1f5f89e7bdd4af850c50638"}
Sep 06 12:34:40.524511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:40.524360    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" event={"ID":"089836b5-84f8-4fa7-bc64-78fad7a0d33d","Type":"ContainerStarted","Data":"b4c28a4cf93bfae7f4dc5e2359f457032cb4336ab4469c103ee431511124668d"}
Sep 06 12:34:40.545900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:40.545854    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" podStartSLOduration=1.545838034 podStartE2EDuration="1.545838034s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:34:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:34:40.543417313 +0000 UTC m=+1022.356841417" watchObservedRunningTime="2026-09-06 12:34:40.545838034 +0000 UTC m=+1022.359262112"
Sep 06 12:34:40.631478 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:40.631447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:40.636611 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:40.636588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:41.532453 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:41.532428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:41.533493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:41.533476    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:34:42.202530 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.202462    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:34:42.539380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.539296    2578 generic.go:356] "Generic (PLEG): container finished" podID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerID="b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201" exitCode=0
Sep 06 12:34:42.539537 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.539373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" event={"ID":"eca65a36-0f56-498d-9494-1fbbd84400f4","Type":"ContainerDied","Data":"b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"}
Sep 06 12:34:42.539891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.539873    2578 scope.go:117] "RemoveContainer" containerID="b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"
Sep 06 12:34:42.540900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.540875    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:42.540961 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.540941    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:42.540998 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:42.540973    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:34:43.547162 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.547126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" event={"ID":"eca65a36-0f56-498d-9494-1fbbd84400f4","Type":"ContainerStarted","Data":"272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e"}
Sep 06 12:34:43.556694 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.556659    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:43.556694 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.556687    2578 patch_prober.go:28] interesting pod/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 06 12:34:43.556915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.556737    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 06 12:34:43.922685 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.922661    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:34:43.988091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988056    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tprwn\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-kube-api-access-tprwn\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-data\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988119    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-envoy\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-socket\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988206    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-certs\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-podinfo\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988351    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-token\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988385    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9309af67-bb9e-45aa-9e69-9f3e45a26008-istiod-ca-cert\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988410    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-credential-socket\") pod \"9309af67-bb9e-45aa-9e69-9f3e45a26008\" (UID: \"9309af67-bb9e-45aa-9e69-9f3e45a26008\") "
Sep 06 12:34:43.988565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988436    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-data" (OuterVolumeSpecName: "istio-data") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:43.988565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988499    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:43.988816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988622    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:43.988816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988674    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:43.988816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988780    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:43.988816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988796    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:43.988816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988811    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:43.989049 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988825    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:43.989049 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.988920    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9309af67-bb9e-45aa-9e69-9f3e45a26008-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:34:43.990766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.990740    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-token" (OuterVolumeSpecName: "istio-token") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:34:43.991186 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.991134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:34:43.991277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.991139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-kube-api-access-tprwn" (OuterVolumeSpecName: "kube-api-access-tprwn") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "kube-api-access-tprwn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:34:43.991371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:43.991356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9309af67-bb9e-45aa-9e69-9f3e45a26008" (UID: "9309af67-bb9e-45aa-9e69-9f3e45a26008"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:34:44.089821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.089742    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tprwn\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-kube-api-access-tprwn\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:44.089821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.089772    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:44.089821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.089781    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:44.089821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.089789    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9309af67-bb9e-45aa-9e69-9f3e45a26008-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:44.089821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.089797    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9309af67-bb9e-45aa-9e69-9f3e45a26008-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:34:44.556483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.556029    2578 patch_prober.go:28] interesting pod/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 06 12:34:44.556483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.556099    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 06 12:34:44.558950 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.558919    2578 generic.go:356] "Generic (PLEG): container finished" podID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerID="38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1" exitCode=0
Sep 06 12:34:44.559732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.559708    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"
Sep 06 12:34:44.570408 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.570382    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" event={"ID":"9309af67-bb9e-45aa-9e69-9f3e45a26008","Type":"ContainerDied","Data":"38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1"}
Sep 06 12:34:44.570596 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.570577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7" event={"ID":"9309af67-bb9e-45aa-9e69-9f3e45a26008","Type":"ContainerDied","Data":"f19450c3d514e78f06cb26e6641a62a55482d96303d7c420eff08260ccdf2e3c"}
Sep 06 12:34:44.570707 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.570669    2578 scope.go:117] "RemoveContainer" containerID="38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1"
Sep 06 12:34:44.591418 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.591385    2578 scope.go:117] "RemoveContainer" containerID="1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"
Sep 06 12:34:44.592482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.592444    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"]
Sep 06 12:34:44.597964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.597945    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-1655f5-openshift-default-75868c9f64-tvrw7"]
Sep 06 12:34:44.600732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.600716    2578 scope.go:117] "RemoveContainer" containerID="38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1"
Sep 06 12:34:44.601010 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:34:44.600991    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1\": container with ID starting with 38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1 not found: ID does not exist" containerID="38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1"
Sep 06 12:34:44.601065 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.601019    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1"} err="failed to get container status \"38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1\": rpc error: code = NotFound desc = could not find container \"38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1\": container with ID starting with 38dfa413620bafa8bbaf9081cdfae68214245ae33a8a8f647507489b85a98bd1 not found: ID does not exist"
Sep 06 12:34:44.601065 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.601037    2578 scope.go:117] "RemoveContainer" containerID="1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"
Sep 06 12:34:44.601315 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:34:44.601295    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4\": container with ID starting with 1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4 not found: ID does not exist" containerID="1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"
Sep 06 12:34:44.601370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.601321    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4"} err="failed to get container status \"1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4\": rpc error: code = NotFound desc = could not find container \"1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4\": container with ID starting with 1e3d12a7458e61794199f27beb90cbf87a7d928e05dee780eb1b2a879aaf13d4 not found: ID does not exist"
Sep 06 12:34:44.678129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:44.678094    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" path="/var/lib/kubelet/pods/9309af67-bb9e-45aa-9e69-9f3e45a26008/volumes"
Sep 06 12:34:45.556344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:45.556297    2578 patch_prober.go:28] interesting pod/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 06 12:34:45.556540 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:45.556367    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 06 12:34:46.557227 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:46.557186    2578 patch_prober.go:28] interesting pod/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 06 12:34:46.557767 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:46.557253    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 06 12:34:47.556043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:47.556001    2578 patch_prober.go:28] interesting pod/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 06 12:34:47.556257 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:47.556073    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 06 12:34:48.556392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:48.556345    2578 patch_prober.go:28] interesting pod/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body=
Sep 06 12:34:48.556881 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:48.556434    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused"
Sep 06 12:34:49.560067 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:49.560036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:49.560501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:49.560456    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:49.561127 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:49.561111    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:34:56.515285 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:56.515249    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"]
Sep 06 12:34:56.515801 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:56.515539    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" podUID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" containerName="istio-proxy" containerID="cri-o://52926c534e60b7d57f4be722e92f7073e989d89dc1f5f89e7bdd4af850c50638" gracePeriod=30
Sep 06 12:34:56.534258 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:56.534226    2578 patch_prober.go:28] interesting pod/e2e-noten-363819-openshift-default-7779985c48-2vnlt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 12:34:56.534384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:34:56.534281    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" podUID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 12:35:01.511299 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.511264    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:35:01.676524 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.676494    2578 generic.go:356] "Generic (PLEG): container finished" podID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" containerID="52926c534e60b7d57f4be722e92f7073e989d89dc1f5f89e7bdd4af850c50638" exitCode=0
Sep 06 12:35:01.676680 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.676568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" event={"ID":"089836b5-84f8-4fa7-bc64-78fad7a0d33d","Type":"ContainerDied","Data":"52926c534e60b7d57f4be722e92f7073e989d89dc1f5f89e7bdd4af850c50638"}
Sep 06 12:35:01.779063 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.779038    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:35:01.947784 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947756    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-certs\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.947969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947793    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-envoy\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.947969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-data\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.947969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947860    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-socket\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.947969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947876    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-podinfo\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.947969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-token\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.947969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947935    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istiod-ca-cert\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.948313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.947975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-credential-socket\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.948313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948006    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4z9z4\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-kube-api-access-4z9z4\") pod \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\" (UID: \"089836b5-84f8-4fa7-bc64-78fad7a0d33d\") "
Sep 06 12:35:01.948313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948068    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:01.948313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948222    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:01.948532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948313    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-data" (OuterVolumeSpecName: "istio-data") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:01.948532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948419    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:01.948532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948439    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:01.948532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948454    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:01.948532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948511    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:01.948784 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.948650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:01.950276 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.950251    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-kube-api-access-4z9z4" (OuterVolumeSpecName: "kube-api-access-4z9z4") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "kube-api-access-4z9z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:01.950513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.950486    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:01.950513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.950500    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-token" (OuterVolumeSpecName: "istio-token") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:01.950643 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:01.950582    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "089836b5-84f8-4fa7-bc64-78fad7a0d33d" (UID: "089836b5-84f8-4fa7-bc64-78fad7a0d33d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:35:02.049463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.049383    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:02.049463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.049411    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:02.049463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.049421    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:02.049463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.049430    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4z9z4\" (UniqueName: \"kubernetes.io/projected/089836b5-84f8-4fa7-bc64-78fad7a0d33d-kube-api-access-4z9z4\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:02.049463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.049440    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:02.049463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.049450    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/089836b5-84f8-4fa7-bc64-78fad7a0d33d-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:02.683696 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.683671    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"
Sep 06 12:35:02.684091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.683783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt" event={"ID":"089836b5-84f8-4fa7-bc64-78fad7a0d33d","Type":"ContainerDied","Data":"b4c28a4cf93bfae7f4dc5e2359f457032cb4336ab4469c103ee431511124668d"}
Sep 06 12:35:02.684091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.683840    2578 scope.go:117] "RemoveContainer" containerID="52926c534e60b7d57f4be722e92f7073e989d89dc1f5f89e7bdd4af850c50638"
Sep 06 12:35:02.705601 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.705568    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"]
Sep 06 12:35:02.709320 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:02.709292    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-363819-openshift-default-7779985c48-2vnlt"]
Sep 06 12:35:03.748983 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:03.748948    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"]
Sep 06 12:35:03.749511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:03.749204    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz" podUID="ed161ae6-a903-4481-a938-5bb5a3ee2963" containerName="maas-api" containerID="cri-o://961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168" gracePeriod=30
Sep 06 12:35:04.014096 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.014035    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:35:04.170515 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.170474    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcsnn\" (UniqueName: \"kubernetes.io/projected/ed161ae6-a903-4481-a938-5bb5a3ee2963-kube-api-access-rcsnn\") pod \"ed161ae6-a903-4481-a938-5bb5a3ee2963\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") "
Sep 06 12:35:04.170738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.170550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed161ae6-a903-4481-a938-5bb5a3ee2963-openshift-service-ca\") pod \"ed161ae6-a903-4481-a938-5bb5a3ee2963\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") "
Sep 06 12:35:04.170738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.170582    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-metrics-certs\") pod \"ed161ae6-a903-4481-a938-5bb5a3ee2963\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") "
Sep 06 12:35:04.170738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.170691    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-maas-api-tls\") pod \"ed161ae6-a903-4481-a938-5bb5a3ee2963\" (UID: \"ed161ae6-a903-4481-a938-5bb5a3ee2963\") "
Sep 06 12:35:04.171076 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.171019    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ed161ae6-a903-4481-a938-5bb5a3ee2963-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ed161ae6-a903-4481-a938-5bb5a3ee2963" (UID: "ed161ae6-a903-4481-a938-5bb5a3ee2963"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:04.172991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.172966    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed161ae6-a903-4481-a938-5bb5a3ee2963-kube-api-access-rcsnn" (OuterVolumeSpecName: "kube-api-access-rcsnn") pod "ed161ae6-a903-4481-a938-5bb5a3ee2963" (UID: "ed161ae6-a903-4481-a938-5bb5a3ee2963"). InnerVolumeSpecName "kube-api-access-rcsnn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:04.173092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.173045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ed161ae6-a903-4481-a938-5bb5a3ee2963" (UID: "ed161ae6-a903-4481-a938-5bb5a3ee2963"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:35:04.173380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.173353    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ed161ae6-a903-4481-a938-5bb5a3ee2963" (UID: "ed161ae6-a903-4481-a938-5bb5a3ee2963"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:35:04.272204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.272116    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.272204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.272143    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcsnn\" (UniqueName: \"kubernetes.io/projected/ed161ae6-a903-4481-a938-5bb5a3ee2963-kube-api-access-rcsnn\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.272204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.272176    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ed161ae6-a903-4481-a938-5bb5a3ee2963-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.272204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.272185    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ed161ae6-a903-4481-a938-5bb5a3ee2963-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:04.668666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.668590    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" path="/var/lib/kubelet/pods/089836b5-84f8-4fa7-bc64-78fad7a0d33d/volumes"
Sep 06 12:35:04.697748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.697720    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed161ae6-a903-4481-a938-5bb5a3ee2963" containerID="961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168" exitCode=0
Sep 06 12:35:04.697892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.697772    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"
Sep 06 12:35:04.697892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.697809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz" event={"ID":"ed161ae6-a903-4481-a938-5bb5a3ee2963","Type":"ContainerDied","Data":"961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168"}
Sep 06 12:35:04.697892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.697866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz" event={"ID":"ed161ae6-a903-4481-a938-5bb5a3ee2963","Type":"ContainerDied","Data":"f71f2a6e9852386e7cc71c788f830697bceda1cfd920159990c7e858eaa19af1"}
Sep 06 12:35:04.698048 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.697895    2578 scope.go:117] "RemoveContainer" containerID="961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168"
Sep 06 12:35:04.707065 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.707049    2578 scope.go:117] "RemoveContainer" containerID="961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168"
Sep 06 12:35:04.707351 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:04.707334    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168\": container with ID starting with 961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168 not found: ID does not exist" containerID="961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168"
Sep 06 12:35:04.707404 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.707358    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168"} err="failed to get container status \"961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168\": rpc error: code = NotFound desc = could not find container \"961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168\": container with ID starting with 961a7359d9a6a01334ac31e9305fb4b68142f68fc5480a6fb9a85e93b8ff0168 not found: ID does not exist"
Sep 06 12:35:04.715705 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.715683    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"]
Sep 06 12:35:04.718729 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:04.718710    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-b57cd363-7dc47b6d68-dkxxz"]
Sep 06 12:35:06.668613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:06.668579    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ed161ae6-a903-4481-a938-5bb5a3ee2963" path="/var/lib/kubelet/pods/ed161ae6-a903-4481-a938-5bb5a3ee2963/volumes"
Sep 06 12:35:10.206280 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:10.206248    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"]
Sep 06 12:35:10.206693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:10.206495    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy" containerID="cri-o://272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e" gracePeriod=30
Sep 06 12:35:14.151605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.151562    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"]
Sep 06 12:35:14.152176 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152140    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy"
Sep 06 12:35:14.152255 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152179    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy"
Sep 06 12:35:14.152255 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152201    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy"
Sep 06 12:35:14.152255 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152209    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy"
Sep 06 12:35:14.152255 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152233    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed161ae6-a903-4481-a938-5bb5a3ee2963" containerName="maas-api"
Sep 06 12:35:14.152255 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152242    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed161ae6-a903-4481-a938-5bb5a3ee2963" containerName="maas-api"
Sep 06 12:35:14.152500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152263    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" containerName="istio-proxy"
Sep 06 12:35:14.152500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152271    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" containerName="istio-proxy"
Sep 06 12:35:14.152500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152368    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy"
Sep 06 12:35:14.152500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152379    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="089836b5-84f8-4fa7-bc64-78fad7a0d33d" containerName="istio-proxy"
Sep 06 12:35:14.152500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152390    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9309af67-bb9e-45aa-9e69-9f3e45a26008" containerName="istio-proxy"
Sep 06 12:35:14.152500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.152399    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed161ae6-a903-4481-a938-5bb5a3ee2963" containerName="maas-api"
Sep 06 12:35:14.156026 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.156011    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:14.159074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.159052    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:35:14.159265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.159054    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-rhtt2\""
Sep 06 12:35:14.161206 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.161181    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"]
Sep 06 12:35:14.249613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.249585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbef89-07d9-4b49-8088-7bdee6033b1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7\" (UID: \"f4dbef89-07d9-4b49-8088-7bdee6033b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:14.350211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.350174    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbef89-07d9-4b49-8088-7bdee6033b1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7\" (UID: \"f4dbef89-07d9-4b49-8088-7bdee6033b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:14.350824 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.350795    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbef89-07d9-4b49-8088-7bdee6033b1b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7\" (UID: \"f4dbef89-07d9-4b49-8088-7bdee6033b1b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:14.467611 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.467587    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:14.746337 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.746304    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"]
Sep 06 12:35:14.747689 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:35:14.747663    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4dbef89_07d9_4b49_8088_7bdee6033b1b.slice/crio-63f569c42ebf23dd42bcd3ccc4673214b8b12bfa36933fd1369d28d33cc12460 WatchSource:0}: Error finding container 63f569c42ebf23dd42bcd3ccc4673214b8b12bfa36933fd1369d28d33cc12460: Status 404 returned error can't find the container with id 63f569c42ebf23dd42bcd3ccc4673214b8b12bfa36933fd1369d28d33cc12460
Sep 06 12:35:14.767548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:14.767518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7" event={"ID":"f4dbef89-07d9-4b49-8088-7bdee6033b1b","Type":"ContainerStarted","Data":"63f569c42ebf23dd42bcd3ccc4673214b8b12bfa36933fd1369d28d33cc12460"}
Sep 06 12:35:15.548512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.548490    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:35:15.668395 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668365    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-envoy\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668404    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-kube-api-access-6fdtn\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca65a36-0f56-498d-9494-1fbbd84400f4-istiod-ca-cert\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668486    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-socket\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668503    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-credential-socket\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-podinfo\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668574    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-token\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668611    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-data\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668656    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-certs\") pod \"eca65a36-0f56-498d-9494-1fbbd84400f4\" (UID: \"eca65a36-0f56-498d-9494-1fbbd84400f4\") "
Sep 06 12:35:15.668862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:15.668862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668787    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:15.669185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:15.669185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668986    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.669185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.669014    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.669185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.668988    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:15.669185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.669030    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eca65a36-0f56-498d-9494-1fbbd84400f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:15.670690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.670664    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-kube-api-access-6fdtn" (OuterVolumeSpecName: "kube-api-access-6fdtn") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "kube-api-access-6fdtn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:15.670902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.670884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:15.671071 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.671040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:35:15.671352 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.671332    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "eca65a36-0f56-498d-9494-1fbbd84400f4" (UID: "eca65a36-0f56-498d-9494-1fbbd84400f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:15.770380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770349    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.770380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770380    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.770584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770395    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.770584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770408    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.770584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770420    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eca65a36-0f56-498d-9494-1fbbd84400f4-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.770584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770432    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fdtn\" (UniqueName: \"kubernetes.io/projected/eca65a36-0f56-498d-9494-1fbbd84400f4-kube-api-access-6fdtn\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.770584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.770444    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eca65a36-0f56-498d-9494-1fbbd84400f4-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:15.775497 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.775470    2578 generic.go:356] "Generic (PLEG): container finished" podID="f4dbef89-07d9-4b49-8088-7bdee6033b1b" containerID="c97d0d8ab0b57df957ed48537589e2a4b2b6d10bf1cf68cd50fc0237ea1f52e2" exitCode=0
Sep 06 12:35:15.775599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.775548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7" event={"ID":"f4dbef89-07d9-4b49-8088-7bdee6033b1b","Type":"ContainerDied","Data":"c97d0d8ab0b57df957ed48537589e2a4b2b6d10bf1cf68cd50fc0237ea1f52e2"}
Sep 06 12:35:15.777247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.777188    2578 generic.go:356] "Generic (PLEG): container finished" podID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerID="272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e" exitCode=0
Sep 06 12:35:15.777247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.777224    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"
Sep 06 12:35:15.777355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.777225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" event={"ID":"eca65a36-0f56-498d-9494-1fbbd84400f4","Type":"ContainerDied","Data":"272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e"}
Sep 06 12:35:15.777392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.777353    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n" event={"ID":"eca65a36-0f56-498d-9494-1fbbd84400f4","Type":"ContainerDied","Data":"6e30199bc118f88059b7ce14ae7ecaff454f95e98de51b3b81a02a95d33fd691"}
Sep 06 12:35:15.777392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.777389    2578 scope.go:117] "RemoveContainer" containerID="272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e"
Sep 06 12:35:15.787630 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.787615    2578 scope.go:117] "RemoveContainer" containerID="b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"
Sep 06 12:35:15.796125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.796109    2578 scope.go:117] "RemoveContainer" containerID="272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e"
Sep 06 12:35:15.796399 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:15.796381    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e\": container with ID starting with 272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e not found: ID does not exist" containerID="272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e"
Sep 06 12:35:15.796451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.796407    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e"} err="failed to get container status \"272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e\": rpc error: code = NotFound desc = could not find container \"272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e\": container with ID starting with 272ed2064490b8b73b7a2dc77e6bb25254530dfacb70d546667d9b68cbf5b01e not found: ID does not exist"
Sep 06 12:35:15.796451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.796424    2578 scope.go:117] "RemoveContainer" containerID="b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"
Sep 06 12:35:15.796682 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:15.796663    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201\": container with ID starting with b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201 not found: ID does not exist" containerID="b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"
Sep 06 12:35:15.796727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.796687    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201"} err="failed to get container status \"b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201\": rpc error: code = NotFound desc = could not find container \"b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201\": container with ID starting with b298a6b48b3890bb7beaaced0d803d6b858d6db3dbadb0dbe4b9da311b3f3201 not found: ID does not exist"
Sep 06 12:35:15.804503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.804485    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"]
Sep 06 12:35:15.808281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.808258    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-b57cd363-openshift-default-847c7b4d88-pfs4n"]
Sep 06 12:35:15.902860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:15.902828    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:35:16.671176 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:16.671114    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" path="/var/lib/kubelet/pods/eca65a36-0f56-498d-9494-1fbbd84400f4/volumes"
Sep 06 12:35:16.924911 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:16.924889    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:16.980694 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:16.980663    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbef89-07d9-4b49-8088-7bdee6033b1b-maas-api-service-ca\") pod \"f4dbef89-07d9-4b49-8088-7bdee6033b1b\" (UID: \"f4dbef89-07d9-4b49-8088-7bdee6033b1b\") "
Sep 06 12:35:16.981015 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:16.980987    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4dbef89-07d9-4b49-8088-7bdee6033b1b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4dbef89-07d9-4b49-8088-7bdee6033b1b" (UID: "f4dbef89-07d9-4b49-8088-7bdee6033b1b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:17.081318 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:17.081243    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4dbef89-07d9-4b49-8088-7bdee6033b1b-maas-api-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:17.791936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:17.791906    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"
Sep 06 12:35:17.791936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:17.791913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7" event={"ID":"f4dbef89-07d9-4b49-8088-7bdee6033b1b","Type":"ContainerDied","Data":"63f569c42ebf23dd42bcd3ccc4673214b8b12bfa36933fd1369d28d33cc12460"}
Sep 06 12:35:17.792503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:17.791966    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63f569c42ebf23dd42bcd3ccc4673214b8b12bfa36933fd1369d28d33cc12460"
Sep 06 12:35:23.623070 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623032    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"]
Sep 06 12:35:23.623448 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623437    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4dbef89-07d9-4b49-8088-7bdee6033b1b" containerName="revoke-keys"
Sep 06 12:35:23.623489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623449    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4dbef89-07d9-4b49-8088-7bdee6033b1b" containerName="revoke-keys"
Sep 06 12:35:23.623489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623459    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy"
Sep 06 12:35:23.623489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623465    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy"
Sep 06 12:35:23.623609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623532    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4dbef89-07d9-4b49-8088-7bdee6033b1b" containerName="revoke-keys"
Sep 06 12:35:23.623609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623541    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy"
Sep 06 12:35:23.623609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.623547    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy"
Sep 06 12:35:23.626590 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.626572    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.629397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.629375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-d96501-openshift-default-dockercfg-crdv7\""
Sep 06 12:35:23.632961 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.632934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-data\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633067 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.632981    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-credential-socket\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5dcr\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-kube-api-access-j5dcr\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-certs\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75930363-7111-4064-9660-318de2269a0b-istio-podinfo\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633248    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-envoy\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-socket\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633421 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75930363-7111-4064-9660-318de2269a0b-istiod-ca-cert\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.633463 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.633435    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-istio-token\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.637399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.637374    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"]
Sep 06 12:35:23.734303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734262    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-data\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-credential-socket\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j5dcr\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-kube-api-access-j5dcr\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-certs\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734482 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734446    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75930363-7111-4064-9660-318de2269a0b-istio-podinfo\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-envoy\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-socket\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75930363-7111-4064-9660-318de2269a0b-istiod-ca-cert\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-istio-token\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-credential-socket\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.734907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.734689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-data\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.735022 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.735005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-certs\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.735101 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.735054    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-socket\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.735397 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.735375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75930363-7111-4064-9660-318de2269a0b-istiod-ca-cert\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.736708 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.736682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-envoy\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.736920 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.736902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75930363-7111-4064-9660-318de2269a0b-istio-podinfo\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.741806 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.741786    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-istio-token\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.742542 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.742525    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5dcr\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-kube-api-access-j5dcr\") pod \"e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") " pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:23.938370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:23.938344    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:24.217460 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.217429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"]
Sep 06 12:35:24.219202 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:35:24.219174    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75930363_7111_4064_9660_318de2269a0b.slice/crio-1575c26435eea6d27c943b8980c9723500e851d0340e60537e298d96578b0f56 WatchSource:0}: Error finding container 1575c26435eea6d27c943b8980c9723500e851d0340e60537e298d96578b0f56: Status 404 returned error can't find the container with id 1575c26435eea6d27c943b8980c9723500e851d0340e60537e298d96578b0f56
Sep 06 12:35:24.221690 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.221659    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:35:24.221781 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.221728    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:35:24.221781 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.221755    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:35:24.814721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.814688    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"]
Sep 06 12:35:24.817893 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.817870    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-36bcab-p96s7"]
Sep 06 12:35:24.838015 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.837983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" event={"ID":"75930363-7111-4064-9660-318de2269a0b","Type":"ContainerStarted","Data":"55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"}
Sep 06 12:35:24.838135 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.838036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" event={"ID":"75930363-7111-4064-9660-318de2269a0b","Type":"ContainerStarted","Data":"1575c26435eea6d27c943b8980c9723500e851d0340e60537e298d96578b0f56"}
Sep 06 12:35:24.858670 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.858625    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podStartSLOduration=1.858610951 podStartE2EDuration="1.858610951s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:35:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:35:24.856688132 +0000 UTC m=+1066.670112215" watchObservedRunningTime="2026-09-06 12:35:24.858610951 +0000 UTC m=+1066.672035030"
Sep 06 12:35:24.938661 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:24.938639    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:25.943406 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:25.943378    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:26.669698 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:26.669664    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4dbef89-07d9-4b49-8088-7bdee6033b1b" path="/var/lib/kubelet/pods/f4dbef89-07d9-4b49-8088-7bdee6033b1b/volumes"
Sep 06 12:35:26.849754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:26.849723    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:26.850641 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:26.850609    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:27.607157 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.607122    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:35:27.949401 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.949370    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"]
Sep 06 12:35:27.950007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.949984    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy"
Sep 06 12:35:27.950055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.950013    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eca65a36-0f56-498d-9494-1fbbd84400f4" containerName="istio-proxy"
Sep 06 12:35:27.954917 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.954893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:27.958822 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.958798    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-d96501-serving-cert\""
Sep 06 12:35:27.958960 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.958868    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:35:27.959360 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.959332    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 12:35:27.959488 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.959382    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 12:35:27.960586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.959614    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w24cl\""
Sep 06 12:35:27.963020 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.962998    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"]
Sep 06 12:35:27.973521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.973307    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:27.973521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.973407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:27.973521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.973451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mkgc\" (UniqueName: \"kubernetes.io/projected/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-kube-api-access-2mkgc\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:27.973521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:27.973515    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.074554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.074528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.074666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.074575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.074666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.074611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.074666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.074630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mkgc\" (UniqueName: \"kubernetes.io/projected/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-kube-api-access-2mkgc\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.074788 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:28.074734    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-serving-cert: secret "maas-api-e2e-shared-a-w2-d96501-serving-cert" not found
Sep 06 12:35:28.074829 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:28.074792    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls podName:d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2 nodeName:}" failed. No retries permitted until 2026-09-06 12:35:28.574778315 +0000 UTC m=+1070.388202372 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls") pod "maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" (UID: "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2") : secret "maas-api-e2e-shared-a-w2-d96501-serving-cert" not found
Sep 06 12:35:28.075260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.075244    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.076892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.076876    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.085424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.085404    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mkgc\" (UniqueName: \"kubernetes.io/projected/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-kube-api-access-2mkgc\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.578536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.578503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.580868 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.580849    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:28.872435 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:28.872350    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:29.144683 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:29.144654    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"]
Sep 06 12:35:29.145612 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:35:29.145587    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0ee7dcd_c5e6_4137_b1ae_c5773743d2b2.slice/crio-9c27db6452974d0c95d382b717bc5fa56adde71979e357776f7b25cbe06c04d5 WatchSource:0}: Error finding container 9c27db6452974d0c95d382b717bc5fa56adde71979e357776f7b25cbe06c04d5: Status 404 returned error can't find the container with id 9c27db6452974d0c95d382b717bc5fa56adde71979e357776f7b25cbe06c04d5
Sep 06 12:35:29.869887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:29.869854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" event={"ID":"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2","Type":"ContainerStarted","Data":"db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1"}
Sep 06 12:35:29.870043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:29.869905    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" event={"ID":"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2","Type":"ContainerStarted","Data":"9c27db6452974d0c95d382b717bc5fa56adde71979e357776f7b25cbe06c04d5"}
Sep 06 12:35:29.870043 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:29.869964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:29.886483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:29.886404    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" podStartSLOduration=2.410878624 podStartE2EDuration="2.886388975s" totalImagesPullingTime="475.510351ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:35:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:35:29.885241218 +0000 UTC m=+1071.698665296" watchObservedRunningTime="2026-09-06 12:35:29.886388975 +0000 UTC m=+1071.699813054"
Sep 06 12:35:31.125802 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:31.125719    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"]
Sep 06 12:35:31.126219 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:31.125977    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy" containerID="cri-o://0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104" gracePeriod=30
Sep 06 12:35:35.883473 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:35.883438    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:35:36.425947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.425922    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:35:36.549801 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-envoy\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.549969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549812    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-socket\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.549969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/741d231f-d4d5-423b-a241-e0fbb4c18b48-istiod-ca-cert\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.549969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-podinfo\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.549969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-data\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.549969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bc5hq\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-kube-api-access-bc5hq\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.550302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-token\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.550302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.549996    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-credential-socket\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.550302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550015    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-certs\") pod \"741d231f-d4d5-423b-a241-e0fbb4c18b48\" (UID: \"741d231f-d4d5-423b-a241-e0fbb4c18b48\") "
Sep 06 12:35:36.550302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550108    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:36.550302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-data" (OuterVolumeSpecName: "istio-data") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:36.550541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550310    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/741d231f-d4d5-423b-a241-e0fbb4c18b48-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:35:36.550541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550372    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:36.550541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550431    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/741d231f-d4d5-423b-a241-e0fbb4c18b48-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.550541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550451    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.550541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550466    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:36.550541 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.550467    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.556620 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.556562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:35:36.564305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.564266    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-kube-api-access-bc5hq" (OuterVolumeSpecName: "kube-api-access-bc5hq") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "kube-api-access-bc5hq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:36.568282 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.568244    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-token" (OuterVolumeSpecName: "istio-token") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:35:36.577196 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.576251    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "741d231f-d4d5-423b-a241-e0fbb4c18b48" (UID: "741d231f-d4d5-423b-a241-e0fbb4c18b48"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:35:36.652086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.651962    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.652086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.652008    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bc5hq\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-kube-api-access-bc5hq\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.652086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.652025    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.652086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.652039    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.652086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.652052    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.652086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.652065    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/741d231f-d4d5-423b-a241-e0fbb4c18b48-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:35:36.913966 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.913931    2578 generic.go:356] "Generic (PLEG): container finished" podID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerID="0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104" exitCode=0
Sep 06 12:35:36.914420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.913987    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"
Sep 06 12:35:36.914420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.914013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" event={"ID":"741d231f-d4d5-423b-a241-e0fbb4c18b48","Type":"ContainerDied","Data":"0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104"}
Sep 06 12:35:36.914420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.914072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk" event={"ID":"741d231f-d4d5-423b-a241-e0fbb4c18b48","Type":"ContainerDied","Data":"be30252b44d3483c68a73bec88e18bd422bc6734ed0cb9056c636bc93e950258"}
Sep 06 12:35:36.914420 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.914098    2578 scope.go:117] "RemoveContainer" containerID="0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104"
Sep 06 12:35:36.926242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.926219    2578 scope.go:117] "RemoveContainer" containerID="cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"
Sep 06 12:35:36.931647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.931626    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"]
Sep 06 12:35:36.935610 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.935590    2578 scope.go:117] "RemoveContainer" containerID="0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104"
Sep 06 12:35:36.935887 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:36.935864    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104\": container with ID starting with 0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104 not found: ID does not exist" containerID="0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104"
Sep 06 12:35:36.935979 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.935893    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104"} err="failed to get container status \"0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104\": rpc error: code = NotFound desc = could not find container \"0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104\": container with ID starting with 0dc3a4ae35f636d617126776099807ca5aadf4a6d5127b3c93eedd9148723104 not found: ID does not exist"
Sep 06 12:35:36.935979 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.935912    2578 scope.go:117] "RemoveContainer" containerID="cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"
Sep 06 12:35:36.936183 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:36.936138    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1\": container with ID starting with cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1 not found: ID does not exist" containerID="cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"
Sep 06 12:35:36.936242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.936192    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1"} err="failed to get container status \"cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1\": rpc error: code = NotFound desc = could not find container \"cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1\": container with ID starting with cb6f569377a8b162beed7a6313a837e539cbf3bfa7e5257800713756748a30c1 not found: ID does not exist"
Sep 06 12:35:36.936887 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:36.936872    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-36bcab-openshift-default-6bf98967c6-cbzdk"]
Sep 06 12:35:38.675338 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:38.675296    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" path="/var/lib/kubelet/pods/741d231f-d4d5-423b-a241-e0fbb4c18b48/volumes"
Sep 06 12:35:41.113815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:41.113772    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:35:42.891321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:42.891279    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:35:42.891719 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:42.891337    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:35:43.964881 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:43.964849    2578 generic.go:356] "Generic (PLEG): container finished" podID="75930363-7111-4064-9660-318de2269a0b" containerID="55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae" exitCode=0
Sep 06 12:35:43.965390 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:43.964929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" event={"ID":"75930363-7111-4064-9660-318de2269a0b","Type":"ContainerDied","Data":"55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"}
Sep 06 12:35:43.965390 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:43.965345    2578 scope.go:117] "RemoveContainer" containerID="55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"
Sep 06 12:35:43.966493 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:43.966452    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:35:43.966577 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:43.966541    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:35:43.966615 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:43.966577    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:35:44.977819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:44.977776    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" event={"ID":"75930363-7111-4064-9660-318de2269a0b","Type":"ContainerStarted","Data":"b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58"}
Sep 06 12:35:45.938484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:45.938445    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:45.938736 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:45.938711    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 06 12:35:45.938806 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:45.938775    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 06 12:35:46.939190 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:46.939141    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 06 12:35:46.939584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:46.939239    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 06 12:35:47.939377 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:47.939341    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 06 12:35:47.939772 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:47.939399    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 06 12:35:48.939629 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:48.939595    2578 patch_prober.go:28] interesting pod/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Sep 06 12:35:48.940020 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:48.939654    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Sep 06 12:35:50.154808 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:50.154765    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:50.155395 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:50.155349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:50.156754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:50.156730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:35:51.507353 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:51.507317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:35:54.225225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.225189    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"]
Sep 06 12:35:54.225849 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.225823    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy"
Sep 06 12:35:54.225939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.225851    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy"
Sep 06 12:35:54.225939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.225867    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy"
Sep 06 12:35:54.225939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.225875    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy"
Sep 06 12:35:54.226093 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.225995    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy"
Sep 06 12:35:54.226093 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.226007    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="741d231f-d4d5-423b-a241-e0fbb4c18b48" containerName="istio-proxy"
Sep 06 12:35:54.230313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.230293    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.233015 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.232996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-3feb92-serving-cert\""
Sep 06 12:35:54.241837 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.241812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"]
Sep 06 12:35:54.333585 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.333553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.333738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.333599    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e35175-dc9e-4f10-a937-c0d6b02bd158-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.333738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.333678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.333738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.333724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z9mz\" (UniqueName: \"kubernetes.io/projected/f9e35175-dc9e-4f10-a937-c0d6b02bd158-kube-api-access-9z9mz\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.435019 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.434983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.435230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.435043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e35175-dc9e-4f10-a937-c0d6b02bd158-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.435230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.435110    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.435230 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:54.435171    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-serving-cert: secret "maas-api-e2e-shared-a-w3-3feb92-serving-cert" not found
Sep 06 12:35:54.435230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.435184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z9mz\" (UniqueName: \"kubernetes.io/projected/f9e35175-dc9e-4f10-a937-c0d6b02bd158-kube-api-access-9z9mz\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.435423 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:54.435250    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls podName:f9e35175-dc9e-4f10-a937-c0d6b02bd158 nodeName:}" failed. No retries permitted until 2026-09-06 12:35:54.935225334 +0000 UTC m=+1096.748649402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls") pod "maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" (UID: "f9e35175-dc9e-4f10-a937-c0d6b02bd158") : secret "maas-api-e2e-shared-a-w3-3feb92-serving-cert" not found
Sep 06 12:35:54.435726 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.435705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e35175-dc9e-4f10-a937-c0d6b02bd158-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.437703 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.437686    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.443507 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.443487    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z9mz\" (UniqueName: \"kubernetes.io/projected/f9e35175-dc9e-4f10-a937-c0d6b02bd158-kube-api-access-9z9mz\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.941265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.941223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:54.944432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:54.944395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:55.144827 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:55.144793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:55.418401 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:55.418373    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"]
Sep 06 12:35:55.419817 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:35:55.419790    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9e35175_dc9e_4f10_a937_c0d6b02bd158.slice/crio-514602e68461111a564e77f7da0bc4e9374c93b346c56fa4b8af90a3552dbc2b WatchSource:0}: Error finding container 514602e68461111a564e77f7da0bc4e9374c93b346c56fa4b8af90a3552dbc2b: Status 404 returned error can't find the container with id 514602e68461111a564e77f7da0bc4e9374c93b346c56fa4b8af90a3552dbc2b
Sep 06 12:35:56.048532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.048449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" event={"ID":"f9e35175-dc9e-4f10-a937-c0d6b02bd158","Type":"ContainerStarted","Data":"6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0"}
Sep 06 12:35:56.048532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.048498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" event={"ID":"f9e35175-dc9e-4f10-a937-c0d6b02bd158","Type":"ContainerStarted","Data":"514602e68461111a564e77f7da0bc4e9374c93b346c56fa4b8af90a3552dbc2b"}
Sep 06 12:35:56.048739 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.048594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:35:56.069017 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.068963    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" podStartSLOduration=1.705723646 podStartE2EDuration="2.068949879s" totalImagesPullingTime="363.226233ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:35:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:35:56.065889103 +0000 UTC m=+1097.879313185" watchObservedRunningTime="2026-09-06 12:35:56.068949879 +0000 UTC m=+1097.882373959"
Sep 06 12:35:56.216604 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.216567    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"]
Sep 06 12:35:56.220939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.220915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.223388 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.223365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-556bc6-serving-cert\""
Sep 06 12:35:56.228908 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.228833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"]
Sep 06 12:35:56.253611 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.253586    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhtqz\" (UniqueName: \"kubernetes.io/projected/0a16b53e-1ed4-4498-a19d-a60dc26d8421-kube-api-access-fhtqz\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.253747 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.253624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a16b53e-1ed4-4498-a19d-a60dc26d8421-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.253747 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.253667    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.253747 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.253692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.354202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.354122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.354202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.354191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.354356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.354299    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhtqz\" (UniqueName: \"kubernetes.io/projected/0a16b53e-1ed4-4498-a19d-a60dc26d8421-kube-api-access-fhtqz\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.354356 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:56.354314    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-serving-cert: secret "maas-api-e2e-shared-b-w2-556bc6-serving-cert" not found
Sep 06 12:35:56.354356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.354342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a16b53e-1ed4-4498-a19d-a60dc26d8421-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.354502 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:35:56.354382    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls podName:0a16b53e-1ed4-4498-a19d-a60dc26d8421 nodeName:}" failed. No retries permitted until 2026-09-06 12:35:56.854360115 +0000 UTC m=+1098.667784191 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls") pod "maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" (UID: "0a16b53e-1ed4-4498-a19d-a60dc26d8421") : secret "maas-api-e2e-shared-b-w2-556bc6-serving-cert" not found
Sep 06 12:35:56.355027 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.355006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a16b53e-1ed4-4498-a19d-a60dc26d8421-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.356643 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.356620    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.362345 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.362322    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhtqz\" (UniqueName: \"kubernetes.io/projected/0a16b53e-1ed4-4498-a19d-a60dc26d8421-kube-api-access-fhtqz\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.858848 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.858817    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:56.861214 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:56.861186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:57.135407 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:57.135325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:57.421103 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:57.421078    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"]
Sep 06 12:35:57.423006 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:35:57.422977    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a16b53e_1ed4_4498_a19d_a60dc26d8421.slice/crio-2ca7e90b18fe292f4e592fc28457d07bbfacbbf3f59914725292a71b4407c2be WatchSource:0}: Error finding container 2ca7e90b18fe292f4e592fc28457d07bbfacbbf3f59914725292a71b4407c2be: Status 404 returned error can't find the container with id 2ca7e90b18fe292f4e592fc28457d07bbfacbbf3f59914725292a71b4407c2be
Sep 06 12:35:58.065029 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:58.064931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" event={"ID":"0a16b53e-1ed4-4498-a19d-a60dc26d8421","Type":"ContainerStarted","Data":"056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5"}
Sep 06 12:35:58.065029 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:58.065001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" event={"ID":"0a16b53e-1ed4-4498-a19d-a60dc26d8421","Type":"ContainerStarted","Data":"2ca7e90b18fe292f4e592fc28457d07bbfacbbf3f59914725292a71b4407c2be"}
Sep 06 12:35:58.065563 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:58.065103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:35:58.085753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:35:58.085697    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" podStartSLOduration=1.753003164 podStartE2EDuration="2.085682061s" totalImagesPullingTime="332.678897ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:35:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:35:58.084073854 +0000 UTC m=+1099.897497933" watchObservedRunningTime="2026-09-06 12:35:58.085682061 +0000 UTC m=+1099.899106141"
Sep 06 12:36:02.061498 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:02.061463    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:36:04.076713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:04.076686    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:36:04.407002 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:04.406922    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:36:20.518937 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.518903    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:20.522612 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.522595    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:20.525104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.525079    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qfdls\""
Sep 06 12:36:20.530011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.529984    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:20.669766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.669732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhzb\" (UniqueName: \"kubernetes.io/projected/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49-kube-api-access-wmhzb\") pod \"test-curl-7754-139886970496320\" (UID: \"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49\") " pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:20.770614 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.770542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhzb\" (UniqueName: \"kubernetes.io/projected/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49-kube-api-access-wmhzb\") pod \"test-curl-7754-139886970496320\" (UID: \"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49\") " pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:20.781436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.781407    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhzb\" (UniqueName: \"kubernetes.io/projected/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49-kube-api-access-wmhzb\") pod \"test-curl-7754-139886970496320\" (UID: \"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49\") " pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:20.833390 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:20.833358    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:21.104574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:21.104544    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:21.105552 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:36:21.105524    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff9470cf_a0b0_4c0f_8f49_99290fbf4e49.slice/crio-e0d0788ec62c76c1fbfaeaad6d7a21e0b35c4752caf87a4e55f20b92f824a473 WatchSource:0}: Error finding container e0d0788ec62c76c1fbfaeaad6d7a21e0b35c4752caf87a4e55f20b92f824a473: Status 404 returned error can't find the container with id e0d0788ec62c76c1fbfaeaad6d7a21e0b35c4752caf87a4e55f20b92f824a473
Sep 06 12:36:21.209230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:21.209143    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496320" event={"ID":"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49","Type":"ContainerStarted","Data":"e0d0788ec62c76c1fbfaeaad6d7a21e0b35c4752caf87a4e55f20b92f824a473"}
Sep 06 12:36:22.216433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.216392    2578 generic.go:356] "Generic (PLEG): container finished" podID="ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" containerID="05d50adc081149b25791229bfc12014ff898e173802a44b6b6a025559353fd70" exitCode=0
Sep 06 12:36:22.216894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.216459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496320" event={"ID":"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49","Type":"ContainerDied","Data":"05d50adc081149b25791229bfc12014ff898e173802a44b6b6a025559353fd70"}
Sep 06 12:36:22.369601 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.369570    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"]
Sep 06 12:36:22.373283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.373263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.376486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.376470    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-e6515e-serving-cert\""
Sep 06 12:36:22.391531 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.391507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"]
Sep 06 12:36:22.488387 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.488320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.488387 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.488379    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.488533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.488429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59381cd3-3e6c-445d-b491-bc44c49f51f9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.488533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.488461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb864\" (UniqueName: \"kubernetes.io/projected/59381cd3-3e6c-445d-b491-bc44c49f51f9-kube-api-access-wb864\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.589369 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.589338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.589490 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.589397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.589490 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.589444    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59381cd3-3e6c-445d-b491-bc44c49f51f9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.589604 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.589487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb864\" (UniqueName: \"kubernetes.io/projected/59381cd3-3e6c-445d-b491-bc44c49f51f9-kube-api-access-wb864\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.590124 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.590104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59381cd3-3e6c-445d-b491-bc44c49f51f9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.591857 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.591835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.591926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.591902    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.596709 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.596691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb864\" (UniqueName: \"kubernetes.io/projected/59381cd3-3e6c-445d-b491-bc44c49f51f9-kube-api-access-wb864\") pod \"maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.683981 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.683955    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:22.966834 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:22.966808    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"]
Sep 06 12:36:22.967884 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:36:22.967861    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59381cd3_3e6c_445d_b491_bc44c49f51f9.slice/crio-826dd4f9304093e07f0a6b736916dc270abf49c2b6921ec5fca115f3310d8e45 WatchSource:0}: Error finding container 826dd4f9304093e07f0a6b736916dc270abf49c2b6921ec5fca115f3310d8e45: Status 404 returned error can't find the container with id 826dd4f9304093e07f0a6b736916dc270abf49c2b6921ec5fca115f3310d8e45
Sep 06 12:36:23.223879 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.223843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l" event={"ID":"59381cd3-3e6c-445d-b491-bc44c49f51f9","Type":"ContainerStarted","Data":"826dd4f9304093e07f0a6b736916dc270abf49c2b6921ec5fca115f3310d8e45"}
Sep 06 12:36:23.379782 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.379757    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:23.413779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.413708    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7754-139886970496320_ff9470cf-a0b0-4c0f-8f49-99290fbf4e49/test-curl-7754-139886970496320/0.log"
Sep 06 12:36:23.436423 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.436395    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:23.440261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.440240    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:23.497949 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.497891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmhzb\" (UniqueName: \"kubernetes.io/projected/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49-kube-api-access-wmhzb\") pod \"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49\" (UID: \"ff9470cf-a0b0-4c0f-8f49-99290fbf4e49\") "
Sep 06 12:36:23.499980 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.499958    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49-kube-api-access-wmhzb" (OuterVolumeSpecName: "kube-api-access-wmhzb") pod "ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" (UID: "ff9470cf-a0b0-4c0f-8f49-99290fbf4e49"). InnerVolumeSpecName "kube-api-access-wmhzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:36:23.552661 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.552626    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:23.553291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.553268    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" containerName="test-curl-7754-139886970496320"
Sep 06 12:36:23.553291 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.553293    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" containerName="test-curl-7754-139886970496320"
Sep 06 12:36:23.553454 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.553431    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" containerName="test-curl-7754-139886970496320"
Sep 06 12:36:23.556885 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.556861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:23.559775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.559753    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:23.599210 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.599187    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmhzb\" (UniqueName: \"kubernetes.io/projected/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49-kube-api-access-wmhzb\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:36:23.700261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.700218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cn8w\" (UniqueName: \"kubernetes.io/projected/2dc947a9-10e3-438b-8549-adce92f45988-kube-api-access-5cn8w\") pod \"test-curl-7754-139886970496320\" (UID: \"2dc947a9-10e3-438b-8549-adce92f45988\") " pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:23.801619 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.801552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cn8w\" (UniqueName: \"kubernetes.io/projected/2dc947a9-10e3-438b-8549-adce92f45988-kube-api-access-5cn8w\") pod \"test-curl-7754-139886970496320\" (UID: \"2dc947a9-10e3-438b-8549-adce92f45988\") " pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:23.809405 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.809385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cn8w\" (UniqueName: \"kubernetes.io/projected/2dc947a9-10e3-438b-8549-adce92f45988-kube-api-access-5cn8w\") pod \"test-curl-7754-139886970496320\" (UID: \"2dc947a9-10e3-438b-8549-adce92f45988\") " pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:23.867725 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:23.867703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:24.136548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.136525    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:24.137499 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:36:24.137478    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2dc947a9_10e3_438b_8549_adce92f45988.slice/crio-eada933ff11a699186e3be98f9fc71116a5e9a04682e50d9ab4d72b5670ac58f WatchSource:0}: Error finding container eada933ff11a699186e3be98f9fc71116a5e9a04682e50d9ab4d72b5670ac58f: Status 404 returned error can't find the container with id eada933ff11a699186e3be98f9fc71116a5e9a04682e50d9ab4d72b5670ac58f
Sep 06 12:36:24.231351 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.231324    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l" event={"ID":"59381cd3-3e6c-445d-b491-bc44c49f51f9","Type":"ContainerStarted","Data":"86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e"}
Sep 06 12:36:24.231702 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.231513    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:24.232704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.232687    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:24.232773 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.232704    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e0d0788ec62c76c1fbfaeaad6d7a21e0b35c4752caf87a4e55f20b92f824a473"
Sep 06 12:36:24.234021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.234002    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496320" event={"ID":"2dc947a9-10e3-438b-8549-adce92f45988","Type":"ContainerStarted","Data":"eada933ff11a699186e3be98f9fc71116a5e9a04682e50d9ab4d72b5670ac58f"}
Sep 06 12:36:24.251456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.251409    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l" podStartSLOduration=1.9143517559999998 podStartE2EDuration="2.251392696s" totalImagesPullingTime="337.04094ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:36:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:36:24.249900381 +0000 UTC m=+1126.063324462" watchObservedRunningTime="2026-09-06 12:36:24.251392696 +0000 UTC m=+1126.064816778"
Sep 06 12:36:24.252996 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.252962    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7754-139886970496320" oldPodUID="ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" podUID="2dc947a9-10e3-438b-8549-adce92f45988"
Sep 06 12:36:24.668696 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:24.668660    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff9470cf-a0b0-4c0f-8f49-99290fbf4e49" path="/var/lib/kubelet/pods/ff9470cf-a0b0-4c0f-8f49-99290fbf4e49/volumes"
Sep 06 12:36:25.243853 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:25.243827    2578 generic.go:356] "Generic (PLEG): container finished" podID="2dc947a9-10e3-438b-8549-adce92f45988" containerID="88ffcad5d73b07e456b16d00412bd2cc89d29e6c2b2321d21c319e6a5c0e665d" exitCode=0
Sep 06 12:36:25.244220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:25.243925    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496320" event={"ID":"2dc947a9-10e3-438b-8549-adce92f45988","Type":"ContainerDied","Data":"88ffcad5d73b07e456b16d00412bd2cc89d29e6c2b2321d21c319e6a5c0e665d"}
Sep 06 12:36:26.390333 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.390312    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:26.410586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.410562    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7754-139886970496320_2dc947a9-10e3-438b-8549-adce92f45988/test-curl-7754-139886970496320/0.log"
Sep 06 12:36:26.433108 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.433058    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:26.436459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.436439    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7754-139886970496320"]
Sep 06 12:36:26.524508 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.524445    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5cn8w\" (UniqueName: \"kubernetes.io/projected/2dc947a9-10e3-438b-8549-adce92f45988-kube-api-access-5cn8w\") pod \"2dc947a9-10e3-438b-8549-adce92f45988\" (UID: \"2dc947a9-10e3-438b-8549-adce92f45988\") "
Sep 06 12:36:26.526438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.526413    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2dc947a9-10e3-438b-8549-adce92f45988-kube-api-access-5cn8w" (OuterVolumeSpecName: "kube-api-access-5cn8w") pod "2dc947a9-10e3-438b-8549-adce92f45988" (UID: "2dc947a9-10e3-438b-8549-adce92f45988"). InnerVolumeSpecName "kube-api-access-5cn8w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:36:26.550719 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.550685    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:26.551165 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.551122    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2dc947a9-10e3-438b-8549-adce92f45988" containerName="test-curl-7754-139886970496320"
Sep 06 12:36:26.551165 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.551140    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2dc947a9-10e3-438b-8549-adce92f45988" containerName="test-curl-7754-139886970496320"
Sep 06 12:36:26.551352 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.551337    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2dc947a9-10e3-438b-8549-adce92f45988" containerName="test-curl-7754-139886970496320"
Sep 06 12:36:26.554441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.554423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:26.573593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.573568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:26.625786 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.625757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t9fxk\" (UniqueName: \"kubernetes.io/projected/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953-kube-api-access-t9fxk\") pod \"test-curl-7754-139886970496896\" (UID: \"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953\") " pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:26.625952 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.625934    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5cn8w\" (UniqueName: \"kubernetes.io/projected/2dc947a9-10e3-438b-8549-adce92f45988-kube-api-access-5cn8w\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:36:26.668688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.668665    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2dc947a9-10e3-438b-8549-adce92f45988" path="/var/lib/kubelet/pods/2dc947a9-10e3-438b-8549-adce92f45988/volumes"
Sep 06 12:36:26.726731 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.726711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t9fxk\" (UniqueName: \"kubernetes.io/projected/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953-kube-api-access-t9fxk\") pod \"test-curl-7754-139886970496896\" (UID: \"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953\") " pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:26.734849 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.734820    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t9fxk\" (UniqueName: \"kubernetes.io/projected/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953-kube-api-access-t9fxk\") pod \"test-curl-7754-139886970496896\" (UID: \"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953\") " pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:26.869798 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:26.869734    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:27.142907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:27.142884    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:27.144003 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:36:27.143976    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod212f32b5_b2bb_4f66_a9a5_27ce7f0c0953.slice/crio-fa732ec57ce3481e28797214fc4dc069f5fa8ed76bf989b6536a50ad187a2630 WatchSource:0}: Error finding container fa732ec57ce3481e28797214fc4dc069f5fa8ed76bf989b6536a50ad187a2630: Status 404 returned error can't find the container with id fa732ec57ce3481e28797214fc4dc069f5fa8ed76bf989b6536a50ad187a2630
Sep 06 12:36:27.258534 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:27.258507    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496320"
Sep 06 12:36:27.258734 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:27.258550    2578 scope.go:117] "RemoveContainer" containerID="88ffcad5d73b07e456b16d00412bd2cc89d29e6c2b2321d21c319e6a5c0e665d"
Sep 06 12:36:27.260381 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:27.260240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496896" event={"ID":"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953","Type":"ContainerStarted","Data":"fa732ec57ce3481e28797214fc4dc069f5fa8ed76bf989b6536a50ad187a2630"}
Sep 06 12:36:28.268284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:28.268252    2578 generic.go:356] "Generic (PLEG): container finished" podID="212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" containerID="f57eaabb0380640c8dd1de80ca8f924eeb31d13c592217b53df1eb76d2020179" exitCode=0
Sep 06 12:36:28.268709 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:28.268338    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496896" event={"ID":"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953","Type":"ContainerDied","Data":"f57eaabb0380640c8dd1de80ca8f924eeb31d13c592217b53df1eb76d2020179"}
Sep 06 12:36:28.415053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:28.415013    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:36:29.418090 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.418062    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:29.436960 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.436935    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7754-139886970496896_212f32b5-b2bb-4f66-a9a5-27ce7f0c0953/test-curl-7754-139886970496896/0.log"
Sep 06 12:36:29.459627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.459598    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:29.465559 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.465534    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:29.548803 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.548718    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t9fxk\" (UniqueName: \"kubernetes.io/projected/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953-kube-api-access-t9fxk\") pod \"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953\" (UID: \"212f32b5-b2bb-4f66-a9a5-27ce7f0c0953\") "
Sep 06 12:36:29.551058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.551021    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953-kube-api-access-t9fxk" (OuterVolumeSpecName: "kube-api-access-t9fxk") pod "212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" (UID: "212f32b5-b2bb-4f66-a9a5-27ce7f0c0953"). InnerVolumeSpecName "kube-api-access-t9fxk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:36:29.579371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.579339    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:29.579812 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.579796    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" containerName="test-curl-7754-139886970496896"
Sep 06 12:36:29.579907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.579815    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" containerName="test-curl-7754-139886970496896"
Sep 06 12:36:29.579907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.579901    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" containerName="test-curl-7754-139886970496896"
Sep 06 12:36:29.582964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.582949    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:29.591044 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.590611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:29.649530 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.649507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cw5f8\" (UniqueName: \"kubernetes.io/projected/29af6109-cb9f-4657-a7da-9b1dd4634721-kube-api-access-cw5f8\") pod \"test-curl-7754-139886970496896\" (UID: \"29af6109-cb9f-4657-a7da-9b1dd4634721\") " pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:29.649683 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.649665    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t9fxk\" (UniqueName: \"kubernetes.io/projected/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953-kube-api-access-t9fxk\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:36:29.750964 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.750927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cw5f8\" (UniqueName: \"kubernetes.io/projected/29af6109-cb9f-4657-a7da-9b1dd4634721-kube-api-access-cw5f8\") pod \"test-curl-7754-139886970496896\" (UID: \"29af6109-cb9f-4657-a7da-9b1dd4634721\") " pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:29.758586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.758561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cw5f8\" (UniqueName: \"kubernetes.io/projected/29af6109-cb9f-4657-a7da-9b1dd4634721-kube-api-access-cw5f8\") pod \"test-curl-7754-139886970496896\" (UID: \"29af6109-cb9f-4657-a7da-9b1dd4634721\") " pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:29.894378 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:29.894317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:30.168281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.168253    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:30.169329 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:36:30.169298    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod29af6109_cb9f_4657_a7da_9b1dd4634721.slice/crio-dad41740d2f8686d170bbb949387c864b5ac2374f971ed27f7ed3eebcccb3a10 WatchSource:0}: Error finding container dad41740d2f8686d170bbb949387c864b5ac2374f971ed27f7ed3eebcccb3a10: Status 404 returned error can't find the container with id dad41740d2f8686d170bbb949387c864b5ac2374f971ed27f7ed3eebcccb3a10
Sep 06 12:36:30.249505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.249484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:36:30.286061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.286024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496896" event={"ID":"29af6109-cb9f-4657-a7da-9b1dd4634721","Type":"ContainerStarted","Data":"dad41740d2f8686d170bbb949387c864b5ac2374f971ed27f7ed3eebcccb3a10"}
Sep 06 12:36:30.287766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.287736    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fa732ec57ce3481e28797214fc4dc069f5fa8ed76bf989b6536a50ad187a2630"
Sep 06 12:36:30.287766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.287744    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:30.302176 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.302123    2578 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7754-139886970496896" oldPodUID="212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" podUID="29af6109-cb9f-4657-a7da-9b1dd4634721"
Sep 06 12:36:30.668483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:30.668448    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="212f32b5-b2bb-4f66-a9a5-27ce7f0c0953" path="/var/lib/kubelet/pods/212f32b5-b2bb-4f66-a9a5-27ce7f0c0953/volumes"
Sep 06 12:36:32.302220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:32.302186    2578 generic.go:356] "Generic (PLEG): container finished" podID="29af6109-cb9f-4657-a7da-9b1dd4634721" containerID="ed5c89750940662a75cda52891c1cf4f33234f9a458b7b2bf5a7696773ce371b" exitCode=0
Sep 06 12:36:32.302583 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:32.302236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7754-139886970496896" event={"ID":"29af6109-cb9f-4657-a7da-9b1dd4634721","Type":"ContainerDied","Data":"ed5c89750940662a75cda52891c1cf4f33234f9a458b7b2bf5a7696773ce371b"}
Sep 06 12:36:33.463785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.463757    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:33.481883 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.481857    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7754-139886970496896_29af6109-cb9f-4657-a7da-9b1dd4634721/test-curl-7754-139886970496896/0.log"
Sep 06 12:36:33.504594 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.504569    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:33.507745 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.507721    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7754-139886970496896"]
Sep 06 12:36:33.602970 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.602902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cw5f8\" (UniqueName: \"kubernetes.io/projected/29af6109-cb9f-4657-a7da-9b1dd4634721-kube-api-access-cw5f8\") pod \"29af6109-cb9f-4657-a7da-9b1dd4634721\" (UID: \"29af6109-cb9f-4657-a7da-9b1dd4634721\") "
Sep 06 12:36:33.604899 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.604878    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29af6109-cb9f-4657-a7da-9b1dd4634721-kube-api-access-cw5f8" (OuterVolumeSpecName: "kube-api-access-cw5f8") pod "29af6109-cb9f-4657-a7da-9b1dd4634721" (UID: "29af6109-cb9f-4657-a7da-9b1dd4634721"). InnerVolumeSpecName "kube-api-access-cw5f8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:36:33.703831 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:33.703807    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cw5f8\" (UniqueName: \"kubernetes.io/projected/29af6109-cb9f-4657-a7da-9b1dd4634721-kube-api-access-cw5f8\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:36:34.316710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:34.316685    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dad41740d2f8686d170bbb949387c864b5ac2374f971ed27f7ed3eebcccb3a10"
Sep 06 12:36:34.316851 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:34.316719    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:34.326738 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:36:34.326709    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7754-139886970496896\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="29af6109-cb9f-4657-a7da-9b1dd4634721" pod="opendatahub/test-curl-7754-139886970496896"
Sep 06 12:36:34.669688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:34.669602    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29af6109-cb9f-4657-a7da-9b1dd4634721" path="/var/lib/kubelet/pods/29af6109-cb9f-4657-a7da-9b1dd4634721/volumes"
Sep 06 12:36:38.363124 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.363086    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"]
Sep 06 12:36:38.363772 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.363751    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29af6109-cb9f-4657-a7da-9b1dd4634721" containerName="test-curl-7754-139886970496896"
Sep 06 12:36:38.363845 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.363776    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="29af6109-cb9f-4657-a7da-9b1dd4634721" containerName="test-curl-7754-139886970496896"
Sep 06 12:36:38.363912 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.363900    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="29af6109-cb9f-4657-a7da-9b1dd4634721" containerName="test-curl-7754-139886970496896"
Sep 06 12:36:38.367399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.367376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.370111 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.370089    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-48920d6f-serving-cert\""
Sep 06 12:36:38.376722 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.376698    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"]
Sep 06 12:36:38.544281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.544244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-openshift-service-ca\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.544446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.544296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-maas-api-tls\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.544446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.544370    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b82gm\" (UniqueName: \"kubernetes.io/projected/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-kube-api-access-b82gm\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.544446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.544407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-metrics-certs\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.645248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.645178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b82gm\" (UniqueName: \"kubernetes.io/projected/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-kube-api-access-b82gm\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.645248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.645216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-metrics-certs\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.645447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.645260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-openshift-service-ca\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.645447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.645287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-maas-api-tls\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.645983 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.645960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-openshift-service-ca\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.647777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.647756    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-48920d6f-serving-cert\""
Sep 06 12:36:38.647853 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.647759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-metrics-certs\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.654990 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.654950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b82gm\" (UniqueName: \"kubernetes.io/projected/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-kube-api-access-b82gm\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.658033 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.658008    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-maas-api-tls\") pod \"maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.680730 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.680709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:38.901489 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.901410    2578 scope.go:117] "RemoveContainer" containerID="3857d6397b934947c1ea56b288a54c539e323d48927295d285963ad2d6c42480"
Sep 06 12:36:38.952386 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:38.952358    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"]
Sep 06 12:36:38.953368 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:36:38.953341    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a9b2b21_bb8b_485d_9583_2f8b756f00f8.slice/crio-81cefc74b614376eeb7e93609383ff444d930cda4d7c2787401738a51ff295a9 WatchSource:0}: Error finding container 81cefc74b614376eeb7e93609383ff444d930cda4d7c2787401738a51ff295a9: Status 404 returned error can't find the container with id 81cefc74b614376eeb7e93609383ff444d930cda4d7c2787401738a51ff295a9
Sep 06 12:36:39.353165 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:39.353108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b" event={"ID":"3a9b2b21-bb8b-485d-9583-2f8b756f00f8","Type":"ContainerStarted","Data":"81cefc74b614376eeb7e93609383ff444d930cda4d7c2787401738a51ff295a9"}
Sep 06 12:36:40.362332 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:40.362296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b" event={"ID":"3a9b2b21-bb8b-485d-9583-2f8b756f00f8","Type":"ContainerStarted","Data":"58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb"}
Sep 06 12:36:40.362775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:40.362351    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:36:40.381119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:40.381074    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b" podStartSLOduration=1.9960546209999999 podStartE2EDuration="2.381059572s" totalImagesPullingTime="385.004951ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:36:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:36:40.38018701 +0000 UTC m=+1142.193611101" watchObservedRunningTime="2026-09-06 12:36:40.381059572 +0000 UTC m=+1142.194483696"
Sep 06 12:36:45.427300 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:45.427261    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:36:46.376906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:36:46.376857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:37:02.813281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:02.813205    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:37:15.706061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:15.706024    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:37:27.802518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.802469    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"]
Sep 06 12:37:27.806996 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.806973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:27.809868 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.809843    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-48920d6f\"/\"openshift-service-ca.crt\""
Sep 06 12:37:27.809998 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.809889    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-48920d6f\"/\"default-dockercfg-lzlkt\""
Sep 06 12:37:27.811011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.810992    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-48920d6f\"/\"e2e-lifecycle-model-48920d6f-kserve-self-signed-certs\""
Sep 06 12:37:27.811103 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.811053    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-48920d6f\"/\"kube-root-ca.crt\""
Sep 06 12:37:27.817433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.817412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"]
Sep 06 12:37:27.942997 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.942963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff945b9-1684-4ccb-815e-f77536b77208-tls-certs\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:27.943135 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.943001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-dshm\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:27.943135 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.943086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28r28\" (UniqueName: \"kubernetes.io/projected/5ff945b9-1684-4ccb-815e-f77536b77208-kube-api-access-28r28\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:27.943281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.943140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-tmp-dir\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:27.943281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.943197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-model-cache\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:27.943281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:27.943271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-home\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044137 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-tmp-dir\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044143    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-model-cache\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044197    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-home\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff945b9-1684-4ccb-815e-f77536b77208-tls-certs\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044289 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-dshm\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044335    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28r28\" (UniqueName: \"kubernetes.io/projected/5ff945b9-1684-4ccb-815e-f77536b77208-kube-api-access-28r28\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044543    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-tmp-dir\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044619 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-model-cache\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.044669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.044654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-home\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.046467 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.046448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-dshm\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.046806 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.046791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff945b9-1684-4ccb-815e-f77536b77208-tls-certs\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.052735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.052666    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28r28\" (UniqueName: \"kubernetes.io/projected/5ff945b9-1684-4ccb-815e-f77536b77208-kube-api-access-28r28\") pod \"e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") " pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.120204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.120172    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:28.394904 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.394873    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"]
Sep 06 12:37:28.397011 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:37:28.396983    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5ff945b9_1684_4ccb_815e_f77536b77208.slice/crio-b89b1209771745cb168c05b0a092ab86e5ecae0413272c5059aac324e4430ec0 WatchSource:0}: Error finding container b89b1209771745cb168c05b0a092ab86e5ecae0413272c5059aac324e4430ec0: Status 404 returned error can't find the container with id b89b1209771745cb168c05b0a092ab86e5ecae0413272c5059aac324e4430ec0
Sep 06 12:37:28.670754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.670662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv" event={"ID":"5ff945b9-1684-4ccb-815e-f77536b77208","Type":"ContainerStarted","Data":"47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091"}
Sep 06 12:37:28.670754 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.670700    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv" event={"ID":"5ff945b9-1684-4ccb-815e-f77536b77208","Type":"ContainerStarted","Data":"b89b1209771745cb168c05b0a092ab86e5ecae0413272c5059aac324e4430ec0"}
Sep 06 12:37:28.688771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:28.688723    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv" podStartSLOduration=1.688709027 podStartE2EDuration="1.688709027s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:37:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:37:28.687484758 +0000 UTC m=+1190.500908838" watchObservedRunningTime="2026-09-06 12:37:28.688709027 +0000 UTC m=+1190.502133105"
Sep 06 12:37:35.912844 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:35.912806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:37:38.121203 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.121165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:38.121589 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.121220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:38.133809 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.133785    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:38.746088 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.746058    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:37:38.780933 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.780893    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:37:38.782327 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.782300    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:37:38.928605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.928571    2578 scope.go:117] "RemoveContainer" containerID="ecb18fcee53bf06891cc3efcf1708c86945088e703556781361a609c904ff8af"
Sep 06 12:37:38.937079 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:38.937064    2578 scope.go:117] "RemoveContainer" containerID="d35907acdf58f62a343eb380c1d7d6a9fc7404aef179d65f976189f6ff225ff7"
Sep 06 12:37:51.104243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:37:51.104209    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:38:09.104266 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:09.104229    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:38:22.307124 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.307037    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"]
Sep 06 12:38:22.307725 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.307281    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b" podUID="3a9b2b21-bb8b-485d-9583-2f8b756f00f8" containerName="maas-api" containerID="cri-o://58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb" gracePeriod=30
Sep 06 12:38:22.568811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.568753    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:38:22.731933 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.731903    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-maas-api-tls\") pod \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") "
Sep 06 12:38:22.732098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.731950    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b82gm\" (UniqueName: \"kubernetes.io/projected/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-kube-api-access-b82gm\") pod \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") "
Sep 06 12:38:22.732098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.731977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-openshift-service-ca\") pod \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") "
Sep 06 12:38:22.732098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.732061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-metrics-certs\") pod \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\" (UID: \"3a9b2b21-bb8b-485d-9583-2f8b756f00f8\") "
Sep 06 12:38:22.732424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.732392    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3a9b2b21-bb8b-485d-9583-2f8b756f00f8" (UID: "3a9b2b21-bb8b-485d-9583-2f8b756f00f8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:38:22.734179 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.734125    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3a9b2b21-bb8b-485d-9583-2f8b756f00f8" (UID: "3a9b2b21-bb8b-485d-9583-2f8b756f00f8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:38:22.734285 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.734241    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-kube-api-access-b82gm" (OuterVolumeSpecName: "kube-api-access-b82gm") pod "3a9b2b21-bb8b-485d-9583-2f8b756f00f8" (UID: "3a9b2b21-bb8b-485d-9583-2f8b756f00f8"). InnerVolumeSpecName "kube-api-access-b82gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:38:22.734365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.734346    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "3a9b2b21-bb8b-485d-9583-2f8b756f00f8" (UID: "3a9b2b21-bb8b-485d-9583-2f8b756f00f8"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:38:22.833330 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.833086    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:22.833330 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.833116    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b82gm\" (UniqueName: \"kubernetes.io/projected/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-kube-api-access-b82gm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:22.833330 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.833133    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:22.833330 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:22.833176    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a9b2b21-bb8b-485d-9583-2f8b756f00f8-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:23.012628 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.012596    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a9b2b21-bb8b-485d-9583-2f8b756f00f8" containerID="58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb" exitCode=0
Sep 06 12:38:23.012783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.012644    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"
Sep 06 12:38:23.012783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.012682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b" event={"ID":"3a9b2b21-bb8b-485d-9583-2f8b756f00f8","Type":"ContainerDied","Data":"58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb"}
Sep 06 12:38:23.012783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.012735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b" event={"ID":"3a9b2b21-bb8b-485d-9583-2f8b756f00f8","Type":"ContainerDied","Data":"81cefc74b614376eeb7e93609383ff444d930cda4d7c2787401738a51ff295a9"}
Sep 06 12:38:23.012783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.012757    2578 scope.go:117] "RemoveContainer" containerID="58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb"
Sep 06 12:38:23.022790 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.022774    2578 scope.go:117] "RemoveContainer" containerID="58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb"
Sep 06 12:38:23.023066 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:38:23.023049    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb\": container with ID starting with 58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb not found: ID does not exist" containerID="58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb"
Sep 06 12:38:23.023134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.023079    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb"} err="failed to get container status \"58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb\": rpc error: code = NotFound desc = could not find container \"58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb\": container with ID starting with 58c16f23fbee727d897b22816bc81dd3f40174a2784259b31b2e0fd201ce7fdb not found: ID does not exist"
Sep 06 12:38:23.039853 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.039822    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"]
Sep 06 12:38:23.042270 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:23.042248    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-48920d6f-6946cd4578-tqg7b"]
Sep 06 12:38:24.668831 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:24.668791    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a9b2b21-bb8b-485d-9583-2f8b756f00f8" path="/var/lib/kubelet/pods/3a9b2b21-bb8b-485d-9583-2f8b756f00f8/volumes"
Sep 06 12:38:27.006188 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:27.006143    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:38:30.516466 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:30.516419    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"]
Sep 06 12:38:38.966171 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:38.966076    2578 scope.go:117] "RemoveContainer" containerID="934d1d8bcc7816b60b05ab67e4e0b64b5ff3fab276cc16f61ce350ba1c56ffae"
Sep 06 12:38:38.975040 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:38.975019    2578 scope.go:117] "RemoveContainer" containerID="720b6002f7a9509437b0f1d205ccd7b43f6f60a31390be294e388cb383a7d9e7"
Sep 06 12:38:38.984692 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:38.984666    2578 scope.go:117] "RemoveContainer" containerID="a66fe6cdd76e2d9ff64fbb3c5070b9bdb3be156390d7c663baa7582a012c57fe"
Sep 06 12:38:44.109129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:44.109094    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:38:45.536791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.536745    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv" podUID="5ff945b9-1684-4ccb-815e-f77536b77208" containerName="main" containerID="cri-o://47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091" gracePeriod=45
Sep 06 12:38:45.788432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.788379    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:38:45.824609 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824584    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-home\") pod \"5ff945b9-1684-4ccb-815e-f77536b77208\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") "
Sep 06 12:38:45.824737 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824681    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28r28\" (UniqueName: \"kubernetes.io/projected/5ff945b9-1684-4ccb-815e-f77536b77208-kube-api-access-28r28\") pod \"5ff945b9-1684-4ccb-815e-f77536b77208\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") "
Sep 06 12:38:45.824737 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824709    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-tmp-dir\") pod \"5ff945b9-1684-4ccb-815e-f77536b77208\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") "
Sep 06 12:38:45.824860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824738    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-dshm\") pod \"5ff945b9-1684-4ccb-815e-f77536b77208\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") "
Sep 06 12:38:45.824860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824765    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-model-cache\") pod \"5ff945b9-1684-4ccb-815e-f77536b77208\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") "
Sep 06 12:38:45.824860 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff945b9-1684-4ccb-815e-f77536b77208-tls-certs\") pod \"5ff945b9-1684-4ccb-815e-f77536b77208\" (UID: \"5ff945b9-1684-4ccb-815e-f77536b77208\") "
Sep 06 12:38:45.825007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824856    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-home" (OuterVolumeSpecName: "home") pod "5ff945b9-1684-4ccb-815e-f77536b77208" (UID: "5ff945b9-1684-4ccb-815e-f77536b77208"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:38:45.825007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.824990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5ff945b9-1684-4ccb-815e-f77536b77208" (UID: "5ff945b9-1684-4ccb-815e-f77536b77208"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:38:45.825113 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.825075    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-model-cache" (OuterVolumeSpecName: "model-cache") pod "5ff945b9-1684-4ccb-815e-f77536b77208" (UID: "5ff945b9-1684-4ccb-815e-f77536b77208"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:38:45.825263 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.825241    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-tmp-dir\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:45.825323 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.825267    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-model-cache\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:45.825323 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.825280    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-home\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:45.826926 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.826904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ff945b9-1684-4ccb-815e-f77536b77208-kube-api-access-28r28" (OuterVolumeSpecName: "kube-api-access-28r28") pod "5ff945b9-1684-4ccb-815e-f77536b77208" (UID: "5ff945b9-1684-4ccb-815e-f77536b77208"). InnerVolumeSpecName "kube-api-access-28r28". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:38:45.827280 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.827252    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-dshm" (OuterVolumeSpecName: "dshm") pod "5ff945b9-1684-4ccb-815e-f77536b77208" (UID: "5ff945b9-1684-4ccb-815e-f77536b77208"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:38:45.827399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.827322    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ff945b9-1684-4ccb-815e-f77536b77208-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5ff945b9-1684-4ccb-815e-f77536b77208" (UID: "5ff945b9-1684-4ccb-815e-f77536b77208"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:38:45.925749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.925712    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5ff945b9-1684-4ccb-815e-f77536b77208-dshm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:45.925749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.925741    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5ff945b9-1684-4ccb-815e-f77536b77208-tls-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:45.925749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:45.925756    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28r28\" (UniqueName: \"kubernetes.io/projected/5ff945b9-1684-4ccb-815e-f77536b77208-kube-api-access-28r28\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:38:46.165507 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.165416    2578 generic.go:356] "Generic (PLEG): container finished" podID="5ff945b9-1684-4ccb-815e-f77536b77208" containerID="47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091" exitCode=0
Sep 06 12:38:46.165507 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.165454    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"
Sep 06 12:38:46.165507 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.165498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv" event={"ID":"5ff945b9-1684-4ccb-815e-f77536b77208","Type":"ContainerDied","Data":"47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091"}
Sep 06 12:38:46.165791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.165541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv" event={"ID":"5ff945b9-1684-4ccb-815e-f77536b77208","Type":"ContainerDied","Data":"b89b1209771745cb168c05b0a092ab86e5ecae0413272c5059aac324e4430ec0"}
Sep 06 12:38:46.165791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.165559    2578 scope.go:117] "RemoveContainer" containerID="47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091"
Sep 06 12:38:46.175319 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.175303    2578 scope.go:117] "RemoveContainer" containerID="47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091"
Sep 06 12:38:46.175614 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:38:46.175593    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091\": container with ID starting with 47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091 not found: ID does not exist" containerID="47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091"
Sep 06 12:38:46.175662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.175624    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091"} err="failed to get container status \"47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091\": rpc error: code = NotFound desc = could not find container \"47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091\": container with ID starting with 47591865e65549b48437f1c104fa246c2b2b90f5236e2e87afc2e6d498fa5091 not found: ID does not exist"
Sep 06 12:38:46.187672 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.187647    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"]
Sep 06 12:38:46.192058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.192036    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-48920d6f/e2e-lifecycle-model-48920d6f-kserve-6b7f9778c-c95kv"]
Sep 06 12:38:46.668858 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:38:46.668827    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ff945b9-1684-4ccb-815e-f77536b77208" path="/var/lib/kubelet/pods/5ff945b9-1684-4ccb-815e-f77536b77208/volumes"
Sep 06 12:39:03.812992 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:03.812960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:39:18.316930 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:18.316898    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:39:28.887111 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887070    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7757-e3a300"]
Sep 06 12:39:28.887689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887669    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a9b2b21-bb8b-485d-9583-2f8b756f00f8" containerName="maas-api"
Sep 06 12:39:28.887778 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887691    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a9b2b21-bb8b-485d-9583-2f8b756f00f8" containerName="maas-api"
Sep 06 12:39:28.887778 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887739    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ff945b9-1684-4ccb-815e-f77536b77208" containerName="main"
Sep 06 12:39:28.887778 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887749    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ff945b9-1684-4ccb-815e-f77536b77208" containerName="main"
Sep 06 12:39:28.887935 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887842    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ff945b9-1684-4ccb-815e-f77536b77208" containerName="main"
Sep 06 12:39:28.887935 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.887857    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a9b2b21-bb8b-485d-9583-2f8b756f00f8" containerName="maas-api"
Sep 06 12:39:28.891229 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.891209    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:28.893898 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.893874    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qfdls\""
Sep 06 12:39:28.895806 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.895787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7757-e3a300"]
Sep 06 12:39:28.901396 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:28.901376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82mfw\" (UniqueName: \"kubernetes.io/projected/97b3f87e-f398-48a9-a999-b41b46430c0e-kube-api-access-82mfw\") pod \"mt-curl-7757-e3a300\" (UID: \"97b3f87e-f398-48a9-a999-b41b46430c0e\") " pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:29.002663 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:29.002634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82mfw\" (UniqueName: \"kubernetes.io/projected/97b3f87e-f398-48a9-a999-b41b46430c0e-kube-api-access-82mfw\") pod \"mt-curl-7757-e3a300\" (UID: \"97b3f87e-f398-48a9-a999-b41b46430c0e\") " pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:29.010939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:29.010908    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82mfw\" (UniqueName: \"kubernetes.io/projected/97b3f87e-f398-48a9-a999-b41b46430c0e-kube-api-access-82mfw\") pod \"mt-curl-7757-e3a300\" (UID: \"97b3f87e-f398-48a9-a999-b41b46430c0e\") " pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:29.202045 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:29.202019    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:29.474190 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:29.474164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7757-e3a300"]
Sep 06 12:39:29.475619 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:39:29.475576    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97b3f87e_f398_48a9_a999_b41b46430c0e.slice/crio-575480f20cb72eb0294098b64a5657d1d966fff1f0dac3c7a387c7cb883ee6ca WatchSource:0}: Error finding container 575480f20cb72eb0294098b64a5657d1d966fff1f0dac3c7a387c7cb883ee6ca: Status 404 returned error can't find the container with id 575480f20cb72eb0294098b64a5657d1d966fff1f0dac3c7a387c7cb883ee6ca
Sep 06 12:39:29.477066 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:29.477044    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:39:30.438574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:30.438542    2578 generic.go:356] "Generic (PLEG): container finished" podID="97b3f87e-f398-48a9-a999-b41b46430c0e" containerID="5bed365732fed3c0bca2d20317a3a144e59b398ef2e28afd04e9a04575312f46" exitCode=0
Sep 06 12:39:30.439110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:30.438587    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7757-e3a300" event={"ID":"97b3f87e-f398-48a9-a999-b41b46430c0e","Type":"ContainerDied","Data":"5bed365732fed3c0bca2d20317a3a144e59b398ef2e28afd04e9a04575312f46"}
Sep 06 12:39:30.439110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:30.438635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7757-e3a300" event={"ID":"97b3f87e-f398-48a9-a999-b41b46430c0e","Type":"ContainerStarted","Data":"575480f20cb72eb0294098b64a5657d1d966fff1f0dac3c7a387c7cb883ee6ca"}
Sep 06 12:39:31.591462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.591434    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:31.622947 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.622921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7757-e3a300_97b3f87e-f398-48a9-a999-b41b46430c0e/mt-curl-7757-e3a300/0.log"
Sep 06 12:39:31.625768 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.625750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82mfw\" (UniqueName: \"kubernetes.io/projected/97b3f87e-f398-48a9-a999-b41b46430c0e-kube-api-access-82mfw\") pod \"97b3f87e-f398-48a9-a999-b41b46430c0e\" (UID: \"97b3f87e-f398-48a9-a999-b41b46430c0e\") "
Sep 06 12:39:31.627839 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.627810    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97b3f87e-f398-48a9-a999-b41b46430c0e-kube-api-access-82mfw" (OuterVolumeSpecName: "kube-api-access-82mfw") pod "97b3f87e-f398-48a9-a999-b41b46430c0e" (UID: "97b3f87e-f398-48a9-a999-b41b46430c0e"). InnerVolumeSpecName "kube-api-access-82mfw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:39:31.646112 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.646084    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7757-e3a300"]
Sep 06 12:39:31.655750 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.650974    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7757-e3a300"]
Sep 06 12:39:31.726550 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:31.726488    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82mfw\" (UniqueName: \"kubernetes.io/projected/97b3f87e-f398-48a9-a999-b41b46430c0e-kube-api-access-82mfw\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:39:32.006938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:32.006857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:39:32.452341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:32.452307    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:32.452506 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:32.452346    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="575480f20cb72eb0294098b64a5657d1d966fff1f0dac3c7a387c7cb883ee6ca"
Sep 06 12:39:32.462214 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:39:32.462189    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7757-e3a300\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="97b3f87e-f398-48a9-a999-b41b46430c0e" pod="opendatahub/mt-curl-7757-e3a300"
Sep 06 12:39:32.668218 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:32.668177    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97b3f87e-f398-48a9-a999-b41b46430c0e" path="/var/lib/kubelet/pods/97b3f87e-f398-48a9-a999-b41b46430c0e/volumes"
Sep 06 12:39:45.109426 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:45.109382    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:39:55.309822 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.309787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"]
Sep 06 12:39:55.310279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.310224    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97b3f87e-f398-48a9-a999-b41b46430c0e" containerName="mt-curl-7757-e3a300"
Sep 06 12:39:55.310279 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.310238    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="97b3f87e-f398-48a9-a999-b41b46430c0e" containerName="mt-curl-7757-e3a300"
Sep 06 12:39:55.310358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.310309    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="97b3f87e-f398-48a9-a999-b41b46430c0e" containerName="mt-curl-7757-e3a300"
Sep 06 12:39:55.314879 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.314859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.317491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.317467    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-a898e1-serving-cert\""
Sep 06 12:39:55.324095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.324071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"]
Sep 06 12:39:55.430713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.430680    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-metrics-certs\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.430995 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.430966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt7qh\" (UniqueName: \"kubernetes.io/projected/fabc67a7-b436-45e1-9e09-d24ca614121a-kube-api-access-dt7qh\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.431139 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.431043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabc67a7-b436-45e1-9e09-d24ca614121a-openshift-service-ca\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.431139 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.431105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.532513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.532479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.532672 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.532526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-metrics-certs\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.532672 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.532559    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt7qh\" (UniqueName: \"kubernetes.io/projected/fabc67a7-b436-45e1-9e09-d24ca614121a-kube-api-access-dt7qh\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.532672 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.532593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabc67a7-b436-45e1-9e09-d24ca614121a-openshift-service-ca\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.532672 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:39:55.532623    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-serving-cert: secret "maas-api-e2e-api-a-a898e1-serving-cert" not found
Sep 06 12:39:55.532835 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:39:55.532712    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls podName:fabc67a7-b436-45e1-9e09-d24ca614121a nodeName:}" failed. No retries permitted until 2026-09-06 12:39:56.032696914 +0000 UTC m=+1337.846120972 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls") pod "maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" (UID: "fabc67a7-b436-45e1-9e09-d24ca614121a") : secret "maas-api-e2e-api-a-a898e1-serving-cert" not found
Sep 06 12:39:55.533247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.533231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabc67a7-b436-45e1-9e09-d24ca614121a-openshift-service-ca\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.535045 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.535020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-metrics-certs\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:55.541545 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:55.541524    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt7qh\" (UniqueName: \"kubernetes.io/projected/fabc67a7-b436-45e1-9e09-d24ca614121a-kube-api-access-dt7qh\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:56.038078 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:56.038041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:56.040486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:56.040455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls\") pod \"maas-api-e2e-api-a-a898e1-99444c5b4-ggs76\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:56.228326 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:56.228296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:56.506087 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:56.506055    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"]
Sep 06 12:39:56.507578 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:39:56.507554    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabc67a7_b436_45e1_9e09_d24ca614121a.slice/crio-b171ebe6c0a3362f4ccef113a6a9c46845d7fcbec10a633df61331a29568860b WatchSource:0}: Error finding container b171ebe6c0a3362f4ccef113a6a9c46845d7fcbec10a633df61331a29568860b: Status 404 returned error can't find the container with id b171ebe6c0a3362f4ccef113a6a9c46845d7fcbec10a633df61331a29568860b
Sep 06 12:39:56.601190 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:56.601105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" event={"ID":"fabc67a7-b436-45e1-9e09-d24ca614121a","Type":"ContainerStarted","Data":"b171ebe6c0a3362f4ccef113a6a9c46845d7fcbec10a633df61331a29568860b"}
Sep 06 12:39:57.608819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:57.608781    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" event={"ID":"fabc67a7-b436-45e1-9e09-d24ca614121a","Type":"ContainerStarted","Data":"aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5"}
Sep 06 12:39:57.609274 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:57.608866    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:39:57.625879 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:39:57.625832    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" podStartSLOduration=2.226767858 podStartE2EDuration="2.625817042s" totalImagesPullingTime="399.049184ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:39:57.623916609 +0000 UTC m=+1339.437340688" watchObservedRunningTime="2026-09-06 12:39:57.625817042 +0000 UTC m=+1339.439241121"
Sep 06 12:40:03.619338 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:03.619257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:40:04.234452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:04.234415    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:40:19.964467 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:19.964429    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"]
Sep 06 12:40:19.968252 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:19.968230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:19.970997 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:19.970969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-969fdf-openshift-default-dockercfg-knc4r\""
Sep 06 12:40:19.984688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:19.984667    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"]
Sep 06 12:40:20.057765 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.057732    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-certs\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.057924 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.057802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-envoy\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.057924 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.057823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh54w\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-kube-api-access-jh54w\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.057924 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.057845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-token\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.057924 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.057873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3345b9-cc3d-4925-8794-03e0ad854755-istiod-ca-cert\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.058177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.057966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-credential-socket\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.058177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.058012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-socket\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.058177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.058053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-data\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.058177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.058094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-podinfo\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3345b9-cc3d-4925-8794-03e0ad854755-istiod-ca-cert\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-credential-socket\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-socket\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-data\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-podinfo\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159295 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-certs\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-envoy\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh54w\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-kube-api-access-jh54w\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-token\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159725 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-credential-socket\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159794 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159728    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-data\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159846 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159823    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-certs\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.159936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.159917    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-socket\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.160070 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.160049    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3345b9-cc3d-4925-8794-03e0ad854755-istiod-ca-cert\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.161619 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.161588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-envoy\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.161858 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.161838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-podinfo\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.168563 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.168534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh54w\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-kube-api-access-jh54w\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.168660 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.168583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-token\") pod \"e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") " pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.278726 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.278659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:20.571185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.571117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"]
Sep 06 12:40:20.571415 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:40:20.571389    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a3345b9_cc3d_4925_8794_03e0ad854755.slice/crio-e5004847e46b64c1a7bde92626067841f9592123a1bca6de337d49337da127c4 WatchSource:0}: Error finding container e5004847e46b64c1a7bde92626067841f9592123a1bca6de337d49337da127c4: Status 404 returned error can't find the container with id e5004847e46b64c1a7bde92626067841f9592123a1bca6de337d49337da127c4
Sep 06 12:40:20.573801 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.573767    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:40:20.573921 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.573842    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:40:20.573921 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.573885    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:40:20.752412 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.752307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" event={"ID":"1a3345b9-cc3d-4925-8794-03e0ad854755","Type":"ContainerStarted","Data":"531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"}
Sep 06 12:40:20.752412 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.752372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" event={"ID":"1a3345b9-cc3d-4925-8794-03e0ad854755","Type":"ContainerStarted","Data":"e5004847e46b64c1a7bde92626067841f9592123a1bca6de337d49337da127c4"}
Sep 06 12:40:20.778292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:20.778239    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podStartSLOduration=1.778225855 podStartE2EDuration="1.778225855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:40:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:40:20.776966462 +0000 UTC m=+1362.590390539" watchObservedRunningTime="2026-09-06 12:40:20.778225855 +0000 UTC m=+1362.591649928"
Sep 06 12:40:21.279220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:21.279183    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:21.283676 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:21.283652    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:21.758962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:21.758930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:21.760052 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:21.760026    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:23.969608 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.969574    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"]
Sep 06 12:40:23.973613 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.973592    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:23.976629 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.976608    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-969fdf-serving-cert\""
Sep 06 12:40:23.989501 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.989481    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"]
Sep 06 12:40:23.993230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.993200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-metrics-certs\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:23.993351 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.993256    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-openshift-service-ca\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:23.993351 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.993295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mllwx\" (UniqueName: \"kubernetes.io/projected/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-kube-api-access-mllwx\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:23.993481 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:23.993423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.094500 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.094467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-metrics-certs\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.094655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.094508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-openshift-service-ca\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.094655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.094528    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mllwx\" (UniqueName: \"kubernetes.io/projected/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-kube-api-access-mllwx\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.094655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.094600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.094781 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:40:24.094694    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-serving-cert: secret "maas-api-e2e-api-b-969fdf-serving-cert" not found
Sep 06 12:40:24.094781 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:40:24.094754    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls podName:1f6e8efa-a150-4380-a7ea-cdadbe8a165d nodeName:}" failed. No retries permitted until 2026-09-06 12:40:24.59473774 +0000 UTC m=+1366.408161798 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls") pod "maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" (UID: "1f6e8efa-a150-4380-a7ea-cdadbe8a165d") : secret "maas-api-e2e-api-b-969fdf-serving-cert" not found
Sep 06 12:40:24.095284 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.095260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-openshift-service-ca\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.096941 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.096919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-metrics-certs\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.103799 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.103778    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mllwx\" (UniqueName: \"kubernetes.io/projected/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-kube-api-access-mllwx\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.600353 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.600319    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.602751 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.602727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls\") pod \"maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:24.887388 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:24.887294    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:25.168954 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:25.168925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"]
Sep 06 12:40:25.169388 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:40:25.169117    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6e8efa_a150_4380_a7ea_cdadbe8a165d.slice/crio-891c098fa1f0c81d8dc0b0b76cadbc13b2879dc404f52c42837fad7de9703bcb WatchSource:0}: Error finding container 891c098fa1f0c81d8dc0b0b76cadbc13b2879dc404f52c42837fad7de9703bcb: Status 404 returned error can't find the container with id 891c098fa1f0c81d8dc0b0b76cadbc13b2879dc404f52c42837fad7de9703bcb
Sep 06 12:40:25.784574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:25.784488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" event={"ID":"1f6e8efa-a150-4380-a7ea-cdadbe8a165d","Type":"ContainerStarted","Data":"e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d"}
Sep 06 12:40:25.784712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:25.784613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:25.784712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:25.784636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" event={"ID":"1f6e8efa-a150-4380-a7ea-cdadbe8a165d","Type":"ContainerStarted","Data":"891c098fa1f0c81d8dc0b0b76cadbc13b2879dc404f52c42837fad7de9703bcb"}
Sep 06 12:40:25.804315 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:25.804268    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" podStartSLOduration=2.511569169 podStartE2EDuration="2.8042522s" totalImagesPullingTime="292.683031ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:40:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:40:25.80260636 +0000 UTC m=+1367.616030438" watchObservedRunningTime="2026-09-06 12:40:25.8042522 +0000 UTC m=+1367.617676315"
Sep 06 12:40:27.141347 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:27.141311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:40:31.795518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:31.795484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:40:39.032107 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:39.032074    2578 scope.go:117] "RemoveContainer" containerID="00b2d72455dbd2ab2341cdec7f298969c433a8b063c6a1c1a4999b738273da36"
Sep 06 12:40:39.040842 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:39.040820    2578 scope.go:117] "RemoveContainer" containerID="d0ce4320893ad933ce25dcde8ccc93dd2dee682c23f684527e6d091f6da557ee"
Sep 06 12:40:43.411443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:43.411410    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:40:44.921732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:44.921638    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerID="531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799" exitCode=0
Sep 06 12:40:44.921732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:44.921710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" event={"ID":"1a3345b9-cc3d-4925-8794-03e0ad854755","Type":"ContainerDied","Data":"531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"}
Sep 06 12:40:44.922223 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:44.922060    2578 scope.go:117] "RemoveContainer" containerID="531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"
Sep 06 12:40:44.923132 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:44.923106    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:40:44.923204 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:44.923190    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:40:44.923243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:44.923222    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:40:45.929833 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:45.929799    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" event={"ID":"1a3345b9-cc3d-4925-8794-03e0ad854755","Type":"ContainerStarted","Data":"471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206"}
Sep 06 12:40:46.279763 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:46.279727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:46.279972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:46.279899    2578 patch_prober.go:28] interesting pod/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Sep 06 12:40:46.279972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:46.279953    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Sep 06 12:40:47.279452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:47.279411    2578 patch_prober.go:28] interesting pod/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Sep 06 12:40:47.279956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:47.279486    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Sep 06 12:40:48.279256 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:48.279218    2578 patch_prober.go:28] interesting pod/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Sep 06 12:40:48.279551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:48.279279    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Sep 06 12:40:49.279407 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:49.279369    2578 patch_prober.go:28] interesting pod/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Sep 06 12:40:49.279712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:49.279673    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Sep 06 12:40:50.279667 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:50.279624    2578 patch_prober.go:28] interesting pod/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused" start-of-body=
Sep 06 12:40:50.279846 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:50.279695    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.89:15021/healthz/ready\": dial tcp 10.132.0.89:15021: connect: connection refused"
Sep 06 12:40:51.283119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:51.283091    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:51.283510 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:51.283460    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:40:51.284182 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:40:51.284137    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:41:00.426185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:00.426142    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:41:03.156899 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.156866    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7757-99b3cd"]
Sep 06 12:41:03.162468 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.162443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:03.164952 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.164925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-qfdls\""
Sep 06 12:41:03.165913 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.165890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7757-99b3cd"]
Sep 06 12:41:03.268738 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.268714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2hg6\" (UniqueName: \"kubernetes.io/projected/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b-kube-api-access-n2hg6\") pod \"mt-curl-7757-99b3cd\" (UID: \"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b\") " pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:03.369441 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.369416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2hg6\" (UniqueName: \"kubernetes.io/projected/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b-kube-api-access-n2hg6\") pod \"mt-curl-7757-99b3cd\" (UID: \"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b\") " pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:03.377976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.377945    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2hg6\" (UniqueName: \"kubernetes.io/projected/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b-kube-api-access-n2hg6\") pod \"mt-curl-7757-99b3cd\" (UID: \"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b\") " pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:03.474216 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.474193    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:03.746610 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:03.746582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7757-99b3cd"]
Sep 06 12:41:03.747130 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:41:03.747105    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod88c2b86f_4ba9_4f89_82b3_fb4b333eae8b.slice/crio-1e21b8fbcc828225a0db4d1a2824705dba4b401a796cd99c5befb83fcbee368e WatchSource:0}: Error finding container 1e21b8fbcc828225a0db4d1a2824705dba4b401a796cd99c5befb83fcbee368e: Status 404 returned error can't find the container with id 1e21b8fbcc828225a0db4d1a2824705dba4b401a796cd99c5befb83fcbee368e
Sep 06 12:41:04.045046 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:04.045019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7757-99b3cd" event={"ID":"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b","Type":"ContainerStarted","Data":"1e21b8fbcc828225a0db4d1a2824705dba4b401a796cd99c5befb83fcbee368e"}
Sep 06 12:41:05.053696 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:05.053661    2578 generic.go:356] "Generic (PLEG): container finished" podID="88c2b86f-4ba9-4f89-82b3-fb4b333eae8b" containerID="ca0d789b0da5ee7895c86ab49eb95a9bbffbac1b6b98c74a7bff7b7d48d4bc66" exitCode=0
Sep 06 12:41:05.054059 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:05.053745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7757-99b3cd" event={"ID":"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b","Type":"ContainerDied","Data":"ca0d789b0da5ee7895c86ab49eb95a9bbffbac1b6b98c74a7bff7b7d48d4bc66"}
Sep 06 12:41:05.992594 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:05.992555    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"]
Sep 06 12:41:05.992883 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:05.992851    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" podUID="fabc67a7-b436-45e1-9e09-d24ca614121a" containerName="maas-api" containerID="cri-o://aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5" gracePeriod=30
Sep 06 12:41:06.216340 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.216274    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:06.251195 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.251134    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7757-99b3cd_88c2b86f-4ba9-4f89-82b3-fb4b333eae8b/mt-curl-7757-99b3cd/0.log"
Sep 06 12:41:06.274451 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.274419    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:41:06.276932 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.276901    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7757-99b3cd"]
Sep 06 12:41:06.281899 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.281878    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7757-99b3cd"]
Sep 06 12:41:06.298671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.298643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt7qh\" (UniqueName: \"kubernetes.io/projected/fabc67a7-b436-45e1-9e09-d24ca614121a-kube-api-access-dt7qh\") pod \"fabc67a7-b436-45e1-9e09-d24ca614121a\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") "
Sep 06 12:41:06.298814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.298711    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls\") pod \"fabc67a7-b436-45e1-9e09-d24ca614121a\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") "
Sep 06 12:41:06.298814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.298737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n2hg6\" (UniqueName: \"kubernetes.io/projected/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b-kube-api-access-n2hg6\") pod \"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b\" (UID: \"88c2b86f-4ba9-4f89-82b3-fb4b333eae8b\") "
Sep 06 12:41:06.298814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.298788    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-metrics-certs\") pod \"fabc67a7-b436-45e1-9e09-d24ca614121a\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") "
Sep 06 12:41:06.299103 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.298890    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabc67a7-b436-45e1-9e09-d24ca614121a-openshift-service-ca\") pod \"fabc67a7-b436-45e1-9e09-d24ca614121a\" (UID: \"fabc67a7-b436-45e1-9e09-d24ca614121a\") "
Sep 06 12:41:06.300052 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.300019    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fabc67a7-b436-45e1-9e09-d24ca614121a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fabc67a7-b436-45e1-9e09-d24ca614121a" (UID: "fabc67a7-b436-45e1-9e09-d24ca614121a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:06.304655 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.304629    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b-kube-api-access-n2hg6" (OuterVolumeSpecName: "kube-api-access-n2hg6") pod "88c2b86f-4ba9-4f89-82b3-fb4b333eae8b" (UID: "88c2b86f-4ba9-4f89-82b3-fb4b333eae8b"). InnerVolumeSpecName "kube-api-access-n2hg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:06.304763 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.304728    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fabc67a7-b436-45e1-9e09-d24ca614121a" (UID: "fabc67a7-b436-45e1-9e09-d24ca614121a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:06.304829 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.304772    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fabc67a7-b436-45e1-9e09-d24ca614121a" (UID: "fabc67a7-b436-45e1-9e09-d24ca614121a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:06.306535 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.306512    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabc67a7-b436-45e1-9e09-d24ca614121a-kube-api-access-dt7qh" (OuterVolumeSpecName: "kube-api-access-dt7qh") pod "fabc67a7-b436-45e1-9e09-d24ca614121a" (UID: "fabc67a7-b436-45e1-9e09-d24ca614121a"). InnerVolumeSpecName "kube-api-access-dt7qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:06.392623 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.392585    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7757-77ce7b"]
Sep 06 12:41:06.393077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.393058    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabc67a7-b436-45e1-9e09-d24ca614121a" containerName="maas-api"
Sep 06 12:41:06.393188 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.393080    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabc67a7-b436-45e1-9e09-d24ca614121a" containerName="maas-api"
Sep 06 12:41:06.393188 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.393098    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c2b86f-4ba9-4f89-82b3-fb4b333eae8b" containerName="mt-curl-7757-99b3cd"
Sep 06 12:41:06.393188 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.393106    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c2b86f-4ba9-4f89-82b3-fb4b333eae8b" containerName="mt-curl-7757-99b3cd"
Sep 06 12:41:06.393349 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.393278    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="88c2b86f-4ba9-4f89-82b3-fb4b333eae8b" containerName="mt-curl-7757-99b3cd"
Sep 06 12:41:06.393349 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.393297    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabc67a7-b436-45e1-9e09-d24ca614121a" containerName="maas-api"
Sep 06 12:41:06.397235 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.397013    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:06.400462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.400438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q4cf\" (UniqueName: \"kubernetes.io/projected/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca-kube-api-access-9q4cf\") pod \"mt-curl-7757-77ce7b\" (UID: \"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca\") " pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:06.400599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.400546    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fabc67a7-b436-45e1-9e09-d24ca614121a-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:06.400599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.400565    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt7qh\" (UniqueName: \"kubernetes.io/projected/fabc67a7-b436-45e1-9e09-d24ca614121a-kube-api-access-dt7qh\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:06.400599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.400579    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:06.400599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.400591    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n2hg6\" (UniqueName: \"kubernetes.io/projected/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b-kube-api-access-n2hg6\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:06.400797 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.400604    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fabc67a7-b436-45e1-9e09-d24ca614121a-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:06.401202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.401113    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7757-77ce7b"]
Sep 06 12:41:06.501195 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.501126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q4cf\" (UniqueName: \"kubernetes.io/projected/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca-kube-api-access-9q4cf\") pod \"mt-curl-7757-77ce7b\" (UID: \"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca\") " pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:06.508774 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.508747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q4cf\" (UniqueName: \"kubernetes.io/projected/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca-kube-api-access-9q4cf\") pod \"mt-curl-7757-77ce7b\" (UID: \"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca\") " pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:06.669372 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.669337    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c2b86f-4ba9-4f89-82b3-fb4b333eae8b" path="/var/lib/kubelet/pods/88c2b86f-4ba9-4f89-82b3-fb4b333eae8b/volumes"
Sep 06 12:41:06.709239 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.709216    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:06.983177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:06.983138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7757-77ce7b"]
Sep 06 12:41:06.984523 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:41:06.984500    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod49ea9099_df0f_45cd_b4e4_e23a0cdca1ca.slice/crio-b0bcc0f02142bca57c40f9b52101a8bbf33ebfe9a55e12049c0836d27cbb2b59 WatchSource:0}: Error finding container b0bcc0f02142bca57c40f9b52101a8bbf33ebfe9a55e12049c0836d27cbb2b59: Status 404 returned error can't find the container with id b0bcc0f02142bca57c40f9b52101a8bbf33ebfe9a55e12049c0836d27cbb2b59
Sep 06 12:41:07.072285 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.072254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7757-77ce7b" event={"ID":"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca","Type":"ContainerStarted","Data":"b0bcc0f02142bca57c40f9b52101a8bbf33ebfe9a55e12049c0836d27cbb2b59"}
Sep 06 12:41:07.073524 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.073507    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-99b3cd"
Sep 06 12:41:07.073626 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.073536    2578 scope.go:117] "RemoveContainer" containerID="ca0d789b0da5ee7895c86ab49eb95a9bbffbac1b6b98c74a7bff7b7d48d4bc66"
Sep 06 12:41:07.074962 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.074938    2578 generic.go:356] "Generic (PLEG): container finished" podID="fabc67a7-b436-45e1-9e09-d24ca614121a" containerID="aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5" exitCode=0
Sep 06 12:41:07.075066 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.074976    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"
Sep 06 12:41:07.075066 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.075026    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" event={"ID":"fabc67a7-b436-45e1-9e09-d24ca614121a","Type":"ContainerDied","Data":"aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5"}
Sep 06 12:41:07.075224 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.075091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76" event={"ID":"fabc67a7-b436-45e1-9e09-d24ca614121a","Type":"ContainerDied","Data":"b171ebe6c0a3362f4ccef113a6a9c46845d7fcbec10a633df61331a29568860b"}
Sep 06 12:41:07.083069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.083051    2578 scope.go:117] "RemoveContainer" containerID="aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5"
Sep 06 12:41:07.091085 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.091061    2578 scope.go:117] "RemoveContainer" containerID="aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5"
Sep 06 12:41:07.091508 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:07.091486    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5\": container with ID starting with aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5 not found: ID does not exist" containerID="aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5"
Sep 06 12:41:07.091622 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.091516    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5"} err="failed to get container status \"aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5\": rpc error: code = NotFound desc = could not find container \"aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5\": container with ID starting with aa399685fd927ab5d5fa36d8b8f120edd5a056af890e5529320be4ded8f355f5 not found: ID does not exist"
Sep 06 12:41:07.094080 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.094063    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"]
Sep 06 12:41:07.097902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:07.097880    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-a898e1-99444c5b4-ggs76"]
Sep 06 12:41:08.082536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:08.082503    2578 generic.go:356] "Generic (PLEG): container finished" podID="49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" containerID="7b194feccc5f6497f655aced58aca3687b8958647b0254b481dd8ffb2cb66569" exitCode=0
Sep 06 12:41:08.082929 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:08.082582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7757-77ce7b" event={"ID":"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca","Type":"ContainerDied","Data":"7b194feccc5f6497f655aced58aca3687b8958647b0254b481dd8ffb2cb66569"}
Sep 06 12:41:08.669503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:08.669469    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabc67a7-b436-45e1-9e09-d24ca614121a" path="/var/lib/kubelet/pods/fabc67a7-b436-45e1-9e09-d24ca614121a/volumes"
Sep 06 12:41:09.227036 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.227014    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:09.255309 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.255280    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7757-77ce7b_49ea9099-df0f-45cd-b4e4-e23a0cdca1ca/mt-curl-7757-77ce7b/0.log"
Sep 06 12:41:09.279380 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.279354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7757-77ce7b"]
Sep 06 12:41:09.282384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.282360    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7757-77ce7b"]
Sep 06 12:41:09.320928 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.320905    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9q4cf\" (UniqueName: \"kubernetes.io/projected/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca-kube-api-access-9q4cf\") pod \"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca\" (UID: \"49ea9099-df0f-45cd-b4e4-e23a0cdca1ca\") "
Sep 06 12:41:09.322883 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.322862    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca-kube-api-access-9q4cf" (OuterVolumeSpecName: "kube-api-access-9q4cf") pod "49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" (UID: "49ea9099-df0f-45cd-b4e4-e23a0cdca1ca"). InnerVolumeSpecName "kube-api-access-9q4cf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:09.421647 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:09.421585    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9q4cf\" (UniqueName: \"kubernetes.io/projected/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca-kube-api-access-9q4cf\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:10.097529 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:10.097502    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:10.097703 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:10.097505    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0bcc0f02142bca57c40f9b52101a8bbf33ebfe9a55e12049c0836d27cbb2b59"
Sep 06 12:41:10.107565 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:10.107529    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7757-77ce7b\" is forbidden: User \"system:node:ip-10-0-130-145.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-130-145.ec2.internal' and this object" podUID="49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" pod="opendatahub/mt-curl-7757-77ce7b"
Sep 06 12:41:10.672007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:10.671966    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" path="/var/lib/kubelet/pods/49ea9099-df0f-45cd-b4e4-e23a0cdca1ca/volumes"
Sep 06 12:41:20.916508 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:20.916473    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:41:28.868709 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:28.868672    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"]
Sep 06 12:41:28.869223 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:28.868942    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" podUID="1f6e8efa-a150-4380-a7ea-cdadbe8a165d" containerName="maas-api" containerID="cri-o://e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d" gracePeriod=30
Sep 06 12:41:29.115731 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.115708    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:41:29.198483 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.198459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-metrics-certs\") pod \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") "
Sep 06 12:41:29.198651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.198495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-openshift-service-ca\") pod \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") "
Sep 06 12:41:29.198651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.198527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls\") pod \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") "
Sep 06 12:41:29.198651 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.198591    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mllwx\" (UniqueName: \"kubernetes.io/projected/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-kube-api-access-mllwx\") pod \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\" (UID: \"1f6e8efa-a150-4380-a7ea-cdadbe8a165d\") "
Sep 06 12:41:29.198872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.198844    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1f6e8efa-a150-4380-a7ea-cdadbe8a165d" (UID: "1f6e8efa-a150-4380-a7ea-cdadbe8a165d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:29.200710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.200680    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1f6e8efa-a150-4380-a7ea-cdadbe8a165d" (UID: "1f6e8efa-a150-4380-a7ea-cdadbe8a165d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:29.200710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.200698    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1f6e8efa-a150-4380-a7ea-cdadbe8a165d" (UID: "1f6e8efa-a150-4380-a7ea-cdadbe8a165d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:29.200849 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.200829    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-kube-api-access-mllwx" (OuterVolumeSpecName: "kube-api-access-mllwx") pod "1f6e8efa-a150-4380-a7ea-cdadbe8a165d" (UID: "1f6e8efa-a150-4380-a7ea-cdadbe8a165d"). InnerVolumeSpecName "kube-api-access-mllwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:29.219442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.219416    2578 generic.go:356] "Generic (PLEG): container finished" podID="1f6e8efa-a150-4380-a7ea-cdadbe8a165d" containerID="e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d" exitCode=0
Sep 06 12:41:29.219545 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.219454    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"
Sep 06 12:41:29.219545 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.219498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" event={"ID":"1f6e8efa-a150-4380-a7ea-cdadbe8a165d","Type":"ContainerDied","Data":"e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d"}
Sep 06 12:41:29.219682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.219559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf" event={"ID":"1f6e8efa-a150-4380-a7ea-cdadbe8a165d","Type":"ContainerDied","Data":"891c098fa1f0c81d8dc0b0b76cadbc13b2879dc404f52c42837fad7de9703bcb"}
Sep 06 12:41:29.219682 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.219599    2578 scope.go:117] "RemoveContainer" containerID="e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d"
Sep 06 12:41:29.229447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.229432    2578 scope.go:117] "RemoveContainer" containerID="e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d"
Sep 06 12:41:29.229710 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:29.229689    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d\": container with ID starting with e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d not found: ID does not exist" containerID="e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d"
Sep 06 12:41:29.229757 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.229719    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d"} err="failed to get container status \"e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d\": rpc error: code = NotFound desc = could not find container \"e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d\": container with ID starting with e6367a4edf55b89c24151f4dd6cb94f4ea0d61ad636f3c4fde5532521c40d83d not found: ID does not exist"
Sep 06 12:41:29.243045 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.243024    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"]
Sep 06 12:41:29.252347 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.252321    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-969fdf-59bf64669c-rvdhf"]
Sep 06 12:41:29.299578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.299539    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mllwx\" (UniqueName: \"kubernetes.io/projected/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-kube-api-access-mllwx\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:29.299578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.299572    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:29.299776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.299595    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:29.299776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:29.299608    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1f6e8efa-a150-4380-a7ea-cdadbe8a165d-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:30.668765 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:30.668731    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6e8efa-a150-4380-a7ea-cdadbe8a165d" path="/var/lib/kubelet/pods/1f6e8efa-a150-4380-a7ea-cdadbe8a165d/volumes"
Sep 06 12:41:35.557163 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:35.557055    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"]
Sep 06 12:41:35.557590 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:35.557332    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" containerID="cri-o://471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206" gracePeriod=30
Sep 06 12:41:36.286658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:36.286623    2578 patch_prober.go:28] interesting pod/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 12:41:36.286840 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:36.286676    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 12:41:39.082485 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:39.082454    2578 scope.go:117] "RemoveContainer" containerID="c97d0d8ab0b57df957ed48537589e2a4b2b6d10bf1cf68cd50fc0237ea1f52e2"
Sep 06 12:41:40.814198 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.814173    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:41:40.897869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-token\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.897869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jh54w\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-kube-api-access-jh54w\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-certs\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897894    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-envoy\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897928    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-podinfo\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897970    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-credential-socket\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.897996    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-socket\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898359 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898079    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3345b9-cc3d-4925-8794-03e0ad854755-istiod-ca-cert\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898359 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-data\") pod \"1a3345b9-cc3d-4925-8794-03e0ad854755\" (UID: \"1a3345b9-cc3d-4925-8794-03e0ad854755\") "
Sep 06 12:41:40.898359 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898185    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:40.898359 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:40.898577 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898410    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:40.898577 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898547    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-data" (OuterVolumeSpecName: "istio-data") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:40.898677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898581    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.898677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898615    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.898677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898631    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.898795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.898715    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a3345b9-cc3d-4925-8794-03e0ad854755-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:40.900021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.899995    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-token" (OuterVolumeSpecName: "istio-token") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:40.900133 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.900102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:40.900552 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.900524    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:41:40.900552 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.900536    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-kube-api-access-jh54w" (OuterVolumeSpecName: "kube-api-access-jh54w") pod "1a3345b9-cc3d-4925-8794-03e0ad854755" (UID: "1a3345b9-cc3d-4925-8794-03e0ad854755"). InnerVolumeSpecName "kube-api-access-jh54w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:40.999058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.999033    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1a3345b9-cc3d-4925-8794-03e0ad854755-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.999058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.999059    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.999248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.999070    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.999248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.999081    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jh54w\" (UniqueName: \"kubernetes.io/projected/1a3345b9-cc3d-4925-8794-03e0ad854755-kube-api-access-jh54w\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.999248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.999092    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:40.999248 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:40.999101    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1a3345b9-cc3d-4925-8794-03e0ad854755-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:41.013533 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.013506    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:41:41.302791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.302759    2578 generic.go:356] "Generic (PLEG): container finished" podID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerID="471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206" exitCode=0
Sep 06 12:41:41.302944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.302805    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"
Sep 06 12:41:41.302944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.302843    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" event={"ID":"1a3345b9-cc3d-4925-8794-03e0ad854755","Type":"ContainerDied","Data":"471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206"}
Sep 06 12:41:41.302944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.302901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj" event={"ID":"1a3345b9-cc3d-4925-8794-03e0ad854755","Type":"ContainerDied","Data":"e5004847e46b64c1a7bde92626067841f9592123a1bca6de337d49337da127c4"}
Sep 06 12:41:41.302944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.302931    2578 scope.go:117] "RemoveContainer" containerID="471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206"
Sep 06 12:41:41.313307 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.313289    2578 scope.go:117] "RemoveContainer" containerID="531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"
Sep 06 12:41:41.321742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.321726    2578 scope.go:117] "RemoveContainer" containerID="471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206"
Sep 06 12:41:41.321996 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:41.321975    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206\": container with ID starting with 471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206 not found: ID does not exist" containerID="471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206"
Sep 06 12:41:41.322084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.322008    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206"} err="failed to get container status \"471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206\": rpc error: code = NotFound desc = could not find container \"471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206\": container with ID starting with 471c156cc87bac8c8804a9935a4dc4fd08d94767d2a3f26dbfd46321de206206 not found: ID does not exist"
Sep 06 12:41:41.322084 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.322033    2578 scope.go:117] "RemoveContainer" containerID="531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"
Sep 06 12:41:41.322333 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:41.322304    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799\": container with ID starting with 531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799 not found: ID does not exist" containerID="531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"
Sep 06 12:41:41.322402 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.322341    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799"} err="failed to get container status \"531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799\": rpc error: code = NotFound desc = could not find container \"531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799\": container with ID starting with 531d59c4f596ccfd4686878f11805d5141af0beede58747a152d57fb0297f799 not found: ID does not exist"
Sep 06 12:41:41.324987 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.324966    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"]
Sep 06 12:41:41.329159 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:41.329128    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-969fdf-openshift-default-84fc75ccdb-z9psj"]
Sep 06 12:41:42.668892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:42.668856    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" path="/var/lib/kubelet/pods/1a3345b9-cc3d-4925-8794-03e0ad854755/volumes"
Sep 06 12:41:46.632993 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:46.632963    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"]
Sep 06 12:41:46.633433 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:46.633204    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" podUID="d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" containerName="maas-api" containerID="cri-o://db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1" gracePeriod=30
Sep 06 12:41:46.891612 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:46.891538    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:41:47.055752 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.055717    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls\") pod \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") "
Sep 06 12:41:47.055936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.055772    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-openshift-service-ca\") pod \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") "
Sep 06 12:41:47.055936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.055798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mkgc\" (UniqueName: \"kubernetes.io/projected/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-kube-api-access-2mkgc\") pod \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") "
Sep 06 12:41:47.055936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.055846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-metrics-certs\") pod \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\" (UID: \"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2\") "
Sep 06 12:41:47.056338 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.056304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" (UID: "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:47.058554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.058509    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" (UID: "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:47.058554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.058523    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-kube-api-access-2mkgc" (OuterVolumeSpecName: "kube-api-access-2mkgc") pod "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" (UID: "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2"). InnerVolumeSpecName "kube-api-access-2mkgc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:47.058727 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.058553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" (UID: "d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:41:47.157488 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.157413    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mkgc\" (UniqueName: \"kubernetes.io/projected/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-kube-api-access-2mkgc\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:47.157488 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.157442    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:47.157488 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.157451    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:47.157488 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.157459    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:47.343639 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.343597    2578 generic.go:356] "Generic (PLEG): container finished" podID="d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" containerID="db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1" exitCode=0
Sep 06 12:41:47.343817 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.343652    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" event={"ID":"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2","Type":"ContainerDied","Data":"db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1"}
Sep 06 12:41:47.343817 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.343659    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"
Sep 06 12:41:47.343817 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.343741    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt" event={"ID":"d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2","Type":"ContainerDied","Data":"9c27db6452974d0c95d382b717bc5fa56adde71979e357776f7b25cbe06c04d5"}
Sep 06 12:41:47.343817 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.343771    2578 scope.go:117] "RemoveContainer" containerID="db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1"
Sep 06 12:41:47.353969 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.353950    2578 scope.go:117] "RemoveContainer" containerID="db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1"
Sep 06 12:41:47.354350 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:47.354327    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1\": container with ID starting with db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1 not found: ID does not exist" containerID="db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1"
Sep 06 12:41:47.354444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.354358    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1"} err="failed to get container status \"db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1\": rpc error: code = NotFound desc = could not find container \"db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1\": container with ID starting with db77c457ce1dbca405dbecbadba09698621e0e3e08c53f24cd8063d1786c7ac1 not found: ID does not exist"
Sep 06 12:41:47.365436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.365412    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"]
Sep 06 12:41:47.369260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:47.369238    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-d96501-7566564596-drlxt"]
Sep 06 12:41:48.668424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:48.668390    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" path="/var/lib/kubelet/pods/d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2/volumes"
Sep 06 12:41:50.915936 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:50.915901    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:41:53.119254 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:53.119218    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"]
Sep 06 12:41:53.119708 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:53.119486    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy" containerID="cri-o://b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58" gracePeriod=30
Sep 06 12:41:58.383863 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.383806    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:41:58.420067 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.420042    2578 generic.go:356] "Generic (PLEG): container finished" podID="75930363-7111-4064-9660-318de2269a0b" containerID="b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58" exitCode=0
Sep 06 12:41:58.420225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.420082    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"
Sep 06 12:41:58.420225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.420090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" event={"ID":"75930363-7111-4064-9660-318de2269a0b","Type":"ContainerDied","Data":"b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58"}
Sep 06 12:41:58.420225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.420132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls" event={"ID":"75930363-7111-4064-9660-318de2269a0b","Type":"ContainerDied","Data":"1575c26435eea6d27c943b8980c9723500e851d0340e60537e298d96578b0f56"}
Sep 06 12:41:58.420225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.420172    2578 scope.go:117] "RemoveContainer" containerID="b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58"
Sep 06 12:41:58.429432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.429411    2578 scope.go:117] "RemoveContainer" containerID="55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"
Sep 06 12:41:58.437743 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.437724    2578 scope.go:117] "RemoveContainer" containerID="b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58"
Sep 06 12:41:58.438030 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:58.438007    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58\": container with ID starting with b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58 not found: ID does not exist" containerID="b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58"
Sep 06 12:41:58.438094 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.438041    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58"} err="failed to get container status \"b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58\": rpc error: code = NotFound desc = could not find container \"b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58\": container with ID starting with b1ed3c034107361293777bede8ab3af782e5633bc4ba293d58620fd3351dae58 not found: ID does not exist"
Sep 06 12:41:58.438094 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.438066    2578 scope.go:117] "RemoveContainer" containerID="55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"
Sep 06 12:41:58.438348 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:41:58.438325    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae\": container with ID starting with 55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae not found: ID does not exist" containerID="55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"
Sep 06 12:41:58.438448 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.438352    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae"} err="failed to get container status \"55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae\": rpc error: code = NotFound desc = could not find container \"55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae\": container with ID starting with 55a4509f068fa5cd32c6737b5dda5723557057fbc87c3bf347c2cf82da541eae not found: ID does not exist"
Sep 06 12:41:58.559538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559511    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75930363-7111-4064-9660-318de2269a0b-istiod-ca-cert\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559551    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-envoy\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j5dcr\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-kube-api-access-j5dcr\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-istio-token\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559704    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-certs\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559743    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75930363-7111-4064-9660-318de2269a0b-istio-podinfo\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559797    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-socket\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559832    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-credential-socket\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.559871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559863    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-data\") pod \"75930363-7111-4064-9660-318de2269a0b\" (UID: \"75930363-7111-4064-9660-318de2269a0b\") "
Sep 06 12:41:58.560138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.559932    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/75930363-7111-4064-9660-318de2269a0b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:41:58.560138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.560119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-data" (OuterVolumeSpecName: "istio-data") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:58.560373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.560315    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.560373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.560332    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:58.560373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.560340    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/75930363-7111-4064-9660-318de2269a0b-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.560645 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.560511    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:58.560645 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.560542    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:58.562422 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.562397    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:41:58.562536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.562445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/75930363-7111-4064-9660-318de2269a0b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:41:58.562536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.562460    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-kube-api-access-j5dcr" (OuterVolumeSpecName: "kube-api-access-j5dcr") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "kube-api-access-j5dcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:58.562536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.562530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-istio-token" (OuterVolumeSpecName: "istio-token") pod "75930363-7111-4064-9660-318de2269a0b" (UID: "75930363-7111-4064-9660-318de2269a0b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.660990    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.661010    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.661020    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.661028    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j5dcr\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-kube-api-access-j5dcr\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.661036    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/75930363-7111-4064-9660-318de2269a0b-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.661044    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/75930363-7111-4064-9660-318de2269a0b-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.661051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.661051    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/75930363-7111-4064-9660-318de2269a0b-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:41:58.737696 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.737669    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"]
Sep 06 12:41:58.741473 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:41:58.741451    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-d96501-openshift-default-59c7db4b64-995ls"]
Sep 06 12:42:00.668933 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:00.668898    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75930363-7111-4064-9660-318de2269a0b" path="/var/lib/kubelet/pods/75930363-7111-4064-9660-318de2269a0b/volumes"
Sep 06 12:42:02.513572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.513534    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"]
Sep 06 12:42:02.514139 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514120    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy"
Sep 06 12:42:02.514139 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514142    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514175    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514186    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514200    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" containerName="maas-api"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514209    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" containerName="maas-api"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514240    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6e8efa-a150-4380-a7ea-cdadbe8a165d" containerName="maas-api"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514249    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6e8efa-a150-4380-a7ea-cdadbe8a165d" containerName="maas-api"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514261    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" containerName="mt-curl-7757-77ce7b"
Sep 06 12:42:02.514336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514270    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" containerName="mt-curl-7757-77ce7b"
Sep 06 12:42:02.514748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514376    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ea9099-df0f-45cd-b4e4-e23a0cdca1ca" containerName="mt-curl-7757-77ce7b"
Sep 06 12:42:02.514748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514389    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy"
Sep 06 12:42:02.514748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514397    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy"
Sep 06 12:42:02.514748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514409    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0ee7dcd-c5e6-4137-b1ae-c5773743d2b2" containerName="maas-api"
Sep 06 12:42:02.514748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.514419    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6e8efa-a150-4380-a7ea-cdadbe8a165d" containerName="maas-api"
Sep 06 12:42:02.519194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.519174    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.522986 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.522962    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"kube-root-ca.crt\""
Sep 06 12:42:02.523138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.523115    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"rate-test-model-e6515e-kserve-self-signed-certs\""
Sep 06 12:42:02.523370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.523060    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"default-dockercfg-hxkj9\""
Sep 06 12:42:02.523464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.523004    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-w3-e6515e\"/\"openshift-service-ca.crt\""
Sep 06 12:42:02.523678 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.523657    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"]
Sep 06 12:42:02.689551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.689519    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-home\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.689551 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.689549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fed8347-18f8-4859-ba78-01d11fac608f-tls-certs\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.689779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.689591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45f7r\" (UniqueName: \"kubernetes.io/projected/5fed8347-18f8-4859-ba78-01d11fac608f-kube-api-access-45f7r\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.689779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.689678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-dshm\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.689779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.689716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-tmp-dir\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.689779 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.689750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-model-cache\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-home\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fed8347-18f8-4859-ba78-01d11fac608f-tls-certs\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45f7r\" (UniqueName: \"kubernetes.io/projected/5fed8347-18f8-4859-ba78-01d11fac608f-kube-api-access-45f7r\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-dshm\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-tmp-dir\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-model-cache\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790862 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790803    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-home\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.790951 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790932    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-tmp-dir\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.791007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.790963    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-model-cache\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.792720 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.792698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-dshm\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.792998 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.792982    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fed8347-18f8-4859-ba78-01d11fac608f-tls-certs\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.797819 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.797796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45f7r\" (UniqueName: \"kubernetes.io/projected/5fed8347-18f8-4859-ba78-01d11fac608f-kube-api-access-45f7r\") pod \"rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") " pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:02.831737 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:02.831709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:03.106177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:03.106134    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"]
Sep 06 12:42:03.107479 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:42:03.107452    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5fed8347_18f8_4859_ba78_01d11fac608f.slice/crio-1396d1fa0b70077b2ef19d65d74edbcab547ea18ad70eaee26c4a57c9610662f WatchSource:0}: Error finding container 1396d1fa0b70077b2ef19d65d74edbcab547ea18ad70eaee26c4a57c9610662f: Status 404 returned error can't find the container with id 1396d1fa0b70077b2ef19d65d74edbcab547ea18ad70eaee26c4a57c9610662f
Sep 06 12:42:03.452074 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:03.452037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7" event={"ID":"5fed8347-18f8-4859-ba78-01d11fac608f","Type":"ContainerStarted","Data":"dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584"}
Sep 06 12:42:03.452268 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:03.452086    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7" event={"ID":"5fed8347-18f8-4859-ba78-01d11fac608f","Type":"ContainerStarted","Data":"1396d1fa0b70077b2ef19d65d74edbcab547ea18ad70eaee26c4a57c9610662f"}
Sep 06 12:42:03.468872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:03.468831    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7" podStartSLOduration=1.468817216 podStartE2EDuration="1.468817216s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:42:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:42:03.467882949 +0000 UTC m=+1465.281307050" watchObservedRunningTime="2026-09-06 12:42:03.468817216 +0000 UTC m=+1465.282241295"
Sep 06 12:42:03.916398 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:03.916317    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"]
Sep 06 12:42:03.916848 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:03.916526    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" podUID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" containerName="maas-api" containerID="cri-o://056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5" gracePeriod=30
Sep 06 12:42:04.072447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.072400    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" podUID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" containerName="maas-api" probeResult="failure" output="Get \"https://10.132.0.79:8443/health\": dial tcp 10.132.0.79:8443: connect: connection refused"
Sep 06 12:42:04.198261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.198221    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:42:04.203098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.203075    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a16b53e-1ed4-4498-a19d-a60dc26d8421-openshift-service-ca\") pod \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") "
Sep 06 12:42:04.203242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.203108    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls\") pod \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") "
Sep 06 12:42:04.203242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.203181    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-metrics-certs\") pod \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") "
Sep 06 12:42:04.203242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.203216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhtqz\" (UniqueName: \"kubernetes.io/projected/0a16b53e-1ed4-4498-a19d-a60dc26d8421-kube-api-access-fhtqz\") pod \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\" (UID: \"0a16b53e-1ed4-4498-a19d-a60dc26d8421\") "
Sep 06 12:42:04.203674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.203640    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a16b53e-1ed4-4498-a19d-a60dc26d8421-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a16b53e-1ed4-4498-a19d-a60dc26d8421" (UID: "0a16b53e-1ed4-4498-a19d-a60dc26d8421"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:42:04.205299 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.205273    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a16b53e-1ed4-4498-a19d-a60dc26d8421" (UID: "0a16b53e-1ed4-4498-a19d-a60dc26d8421"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:42:04.205419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.205333    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0a16b53e-1ed4-4498-a19d-a60dc26d8421" (UID: "0a16b53e-1ed4-4498-a19d-a60dc26d8421"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:42:04.205419 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.205359    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a16b53e-1ed4-4498-a19d-a60dc26d8421-kube-api-access-fhtqz" (OuterVolumeSpecName: "kube-api-access-fhtqz") pod "0a16b53e-1ed4-4498-a19d-a60dc26d8421" (UID: "0a16b53e-1ed4-4498-a19d-a60dc26d8421"). InnerVolumeSpecName "kube-api-access-fhtqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:42:04.304356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.304325    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:42:04.304356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.304353    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhtqz\" (UniqueName: \"kubernetes.io/projected/0a16b53e-1ed4-4498-a19d-a60dc26d8421-kube-api-access-fhtqz\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:42:04.304356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.304364    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a16b53e-1ed4-4498-a19d-a60dc26d8421-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:42:04.304578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.304372    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a16b53e-1ed4-4498-a19d-a60dc26d8421-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:42:04.461571 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.461542    2578 generic.go:356] "Generic (PLEG): container finished" podID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" containerID="056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5" exitCode=0
Sep 06 12:42:04.461728 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.461594    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"
Sep 06 12:42:04.461728 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.461650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" event={"ID":"0a16b53e-1ed4-4498-a19d-a60dc26d8421","Type":"ContainerDied","Data":"056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5"}
Sep 06 12:42:04.461816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.461731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89" event={"ID":"0a16b53e-1ed4-4498-a19d-a60dc26d8421","Type":"ContainerDied","Data":"2ca7e90b18fe292f4e592fc28457d07bbfacbbf3f59914725292a71b4407c2be"}
Sep 06 12:42:04.461816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.461766    2578 scope.go:117] "RemoveContainer" containerID="056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5"
Sep 06 12:42:04.475202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.475183    2578 scope.go:117] "RemoveContainer" containerID="056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5"
Sep 06 12:42:04.475496 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:42:04.475478    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5\": container with ID starting with 056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5 not found: ID does not exist" containerID="056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5"
Sep 06 12:42:04.475556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.475505    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5"} err="failed to get container status \"056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5\": rpc error: code = NotFound desc = could not find container \"056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5\": container with ID starting with 056d4a15eae7cbc644625965f31f78bc5b3998fb24ecf4337261f12b8dd367f5 not found: ID does not exist"
Sep 06 12:42:04.488231 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.488207    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"]
Sep 06 12:42:04.490600 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.490580    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-556bc6-5c58cd7777-4zp89"]
Sep 06 12:42:04.669089 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:04.669060    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" path="/var/lib/kubelet/pods/0a16b53e-1ed4-4498-a19d-a60dc26d8421/volumes"
Sep 06 12:42:08.412470 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:08.412435    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:42:12.832281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:12.832246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:12.832736 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:12.832301    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:12.844606 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:12.844586    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:13.526991 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:13.526965    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:42:38.823679 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:38.823648    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:42:38.827271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:38.827247    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:42:39.115705 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:39.115630    2578 scope.go:117] "RemoveContainer" containerID="05d50adc081149b25791229bfc12014ff898e173802a44b6b6a025559353fd70"
Sep 06 12:42:39.124091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:39.124066    2578 scope.go:117] "RemoveContainer" containerID="f57eaabb0380640c8dd1de80ca8f924eeb31d13c592217b53df1eb76d2020179"
Sep 06 12:42:39.131673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:39.131656    2578 scope.go:117] "RemoveContainer" containerID="ed5c89750940662a75cda52891c1cf4f33234f9a458b7b2bf5a7696773ce371b"
Sep 06 12:42:44.819033 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:44.818999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:42:54.407476 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:42:54.407439    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:43:02.143371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.143282    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"]
Sep 06 12:43:02.878508 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.878473    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"]
Sep 06 12:43:02.879007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.878987    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy"
Sep 06 12:43:02.879007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879006    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy"
Sep 06 12:43:02.879140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879021    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy"
Sep 06 12:43:02.879140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879028    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy"
Sep 06 12:43:02.879140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879039    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" containerName="maas-api"
Sep 06 12:43:02.879140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879044    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" containerName="maas-api"
Sep 06 12:43:02.879140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879122    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="75930363-7111-4064-9660-318de2269a0b" containerName="istio-proxy"
Sep 06 12:43:02.879140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879133    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a3345b9-cc3d-4925-8794-03e0ad854755" containerName="istio-proxy"
Sep 06 12:43:02.879358 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.879158    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a16b53e-1ed4-4498-a19d-a60dc26d8421" containerName="maas-api"
Sep 06 12:43:02.883791 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.883773    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.887166 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.887136    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-4f1951-openshift-default-dockercfg-fr69j\""
Sep 06 12:43:02.897616 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.897591    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"]
Sep 06 12:43:02.981553 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-credential-socket\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85db5ab0-987a-4850-bd1a-361d2989578d-istio-podinfo\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-istio-token\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85db5ab0-987a-4850-bd1a-361d2989578d-istiod-ca-cert\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981704 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981671    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-envoy\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdf9c\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-kube-api-access-cdf9c\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-data\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-certs\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:02.981870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:02.981843    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-socket\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.082663 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-credential-socket\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.082803 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082669    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85db5ab0-987a-4850-bd1a-361d2989578d-istio-podinfo\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.082803 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-istio-token\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.082803 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85db5ab0-987a-4850-bd1a-361d2989578d-istiod-ca-cert\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.082803 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-envoy\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.082803 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdf9c\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-kube-api-access-cdf9c\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-data\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.082984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-certs\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.083069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-socket\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083213 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.083068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-credential-socket\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083309 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.083213    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-data\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083361 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.083339    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-certs\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083399 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.083387    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-socket\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.083480 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.083464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85db5ab0-987a-4850-bd1a-361d2989578d-istiod-ca-cert\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.085590 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.085559    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-envoy\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.085747 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.085731    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85db5ab0-987a-4850-bd1a-361d2989578d-istio-podinfo\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.091677 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.091654    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-istio-token\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.091913 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.091895    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdf9c\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-kube-api-access-cdf9c\") pod \"e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") " pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.193591 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.193570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:03.476815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.476778    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"]
Sep 06 12:43:03.477687 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:43:03.477654    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85db5ab0_987a_4850_bd1a_361d2989578d.slice/crio-5edecd80e01f88d16a5e38bad39604ec15ec82b9e88805929fb6dd14846e52fb WatchSource:0}: Error finding container 5edecd80e01f88d16a5e38bad39604ec15ec82b9e88805929fb6dd14846e52fb: Status 404 returned error can't find the container with id 5edecd80e01f88d16a5e38bad39604ec15ec82b9e88805929fb6dd14846e52fb
Sep 06 12:43:03.480118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.480077    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:03.480202 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.480186    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:03.480265 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.480248    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:03.817748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.817660    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" event={"ID":"85db5ab0-987a-4850-bd1a-361d2989578d","Type":"ContainerStarted","Data":"dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"}
Sep 06 12:43:03.817748 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.817720    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" event={"ID":"85db5ab0-987a-4850-bd1a-361d2989578d","Type":"ContainerStarted","Data":"5edecd80e01f88d16a5e38bad39604ec15ec82b9e88805929fb6dd14846e52fb"}
Sep 06 12:43:03.842502 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:03.842456    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podStartSLOduration=1.842441529 podStartE2EDuration="1.842441529s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:43:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:43:03.840626889 +0000 UTC m=+1525.654050968" watchObservedRunningTime="2026-09-06 12:43:03.842441529 +0000 UTC m=+1525.655865608"
Sep 06 12:43:04.193777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:04.193745    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:04.198624 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:04.198597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:04.816792 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:04.816755    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:43:04.824444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:04.824413    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:04.825220 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:04.825203    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:17.171784 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.171714    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7" podUID="5fed8347-18f8-4859-ba78-01d11fac608f" containerName="main" containerID="cri-o://dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584" gracePeriod=45
Sep 06 12:43:17.437959 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.437940    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:43:17.514183 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514141    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-model-cache\") pod \"5fed8347-18f8-4859-ba78-01d11fac608f\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") "
Sep 06 12:43:17.514355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514194    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-dshm\") pod \"5fed8347-18f8-4859-ba78-01d11fac608f\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") "
Sep 06 12:43:17.514355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514212    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-tmp-dir\") pod \"5fed8347-18f8-4859-ba78-01d11fac608f\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") "
Sep 06 12:43:17.514355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514291    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fed8347-18f8-4859-ba78-01d11fac608f-tls-certs\") pod \"5fed8347-18f8-4859-ba78-01d11fac608f\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") "
Sep 06 12:43:17.514355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-home\") pod \"5fed8347-18f8-4859-ba78-01d11fac608f\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") "
Sep 06 12:43:17.514584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514374    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-45f7r\" (UniqueName: \"kubernetes.io/projected/5fed8347-18f8-4859-ba78-01d11fac608f-kube-api-access-45f7r\") pod \"5fed8347-18f8-4859-ba78-01d11fac608f\" (UID: \"5fed8347-18f8-4859-ba78-01d11fac608f\") "
Sep 06 12:43:17.514584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514422    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-model-cache" (OuterVolumeSpecName: "model-cache") pod "5fed8347-18f8-4859-ba78-01d11fac608f" (UID: "5fed8347-18f8-4859-ba78-01d11fac608f"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:17.514584 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514498    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5fed8347-18f8-4859-ba78-01d11fac608f" (UID: "5fed8347-18f8-4859-ba78-01d11fac608f"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:17.514728 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-home" (OuterVolumeSpecName: "home") pod "5fed8347-18f8-4859-ba78-01d11fac608f" (UID: "5fed8347-18f8-4859-ba78-01d11fac608f"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:17.514795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514725    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-home\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.514795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514743    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-model-cache\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.514795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.514758    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-tmp-dir\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.516526 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.516495    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fed8347-18f8-4859-ba78-01d11fac608f-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5fed8347-18f8-4859-ba78-01d11fac608f" (UID: "5fed8347-18f8-4859-ba78-01d11fac608f"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:43:17.516603 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.516571    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fed8347-18f8-4859-ba78-01d11fac608f-kube-api-access-45f7r" (OuterVolumeSpecName: "kube-api-access-45f7r") pod "5fed8347-18f8-4859-ba78-01d11fac608f" (UID: "5fed8347-18f8-4859-ba78-01d11fac608f"). InnerVolumeSpecName "kube-api-access-45f7r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:43:17.516785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.516758    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-dshm" (OuterVolumeSpecName: "dshm") pod "5fed8347-18f8-4859-ba78-01d11fac608f" (UID: "5fed8347-18f8-4859-ba78-01d11fac608f"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:43:17.615872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.615840    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fed8347-18f8-4859-ba78-01d11fac608f-tls-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.615872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.615866    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-45f7r\" (UniqueName: \"kubernetes.io/projected/5fed8347-18f8-4859-ba78-01d11fac608f-kube-api-access-45f7r\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.615872 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.615877    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fed8347-18f8-4859-ba78-01d11fac608f-dshm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:43:17.905776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.905747    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fed8347-18f8-4859-ba78-01d11fac608f" containerID="dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584" exitCode=0
Sep 06 12:43:17.905918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.905793    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"
Sep 06 12:43:17.905918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.905833    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7" event={"ID":"5fed8347-18f8-4859-ba78-01d11fac608f","Type":"ContainerDied","Data":"dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584"}
Sep 06 12:43:17.905918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.905890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7" event={"ID":"5fed8347-18f8-4859-ba78-01d11fac608f","Type":"ContainerDied","Data":"1396d1fa0b70077b2ef19d65d74edbcab547ea18ad70eaee26c4a57c9610662f"}
Sep 06 12:43:17.905918 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.905912    2578 scope.go:117] "RemoveContainer" containerID="dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584"
Sep 06 12:43:17.916804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.916786    2578 scope.go:117] "RemoveContainer" containerID="dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584"
Sep 06 12:43:17.917090 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:43:17.917073    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584\": container with ID starting with dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584 not found: ID does not exist" containerID="dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584"
Sep 06 12:43:17.917156 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.917100    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584"} err="failed to get container status \"dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584\": rpc error: code = NotFound desc = could not find container \"dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584\": container with ID starting with dbd1c4166029e37b3732cebe654a17c369e8965b11bee92abb4c5265c366c584 not found: ID does not exist"
Sep 06 12:43:17.929335 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.929276    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"]
Sep 06 12:43:17.932384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:17.932356    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-w3-e6515e/rate-test-model-e6515e-kserve-5dc9d694ff-8cdz7"]
Sep 06 12:43:18.613107 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:18.613071    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:43:18.676671 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:18.676627    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fed8347-18f8-4859-ba78-01d11fac608f" path="/var/lib/kubelet/pods/5fed8347-18f8-4859-ba78-01d11fac608f/volumes"
Sep 06 12:43:20.806619 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.805618    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": read tcp 10.132.0.2:41966->10.132.0.94:15021: read: connection reset by peer" start-of-body=
Sep 06 12:43:20.806619 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.805688    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": read tcp 10.132.0.2:41966->10.132.0.94:15021: read: connection reset by peer"
Sep 06 12:43:20.927843 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.927803    2578 generic.go:356] "Generic (PLEG): container finished" podID="85db5ab0-987a-4850-bd1a-361d2989578d" containerID="dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0" exitCode=0
Sep 06 12:43:20.927967 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.927858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" event={"ID":"85db5ab0-987a-4850-bd1a-361d2989578d","Type":"ContainerDied","Data":"dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"}
Sep 06 12:43:20.928292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.928278    2578 scope.go:117] "RemoveContainer" containerID="dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"
Sep 06 12:43:20.929315 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.929287    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:20.929413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.929371    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:20.929476 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:20.929422    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:21.935755 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:21.935721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" event={"ID":"85db5ab0-987a-4850-bd1a-361d2989578d","Type":"ContainerStarted","Data":"29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3"}
Sep 06 12:43:22.193878 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:22.193850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:22.194081 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:22.194064    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Sep 06 12:43:22.194129 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:22.194104    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Sep 06 12:43:23.194656 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:23.194621    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Sep 06 12:43:23.195053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:23.194669    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Sep 06 12:43:24.194711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:24.194665    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Sep 06 12:43:24.195298 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:24.194741    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Sep 06 12:43:25.194351 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:25.194316    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Sep 06 12:43:25.194518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:25.194378    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Sep 06 12:43:26.194593 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:26.194556    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused" start-of-body=
Sep 06 12:43:26.194974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:26.194608    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.94:15021/healthz/ready\": dial tcp 10.132.0.94:15021: connect: connection refused"
Sep 06 12:43:27.197977 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:27.197946    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:27.198444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:27.198241    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:27.198785 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:27.198767    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:43:31.664555 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.664521    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"]
Sep 06 12:43:31.664993 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.664976    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fed8347-18f8-4859-ba78-01d11fac608f" containerName="main"
Sep 06 12:43:31.664993 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.664994    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fed8347-18f8-4859-ba78-01d11fac608f" containerName="main"
Sep 06 12:43:31.665109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.665094    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fed8347-18f8-4859-ba78-01d11fac608f" containerName="main"
Sep 06 12:43:31.668486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.668463    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.671372 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.671355    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-e2a894-openshift-default-dockercfg-w84s5\""
Sep 06 12:43:31.685438 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.685412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"]
Sep 06 12:43:31.747815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.747791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-istio-token\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.747923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.747820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-certs\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.747923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.747873    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23339e77-9c41-4501-aa97-5606fa0a404c-istio-podinfo\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.747923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.747903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23339e77-9c41-4501-aa97-5606fa0a404c-istiod-ca-cert\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.748037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.747933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-envoy\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.748037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.747949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6lm2\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-kube-api-access-s6lm2\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.748037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.748007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-credential-socket\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.748142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.748064    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-data\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.748142 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.748086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-socket\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849466 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-data\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849466 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-socket\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849652 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-istio-token\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849652 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-certs\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849752 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23339e77-9c41-4501-aa97-5606fa0a404c-istio-podinfo\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849789 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23339e77-9c41-4501-aa97-5606fa0a404c-istiod-ca-cert\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849840 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-envoy\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849884 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6lm2\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-kube-api-access-s6lm2\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849885    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-socket\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-credential-socket\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.849938 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849900    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-data\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.850095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.849977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-certs\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.850185 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.850128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-credential-socket\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.850598 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.850571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23339e77-9c41-4501-aa97-5606fa0a404c-istiod-ca-cert\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.852328 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.852298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-envoy\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.852424 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.852301    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23339e77-9c41-4501-aa97-5606fa0a404c-istio-podinfo\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.858539 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.858511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-istio-token\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.858839 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.858821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6lm2\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-kube-api-access-s6lm2\") pod \"e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") " pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:31.980112 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:31.980087    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:32.269943 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:32.269912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"]
Sep 06 12:43:32.270645 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:43:32.270617    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23339e77_9c41_4501_aa97_5606fa0a404c.slice/crio-aa4cc6d4c0571142b19bc56f577b61c0799535d2b8eb36348936f3a3f0dbf39b WatchSource:0}: Error finding container aa4cc6d4c0571142b19bc56f577b61c0799535d2b8eb36348936f3a3f0dbf39b: Status 404 returned error can't find the container with id aa4cc6d4c0571142b19bc56f577b61c0799535d2b8eb36348936f3a3f0dbf39b
Sep 06 12:43:32.272916 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:32.272882    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:32.272993 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:32.272945    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:32.272993 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:32.272973    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:33.007711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:33.007675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" event={"ID":"23339e77-9c41-4501-aa97-5606fa0a404c","Type":"ContainerStarted","Data":"447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"}
Sep 06 12:43:33.008104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:33.007735    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" event={"ID":"23339e77-9c41-4501-aa97-5606fa0a404c","Type":"ContainerStarted","Data":"aa4cc6d4c0571142b19bc56f577b61c0799535d2b8eb36348936f3a3f0dbf39b"}
Sep 06 12:43:33.031443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:33.031402    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podStartSLOduration=2.031387696 podStartE2EDuration="2.031387696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:43:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:43:33.02995704 +0000 UTC m=+1554.843381118" watchObservedRunningTime="2026-09-06 12:43:33.031387696 +0000 UTC m=+1554.844811775"
Sep 06 12:43:33.980891 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:33.980855    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:33.986033 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:33.986007    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:34.013700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:34.013675    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:34.014722 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:34.014697    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:36.042919 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.042881    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"]
Sep 06 12:43:36.047567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.047545    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.050524 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.050501    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-e2a894-serving-cert\""
Sep 06 12:43:36.062729 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.062707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"]
Sep 06 12:43:36.190865 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.190828    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbkdx\" (UniqueName: \"kubernetes.io/projected/1ed426ad-cea4-432c-834a-d01403128f93-kube-api-access-qbkdx\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.191034 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.190975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed426ad-cea4-432c-834a-d01403128f93-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.191034 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.191002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.191116 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.191080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-metrics-certs\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.292069 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.292039    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-metrics-certs\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.292230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.292099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbkdx\" (UniqueName: \"kubernetes.io/projected/1ed426ad-cea4-432c-834a-d01403128f93-kube-api-access-qbkdx\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.292230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.292168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed426ad-cea4-432c-834a-d01403128f93-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.292230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.292216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.292343 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:43:36.292323    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-serving-cert: secret "maas-api-e2e-ipp-b-e2a894-serving-cert" not found
Sep 06 12:43:36.292385 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:43:36.292376    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls podName:1ed426ad-cea4-432c-834a-d01403128f93 nodeName:}" failed. No retries permitted until 2026-09-06 12:43:36.79236087 +0000 UTC m=+1558.605784928 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls") pod "maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" (UID: "1ed426ad-cea4-432c-834a-d01403128f93") : secret "maas-api-e2e-ipp-b-e2a894-serving-cert" not found
Sep 06 12:43:36.292813 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.292791    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed426ad-cea4-432c-834a-d01403128f93-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.294503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.294438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-metrics-certs\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.302005 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.301987    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbkdx\" (UniqueName: \"kubernetes.io/projected/1ed426ad-cea4-432c-834a-d01403128f93-kube-api-access-qbkdx\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.797505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.797455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.800055 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.800028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls\") pod \"maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:36.962731 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:36.962696    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:37.244749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:37.244720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"]
Sep 06 12:43:37.245371 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:43:37.245343    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ed426ad_cea4_432c_834a_d01403128f93.slice/crio-5c38e85a3f476cc5bc860f5871a25abbd7cab7a0c545d1e585428f347f61a7f6 WatchSource:0}: Error finding container 5c38e85a3f476cc5bc860f5871a25abbd7cab7a0c545d1e585428f347f61a7f6: Status 404 returned error can't find the container with id 5c38e85a3f476cc5bc860f5871a25abbd7cab7a0c545d1e585428f347f61a7f6
Sep 06 12:43:38.042942 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:38.042902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" event={"ID":"1ed426ad-cea4-432c-834a-d01403128f93","Type":"ContainerStarted","Data":"4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4"}
Sep 06 12:43:38.043110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:38.042963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" event={"ID":"1ed426ad-cea4-432c-834a-d01403128f93","Type":"ContainerStarted","Data":"5c38e85a3f476cc5bc860f5871a25abbd7cab7a0c545d1e585428f347f61a7f6"}
Sep 06 12:43:38.043110 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:38.042991    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:38.063979 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:38.063927    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" podStartSLOduration=1.7600864550000002 podStartE2EDuration="2.06391153s" totalImagesPullingTime="303.825075ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:43:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:43:38.060884469 +0000 UTC m=+1559.874308547" watchObservedRunningTime="2026-09-06 12:43:38.06391153 +0000 UTC m=+1559.877335633"
Sep 06 12:43:42.430113 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:42.430070    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:43:44.062464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:44.062430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:43:52.134342 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:52.134312    2578 generic.go:356] "Generic (PLEG): container finished" podID="23339e77-9c41-4501-aa97-5606fa0a404c" containerID="447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097" exitCode=0
Sep 06 12:43:52.134674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:52.134354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" event={"ID":"23339e77-9c41-4501-aa97-5606fa0a404c","Type":"ContainerDied","Data":"447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"}
Sep 06 12:43:52.134770 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:52.134755    2578 scope.go:117] "RemoveContainer" containerID="447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"
Sep 06 12:43:52.135912 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:52.135873    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:52.135974 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:52.135956    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:52.136014 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:52.135995    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:43:53.141717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:53.141685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" event={"ID":"23339e77-9c41-4501-aa97-5606fa0a404c","Type":"ContainerStarted","Data":"52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2"}
Sep 06 12:43:53.981089 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:53.981055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:53.981315 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:53.981205    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 06 12:43:53.981315 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:53.981289    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 06 12:43:54.980751 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:54.980717    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 06 12:43:54.981264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:54.980771    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 06 12:43:55.981116 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:55.981075    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 06 12:43:55.981513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:55.981165    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 06 12:43:56.980615 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:56.980580    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 06 12:43:56.980792 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:56.980645    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 06 12:43:57.980992 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:57.980954    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused" start-of-body=
Sep 06 12:43:57.981436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:57.981011    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.95:15021/healthz/ready\": dial tcp 10.132.0.95:15021: connect: connection refused"
Sep 06 12:43:58.984459 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:58.984430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:58.984823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:58.984691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:43:58.985300 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:43:58.985281    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:44:30.924263 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:30.924226    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:44:52.607350 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:52.607316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:44:56.506566 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.506534    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"]
Sep 06 12:44:56.510326 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.510308    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.513021 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.512998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-c82458-openshift-default-dockercfg-l4lxs\""
Sep 06 12:44:56.520605 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.520582    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"]
Sep 06 12:44:56.675540 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-credential-socket\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675604    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-data\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675721 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzw47\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-kube-api-access-fzw47\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-podinfo\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675823 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-certs\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-envoy\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-token\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.675939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.675930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-socket\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.776944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.776846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-envoy\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.776944 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.776895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-token\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-socket\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-credential-socket\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777211 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-data\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777440 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzw47\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-kube-api-access-fzw47\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777502 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-socket\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777597 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777574    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-credential-socket\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777659 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777615    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-data\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777675    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-podinfo\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-certs\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777910 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777883    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istiod-ca-cert\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.777972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.777947    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-certs\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.779267 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.779247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-envoy\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.779921 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.779905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-podinfo\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.784760 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.784740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-token\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.785246 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.785223    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzw47\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-kube-api-access-fzw47\") pod \"e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") " pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:56.821163 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:56.821124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:57.103178 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.103139    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"]
Sep 06 12:44:57.104699 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:44:57.104676    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5b4a83_9ce2_4899_9f7f_4778c78d0a1e.slice/crio-3e5336ba94e9f73e142a44d0e16db805fc2effb01a4f1f41032c43cade5cb16f WatchSource:0}: Error finding container 3e5336ba94e9f73e142a44d0e16db805fc2effb01a4f1f41032c43cade5cb16f: Status 404 returned error can't find the container with id 3e5336ba94e9f73e142a44d0e16db805fc2effb01a4f1f41032c43cade5cb16f
Sep 06 12:44:57.107418 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.107382    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:44:57.107503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.107451    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:44:57.107503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.107490    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:44:57.521058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.521024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" event={"ID":"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e","Type":"ContainerStarted","Data":"afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"}
Sep 06 12:44:57.521554 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.521076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" event={"ID":"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e","Type":"ContainerStarted","Data":"3e5336ba94e9f73e142a44d0e16db805fc2effb01a4f1f41032c43cade5cb16f"}
Sep 06 12:44:57.542373 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.542326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podStartSLOduration=1.542311765 podStartE2EDuration="1.542311765s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:44:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:44:57.540532402 +0000 UTC m=+1639.353956481" watchObservedRunningTime="2026-09-06 12:44:57.542311765 +0000 UTC m=+1639.355735858"
Sep 06 12:44:57.822024 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:57.821953    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:58.827113 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:58.827080    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:59.533814 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:59.533779    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:44:59.534633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:44:59.534613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:00.567892 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.567859    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"]
Sep 06 12:45:00.572083 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.572064    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.574406 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.574389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-c82458-serving-cert\""
Sep 06 12:45:00.582574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.582553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"]
Sep 06 12:45:00.717313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.717273    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.717491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.717326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdhsv\" (UniqueName: \"kubernetes.io/projected/f41b28d6-f647-4d91-83c8-52f558b49274-kube-api-access-bdhsv\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.717491 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.717357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.717599 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.717562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b28d6-f647-4d91-83c8-52f558b49274-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.818750 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.818673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b28d6-f647-4d91-83c8-52f558b49274-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.818750 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.818730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.818750 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.818751    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdhsv\" (UniqueName: \"kubernetes.io/projected/f41b28d6-f647-4d91-83c8-52f558b49274-kube-api-access-bdhsv\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.819025 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.818771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.819025 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:45:00.818892    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-serving-cert: secret "maas-api-e2e-ipp-cleanup-c82458-serving-cert" not found
Sep 06 12:45:00.819025 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:45:00.818979    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls podName:f41b28d6-f647-4d91-83c8-52f558b49274 nodeName:}" failed. No retries permitted until 2026-09-06 12:45:01.31895654 +0000 UTC m=+1643.132380602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" (UID: "f41b28d6-f647-4d91-83c8-52f558b49274") : secret "maas-api-e2e-ipp-cleanup-c82458-serving-cert" not found
Sep 06 12:45:00.819450 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.819427    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b28d6-f647-4d91-83c8-52f558b49274-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.821263 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.821245    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:00.826702 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:00.826682    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdhsv\" (UniqueName: \"kubernetes.io/projected/f41b28d6-f647-4d91-83c8-52f558b49274-kube-api-access-bdhsv\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:01.324742 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:01.324701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:01.327094 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:01.327065    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:01.485711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:01.485672    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:01.758268 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:01.758241    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"]
Sep 06 12:45:01.759352 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:45:01.759326    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf41b28d6_f647_4d91_83c8_52f558b49274.slice/crio-4e346aad0d747e09a4609bdad60cbb955d624edbdc5b0e819cbffec78b945d63 WatchSource:0}: Error finding container 4e346aad0d747e09a4609bdad60cbb955d624edbdc5b0e819cbffec78b945d63: Status 404 returned error can't find the container with id 4e346aad0d747e09a4609bdad60cbb955d624edbdc5b0e819cbffec78b945d63
Sep 06 12:45:01.760836 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:01.760820    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:45:02.561302 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:02.561265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" event={"ID":"f41b28d6-f647-4d91-83c8-52f558b49274","Type":"ContainerStarted","Data":"4e346aad0d747e09a4609bdad60cbb955d624edbdc5b0e819cbffec78b945d63"}
Sep 06 12:45:03.568321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:03.568283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" event={"ID":"f41b28d6-f647-4d91-83c8-52f558b49274","Type":"ContainerStarted","Data":"49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6"}
Sep 06 12:45:03.568774 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:03.568466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:03.584844 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:03.584788    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" podStartSLOduration=2.834808753 podStartE2EDuration="3.584774551s" totalImagesPullingTime="749.965798ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:45:03.583805433 +0000 UTC m=+1645.397229510" watchObservedRunningTime="2026-09-06 12:45:03.584774551 +0000 UTC m=+1645.398198626"
Sep 06 12:45:04.607138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:04.607098    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:45:09.580355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:09.580324    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:15.575309 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:15.575263    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 06 12:45:15.575719 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:15.575378    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 06 12:45:16.649976 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:16.649944    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerID="afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334" exitCode=0
Sep 06 12:45:16.650445 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:16.650001    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" event={"ID":"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e","Type":"ContainerDied","Data":"afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"}
Sep 06 12:45:16.650538 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:16.650465    2578 scope.go:117] "RemoveContainer" containerID="afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"
Sep 06 12:45:16.651956 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:16.651917    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:45:16.652051 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:16.652007    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:45:16.652099 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:16.652050    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 06 12:45:17.662532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:17.662498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" event={"ID":"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e","Type":"ContainerStarted","Data":"86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf"}
Sep 06 12:45:17.822104 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:17.822072    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:17.822298 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:17.822277    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 06 12:45:17.822346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:17.822324    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 06 12:45:18.821828 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:18.821791    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 06 12:45:18.822247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:18.821843    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 06 12:45:19.821715 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:19.821682    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 06 12:45:19.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:19.821741    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 06 12:45:20.822394 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:20.822355    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 06 12:45:20.822801 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:20.822421    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 06 12:45:21.821724 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:21.821685    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 06 12:45:21.821898 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:21.821749    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 06 12:45:22.821948 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:22.821914    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused" start-of-body=
Sep 06 12:45:22.822356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:22.821979    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.97:15021/healthz/ready\": dial tcp 10.132.0.97:15021: connect: connection refused"
Sep 06 12:45:23.825125 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:23.825090    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:23.825586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:23.825552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:23.826381 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:23.826362    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:31.044688 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.044641    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"]
Sep 06 12:45:31.045194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.044870    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" podUID="f41b28d6-f647-4d91-83c8-52f558b49274" containerName="maas-api" containerID="cri-o://49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6" gracePeriod=30
Sep 06 12:45:31.304637 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.304580    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:31.413075 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.413043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b28d6-f647-4d91-83c8-52f558b49274-openshift-service-ca\") pod \"f41b28d6-f647-4d91-83c8-52f558b49274\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") "
Sep 06 12:45:31.413277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.413131    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls\") pod \"f41b28d6-f647-4d91-83c8-52f558b49274\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") "
Sep 06 12:45:31.413277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.413182    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-metrics-certs\") pod \"f41b28d6-f647-4d91-83c8-52f558b49274\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") "
Sep 06 12:45:31.413277 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.413241    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdhsv\" (UniqueName: \"kubernetes.io/projected/f41b28d6-f647-4d91-83c8-52f558b49274-kube-api-access-bdhsv\") pod \"f41b28d6-f647-4d91-83c8-52f558b49274\" (UID: \"f41b28d6-f647-4d91-83c8-52f558b49274\") "
Sep 06 12:45:31.413502 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.413479    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f41b28d6-f647-4d91-83c8-52f558b49274-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f41b28d6-f647-4d91-83c8-52f558b49274" (UID: "f41b28d6-f647-4d91-83c8-52f558b49274"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:45:31.413624 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.413607    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f41b28d6-f647-4d91-83c8-52f558b49274-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:31.415384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.415334    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f41b28d6-f647-4d91-83c8-52f558b49274" (UID: "f41b28d6-f647-4d91-83c8-52f558b49274"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:45:31.415505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.415423    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f41b28d6-f647-4d91-83c8-52f558b49274-kube-api-access-bdhsv" (OuterVolumeSpecName: "kube-api-access-bdhsv") pod "f41b28d6-f647-4d91-83c8-52f558b49274" (UID: "f41b28d6-f647-4d91-83c8-52f558b49274"). InnerVolumeSpecName "kube-api-access-bdhsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:45:31.415505 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.415440    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f41b28d6-f647-4d91-83c8-52f558b49274" (UID: "f41b28d6-f647-4d91-83c8-52f558b49274"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:45:31.514447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.514415    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:31.514447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.514443    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f41b28d6-f647-4d91-83c8-52f558b49274-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:31.514447 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.514454    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdhsv\" (UniqueName: \"kubernetes.io/projected/f41b28d6-f647-4d91-83c8-52f558b49274-kube-api-access-bdhsv\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:31.763437 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.763402    2578 generic.go:356] "Generic (PLEG): container finished" podID="f41b28d6-f647-4d91-83c8-52f558b49274" containerID="49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6" exitCode=0
Sep 06 12:45:31.763634 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.763456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"
Sep 06 12:45:31.763634 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.763494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" event={"ID":"f41b28d6-f647-4d91-83c8-52f558b49274","Type":"ContainerDied","Data":"49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6"}
Sep 06 12:45:31.763634 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.763558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z" event={"ID":"f41b28d6-f647-4d91-83c8-52f558b49274","Type":"ContainerDied","Data":"4e346aad0d747e09a4609bdad60cbb955d624edbdc5b0e819cbffec78b945d63"}
Sep 06 12:45:31.763634 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.763588    2578 scope.go:117] "RemoveContainer" containerID="49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6"
Sep 06 12:45:31.774037 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.774020    2578 scope.go:117] "RemoveContainer" containerID="49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6"
Sep 06 12:45:31.774321 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:45:31.774298    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6\": container with ID starting with 49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6 not found: ID does not exist" containerID="49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6"
Sep 06 12:45:31.774413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.774327    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6"} err="failed to get container status \"49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6\": rpc error: code = NotFound desc = could not find container \"49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6\": container with ID starting with 49cf3fe4dec09001cc71ea44b3478607d7d619de47245b32a96cc636e1ac01a6 not found: ID does not exist"
Sep 06 12:45:31.785636 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.785613    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"]
Sep 06 12:45:31.791057 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:31.791038    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-c82458-98b78d4db-tgw8z"]
Sep 06 12:45:32.668519 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:32.668486    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f41b28d6-f647-4d91-83c8-52f558b49274" path="/var/lib/kubelet/pods/f41b28d6-f647-4d91-83c8-52f558b49274/volumes"
Sep 06 12:45:37.410205 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:37.410169    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:45:37.417627 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:37.417600    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"]
Sep 06 12:45:37.417989 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:37.417957    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" containerID="cri-o://86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf" gracePeriod=30
Sep 06 12:45:38.828009 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:38.827972    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 06 12:45:38.828384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:38.828040    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 06 12:45:39.198712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:39.198683    2578 scope.go:117] "RemoveContainer" containerID="5bed365732fed3c0bca2d20317a3a144e59b398ef2e28afd04e9a04575312f46"
Sep 06 12:45:42.677008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.676984    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:42.821082 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istiod-ca-cert\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821102    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-token\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-socket\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821164    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-podinfo\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821191    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-credential-socket\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-data\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821222    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-envoy\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821292 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821279    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-certs\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821670 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821372    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzw47\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-kube-api-access-fzw47\") pod \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\" (UID: \"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e\") "
Sep 06 12:45:42.821670 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821461    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:45:42.821670 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821577    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:45:42.821670 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821591    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:45:42.821670 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821595    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:45:42.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821708    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:45:42.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821792    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821810    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821824    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821838    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.821894 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.821851    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.823443 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.823419    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:45:42.823520 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.823461    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:45:42.823972 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.823952    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-kube-api-access-fzw47" (OuterVolumeSpecName: "kube-api-access-fzw47") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "kube-api-access-fzw47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:45:42.824053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.823974    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" (UID: "6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:45:42.831966 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.831940    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerID="86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf" exitCode=0
Sep 06 12:45:42.832061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.831998    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"
Sep 06 12:45:42.832061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.831997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" event={"ID":"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e","Type":"ContainerDied","Data":"86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf"}
Sep 06 12:45:42.832198 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.832098    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7" event={"ID":"6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e","Type":"ContainerDied","Data":"3e5336ba94e9f73e142a44d0e16db805fc2effb01a4f1f41032c43cade5cb16f"}
Sep 06 12:45:42.832198 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.832132    2578 scope.go:117] "RemoveContainer" containerID="86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf"
Sep 06 12:45:42.845594 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.845576    2578 scope.go:117] "RemoveContainer" containerID="afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"
Sep 06 12:45:42.854131 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.854109    2578 scope.go:117] "RemoveContainer" containerID="86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf"
Sep 06 12:45:42.854538 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:45:42.854502    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf\": container with ID starting with 86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf not found: ID does not exist" containerID="86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf"
Sep 06 12:45:42.854628 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.854538    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf"} err="failed to get container status \"86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf\": rpc error: code = NotFound desc = could not find container \"86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf\": container with ID starting with 86c17b4b0fcdf6fb4465ac28088afc906eb18b73db6248818b172deb93d4ffcf not found: ID does not exist"
Sep 06 12:45:42.854628 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.854562    2578 scope.go:117] "RemoveContainer" containerID="afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"
Sep 06 12:45:42.855002 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:45:42.854977    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334\": container with ID starting with afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334 not found: ID does not exist" containerID="afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"
Sep 06 12:45:42.855088 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.855009    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334"} err="failed to get container status \"afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334\": rpc error: code = NotFound desc = could not find container \"afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334\": container with ID starting with afa9803880cf1f5b6f5382c0a1c7ccb81e75fcfb22d334ca2c44c132ed4a2334 not found: ID does not exist"
Sep 06 12:45:42.857575 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.857553    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"]
Sep 06 12:45:42.860771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.860748    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-c82458-openshift-default-5fff89568d-2czj7"]
Sep 06 12:45:42.922294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.922270    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.922294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.922293    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.922411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.922302    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:42.922411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:42.922311    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzw47\" (UniqueName: \"kubernetes.io/projected/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e-kube-api-access-fzw47\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:45:44.668691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:44.668655    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" path="/var/lib/kubelet/pods/6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e/volumes"
Sep 06 12:45:56.008529 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:45:56.008493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:46:06.400311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:06.400233    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:46:44.679122 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:44.679083    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"]
Sep 06 12:46:44.679669 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:44.679353    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy" containerID="cri-o://29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3" gracePeriod=30
Sep 06 12:46:49.924128 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:49.924103    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:46:50.018278 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018215    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85db5ab0-987a-4850-bd1a-361d2989578d-istiod-ca-cert\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018278 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018261    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-certs\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018426 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018287    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-istio-token\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018426 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018308    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-socket\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018506 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018464    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85db5ab0-987a-4850-bd1a-361d2989578d-istio-podinfo\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018556 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-credential-socket\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018614 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018562    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:50.018614 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018573    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:50.018614 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018594    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85db5ab0-987a-4850-bd1a-361d2989578d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:46:50.018775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-data\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018637    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-envoy\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018661    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdf9c\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-kube-api-access-cdf9c\") pod \"85db5ab0-987a-4850-bd1a-361d2989578d\" (UID: \"85db5ab0-987a-4850-bd1a-361d2989578d\") "
Sep 06 12:46:50.018940 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018808    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:50.018940 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018842    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-data" (OuterVolumeSpecName: "istio-data") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:50.019054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018960    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85db5ab0-987a-4850-bd1a-361d2989578d-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.019054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018976    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.019054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018986    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.019054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.018995    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.019054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.019009    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.020689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.020658    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85db5ab0-987a-4850-bd1a-361d2989578d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:46:50.020689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.020657    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-kube-api-access-cdf9c" (OuterVolumeSpecName: "kube-api-access-cdf9c") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "kube-api-access-cdf9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:46:50.020867 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.020787    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-istio-token" (OuterVolumeSpecName: "istio-token") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:46:50.020931 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.020873    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85db5ab0-987a-4850-bd1a-361d2989578d" (UID: "85db5ab0-987a-4850-bd1a-361d2989578d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:46:50.119666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.119643    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85db5ab0-987a-4850-bd1a-361d2989578d-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.119666 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.119663    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdf9c\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-kube-api-access-cdf9c\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.119804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.119673    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85db5ab0-987a-4850-bd1a-361d2989578d-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.119804 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.119682    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85db5ab0-987a-4850-bd1a-361d2989578d-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:50.231464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.231436    2578 generic.go:356] "Generic (PLEG): container finished" podID="85db5ab0-987a-4850-bd1a-361d2989578d" containerID="29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3" exitCode=0
Sep 06 12:46:50.231582 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.231491    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"
Sep 06 12:46:50.231582 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.231516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" event={"ID":"85db5ab0-987a-4850-bd1a-361d2989578d","Type":"ContainerDied","Data":"29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3"}
Sep 06 12:46:50.231582 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.231572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh" event={"ID":"85db5ab0-987a-4850-bd1a-361d2989578d","Type":"ContainerDied","Data":"5edecd80e01f88d16a5e38bad39604ec15ec82b9e88805929fb6dd14846e52fb"}
Sep 06 12:46:50.231753 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.231597    2578 scope.go:117] "RemoveContainer" containerID="29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3"
Sep 06 12:46:50.241396 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.241377    2578 scope.go:117] "RemoveContainer" containerID="dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"
Sep 06 12:46:50.253101 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.253054    2578 scope.go:117] "RemoveContainer" containerID="29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3"
Sep 06 12:46:50.253649 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:46:50.253620    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3\": container with ID starting with 29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3 not found: ID does not exist" containerID="29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3"
Sep 06 12:46:50.253759 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.253659    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3"} err="failed to get container status \"29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3\": rpc error: code = NotFound desc = could not find container \"29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3\": container with ID starting with 29b1fab0756b863e8bf4c7580456da09026f9a55e9907718cd47afdd42c77ae3 not found: ID does not exist"
Sep 06 12:46:50.253759 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.253682    2578 scope.go:117] "RemoveContainer" containerID="dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"
Sep 06 12:46:50.254325 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:46:50.254299    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0\": container with ID starting with dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0 not found: ID does not exist" containerID="dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"
Sep 06 12:46:50.254422 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.254332    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0"} err="failed to get container status \"dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0\": rpc error: code = NotFound desc = could not find container \"dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0\": container with ID starting with dac6f1bc23bc42feb677acc9286ff0b9efbb807dacc559ffc2cbbad5e0c1cca0 not found: ID does not exist"
Sep 06 12:46:50.256208 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.256187    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"]
Sep 06 12:46:50.260595 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.260575    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-4f1951-openshift-default-7b97bfc566-9d5sh"]
Sep 06 12:46:50.669391 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:50.669358    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" path="/var/lib/kubelet/pods/85db5ab0-987a-4850-bd1a-361d2989578d/volumes"
Sep 06 12:46:55.505689 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.505652    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"]
Sep 06 12:46:55.506188 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.505931    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" podUID="1ed426ad-cea4-432c-834a-d01403128f93" containerName="maas-api" containerID="cri-o://4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4" gracePeriod=30
Sep 06 12:46:55.752216 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.752189    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:46:55.873253 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.873176    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls\") pod \"1ed426ad-cea4-432c-834a-d01403128f93\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") "
Sep 06 12:46:55.873395 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.873326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbkdx\" (UniqueName: \"kubernetes.io/projected/1ed426ad-cea4-432c-834a-d01403128f93-kube-api-access-qbkdx\") pod \"1ed426ad-cea4-432c-834a-d01403128f93\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") "
Sep 06 12:46:55.873395 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.873369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-metrics-certs\") pod \"1ed426ad-cea4-432c-834a-d01403128f93\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") "
Sep 06 12:46:55.873510 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.873394    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed426ad-cea4-432c-834a-d01403128f93-openshift-service-ca\") pod \"1ed426ad-cea4-432c-834a-d01403128f93\" (UID: \"1ed426ad-cea4-432c-834a-d01403128f93\") "
Sep 06 12:46:55.873844 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.873809    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ed426ad-cea4-432c-834a-d01403128f93-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ed426ad-cea4-432c-834a-d01403128f93" (UID: "1ed426ad-cea4-432c-834a-d01403128f93"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:46:55.875626 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.875577    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ed426ad-cea4-432c-834a-d01403128f93-kube-api-access-qbkdx" (OuterVolumeSpecName: "kube-api-access-qbkdx") pod "1ed426ad-cea4-432c-834a-d01403128f93" (UID: "1ed426ad-cea4-432c-834a-d01403128f93"). InnerVolumeSpecName "kube-api-access-qbkdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:46:55.875733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.875632    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "1ed426ad-cea4-432c-834a-d01403128f93" (UID: "1ed426ad-cea4-432c-834a-d01403128f93"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:46:55.875733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.875653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ed426ad-cea4-432c-834a-d01403128f93" (UID: "1ed426ad-cea4-432c-834a-d01403128f93"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:46:55.974711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.974677    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:55.974711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.974711    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbkdx\" (UniqueName: \"kubernetes.io/projected/1ed426ad-cea4-432c-834a-d01403128f93-kube-api-access-qbkdx\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:55.974902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.974726    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1ed426ad-cea4-432c-834a-d01403128f93-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:55.974902 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:55.974740    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ed426ad-cea4-432c-834a-d01403128f93-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:46:56.269261 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.269224    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ed426ad-cea4-432c-834a-d01403128f93" containerID="4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4" exitCode=0
Sep 06 12:46:56.269453 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.269271    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"
Sep 06 12:46:56.269453 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.269311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" event={"ID":"1ed426ad-cea4-432c-834a-d01403128f93","Type":"ContainerDied","Data":"4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4"}
Sep 06 12:46:56.269453 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.269376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc" event={"ID":"1ed426ad-cea4-432c-834a-d01403128f93","Type":"ContainerDied","Data":"5c38e85a3f476cc5bc860f5871a25abbd7cab7a0c545d1e585428f347f61a7f6"}
Sep 06 12:46:56.269453 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.269407    2578 scope.go:117] "RemoveContainer" containerID="4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4"
Sep 06 12:46:56.279499 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.279482    2578 scope.go:117] "RemoveContainer" containerID="4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4"
Sep 06 12:46:56.279775 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:46:56.279758    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4\": container with ID starting with 4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4 not found: ID does not exist" containerID="4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4"
Sep 06 12:46:56.279836 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.279787    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4"} err="failed to get container status \"4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4\": rpc error: code = NotFound desc = could not find container \"4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4\": container with ID starting with 4a08382e1f58c2bb4bea11ad268cfc7d08053be1148ec16bebc261bde21ecdb4 not found: ID does not exist"
Sep 06 12:46:56.306985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.306965    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"]
Sep 06 12:46:56.312391 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.312370    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-e2a894-864c6967df-4tfsc"]
Sep 06 12:46:56.669561 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:56.669484    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ed426ad-cea4-432c-834a-d01403128f93" path="/var/lib/kubelet/pods/1ed426ad-cea4-432c-834a-d01403128f93/volumes"
Sep 06 12:46:59.602659 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:46:59.602627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:47:02.053958 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:02.053922    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"]
Sep 06 12:47:02.054436 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:02.054190    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy" containerID="cri-o://52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2" gracePeriod=30
Sep 06 12:47:07.320002 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.319946    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:47:07.331469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.331444    2578 generic.go:356] "Generic (PLEG): container finished" podID="23339e77-9c41-4501-aa97-5606fa0a404c" containerID="52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2" exitCode=0
Sep 06 12:47:07.331565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.331481    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"
Sep 06 12:47:07.331565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.331515    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" event={"ID":"23339e77-9c41-4501-aa97-5606fa0a404c","Type":"ContainerDied","Data":"52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2"}
Sep 06 12:47:07.331565 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.331559    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f" event={"ID":"23339e77-9c41-4501-aa97-5606fa0a404c","Type":"ContainerDied","Data":"aa4cc6d4c0571142b19bc56f577b61c0799535d2b8eb36348936f3a3f0dbf39b"}
Sep 06 12:47:07.331706 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.331582    2578 scope.go:117] "RemoveContainer" containerID="52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2"
Sep 06 12:47:07.339984 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.339955    2578 scope.go:117] "RemoveContainer" containerID="447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"
Sep 06 12:47:07.357391 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.357367    2578 scope.go:117] "RemoveContainer" containerID="52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2"
Sep 06 12:47:07.357728 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:47:07.357705    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2\": container with ID starting with 52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2 not found: ID does not exist" containerID="52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2"
Sep 06 12:47:07.357786 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.357735    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2"} err="failed to get container status \"52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2\": rpc error: code = NotFound desc = could not find container \"52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2\": container with ID starting with 52bb3052d9e1e94a87ac4929a93c6221c5909243d52da15169efccfa76f259d2 not found: ID does not exist"
Sep 06 12:47:07.357786 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.357752    2578 scope.go:117] "RemoveContainer" containerID="447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"
Sep 06 12:47:07.358037 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:47:07.358021    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097\": container with ID starting with 447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097 not found: ID does not exist" containerID="447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"
Sep 06 12:47:07.358101 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.358042    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097"} err="failed to get container status \"447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097\": rpc error: code = NotFound desc = could not find container \"447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097\": container with ID starting with 447a0a1d1050bf10580a4f6862e9a04efdf18872d1120afa11639b8885618097 not found: ID does not exist"
Sep 06 12:47:07.472095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472067    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-credential-socket\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472104    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-data\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-certs\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472209    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-envoy\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472405 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472253    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6lm2\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-kube-api-access-s6lm2\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472405 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472290    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-istio-token\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472405 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23339e77-9c41-4501-aa97-5606fa0a404c-istiod-ca-cert\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472566 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472443    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-data" (OuterVolumeSpecName: "istio-data") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:07.472566 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472457    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:07.472566 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23339e77-9c41-4501-aa97-5606fa0a404c-istio-podinfo\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472743 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-socket\") pod \"23339e77-9c41-4501-aa97-5606fa0a404c\" (UID: \"23339e77-9c41-4501-aa97-5606fa0a404c\") "
Sep 06 12:47:07.472743 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472685    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/23339e77-9c41-4501-aa97-5606fa0a404c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:07.472743 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472705    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:07.472900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472853    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:07.472900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472862    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.473008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472907    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/23339e77-9c41-4501-aa97-5606fa0a404c-istiod-ca-cert\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.473008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472923    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-credential-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.473008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.472937    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-data\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.474635 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.474607    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/23339e77-9c41-4501-aa97-5606fa0a404c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 06 12:47:07.474734 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.474679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-istio-token" (OuterVolumeSpecName: "istio-token") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:07.474811 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.474794    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-kube-api-access-s6lm2" (OuterVolumeSpecName: "kube-api-access-s6lm2") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "kube-api-access-s6lm2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:07.474851 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.474817    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "23339e77-9c41-4501-aa97-5606fa0a404c" (UID: "23339e77-9c41-4501-aa97-5606fa0a404c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:47:07.573472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.573422    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-istio-envoy\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.573472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.573443    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6lm2\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-kube-api-access-s6lm2\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.573472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.573453    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/23339e77-9c41-4501-aa97-5606fa0a404c-istio-token\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.573472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.573461    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/23339e77-9c41-4501-aa97-5606fa0a404c-istio-podinfo\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.573472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.573469    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/23339e77-9c41-4501-aa97-5606fa0a404c-workload-socket\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:07.654176 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.654139    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"]
Sep 06 12:47:07.658641 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:07.658618    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-e2a894-openshift-default-677db5fd5d-xs55f"]
Sep 06 12:47:08.669449 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:08.669416    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" path="/var/lib/kubelet/pods/23339e77-9c41-4501-aa97-5606fa0a404c/volumes"
Sep 06 12:47:13.028162 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.028121    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"]
Sep 06 12:47:13.028586 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.028341    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" podUID="f9e35175-dc9e-4f10-a937-c0d6b02bd158" containerName="maas-api" containerID="cri-o://6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0" gracePeriod=30
Sep 06 12:47:13.281244 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.281187    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:47:13.369572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.369538    2578 generic.go:356] "Generic (PLEG): container finished" podID="f9e35175-dc9e-4f10-a937-c0d6b02bd158" containerID="6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0" exitCode=0
Sep 06 12:47:13.369726 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.369587    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"
Sep 06 12:47:13.369726 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.369630    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" event={"ID":"f9e35175-dc9e-4f10-a937-c0d6b02bd158","Type":"ContainerDied","Data":"6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0"}
Sep 06 12:47:13.369726 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.369710    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq" event={"ID":"f9e35175-dc9e-4f10-a937-c0d6b02bd158","Type":"ContainerDied","Data":"514602e68461111a564e77f7da0bc4e9374c93b346c56fa4b8af90a3552dbc2b"}
Sep 06 12:47:13.369830 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.369740    2578 scope.go:117] "RemoveContainer" containerID="6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0"
Sep 06 12:47:13.378815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.378796    2578 scope.go:117] "RemoveContainer" containerID="6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0"
Sep 06 12:47:13.379099 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:47:13.379080    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0\": container with ID starting with 6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0 not found: ID does not exist" containerID="6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0"
Sep 06 12:47:13.379191 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.379112    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0"} err="failed to get container status \"6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0\": rpc error: code = NotFound desc = could not find container \"6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0\": container with ID starting with 6bf2ff5b61414927295bd42e3d18013af0b6d2d035d1e208bdc088c6c5f6cea0 not found: ID does not exist"
Sep 06 12:47:13.423957 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.423929    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-metrics-certs\") pod \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") "
Sep 06 12:47:13.424091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.424031    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e35175-dc9e-4f10-a937-c0d6b02bd158-openshift-service-ca\") pod \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") "
Sep 06 12:47:13.424091 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.424059    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z9mz\" (UniqueName: \"kubernetes.io/projected/f9e35175-dc9e-4f10-a937-c0d6b02bd158-kube-api-access-9z9mz\") pod \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") "
Sep 06 12:47:13.424232 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.424130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls\") pod \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\" (UID: \"f9e35175-dc9e-4f10-a937-c0d6b02bd158\") "
Sep 06 12:47:13.424452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.424419    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f9e35175-dc9e-4f10-a937-c0d6b02bd158-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f9e35175-dc9e-4f10-a937-c0d6b02bd158" (UID: "f9e35175-dc9e-4f10-a937-c0d6b02bd158"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:13.426388 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.426361    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f9e35175-dc9e-4f10-a937-c0d6b02bd158" (UID: "f9e35175-dc9e-4f10-a937-c0d6b02bd158"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:47:13.426388 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.426374    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "f9e35175-dc9e-4f10-a937-c0d6b02bd158" (UID: "f9e35175-dc9e-4f10-a937-c0d6b02bd158"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:47:13.426521 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.426369    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9e35175-dc9e-4f10-a937-c0d6b02bd158-kube-api-access-9z9mz" (OuterVolumeSpecName: "kube-api-access-9z9mz") pod "f9e35175-dc9e-4f10-a937-c0d6b02bd158" (UID: "f9e35175-dc9e-4f10-a937-c0d6b02bd158"). InnerVolumeSpecName "kube-api-access-9z9mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:13.525095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.525054    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:13.525095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.525095    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f9e35175-dc9e-4f10-a937-c0d6b02bd158-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:13.525242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.525104    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f9e35175-dc9e-4f10-a937-c0d6b02bd158-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:13.525242 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.525114    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z9mz\" (UniqueName: \"kubernetes.io/projected/f9e35175-dc9e-4f10-a937-c0d6b02bd158-kube-api-access-9z9mz\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:13.693890 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.693857    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"]
Sep 06 12:47:13.700517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:13.700494    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-3feb92-7c676d49cf-mcbkq"]
Sep 06 12:47:14.668629 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:14.668594    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9e35175-dc9e-4f10-a937-c0d6b02bd158" path="/var/lib/kubelet/pods/f9e35175-dc9e-4f10-a937-c0d6b02bd158/volumes"
Sep 06 12:47:16.409113 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:16.409085    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:47:30.681348 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:30.681308    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"]
Sep 06 12:47:30.681928 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:30.681518    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l" podUID="59381cd3-3e6c-445d-b491-bc44c49f51f9" containerName="maas-api" containerID="cri-o://86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e" gracePeriod=30
Sep 06 12:47:30.925313 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:30.925287    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:47:31.067767 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.067699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-maas-api-tls\") pod \"59381cd3-3e6c-445d-b491-bc44c49f51f9\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") "
Sep 06 12:47:31.067886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.067809    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59381cd3-3e6c-445d-b491-bc44c49f51f9-openshift-service-ca\") pod \"59381cd3-3e6c-445d-b491-bc44c49f51f9\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") "
Sep 06 12:47:31.067886 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.067846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-metrics-certs\") pod \"59381cd3-3e6c-445d-b491-bc44c49f51f9\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") "
Sep 06 12:47:31.067985 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.067884    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb864\" (UniqueName: \"kubernetes.io/projected/59381cd3-3e6c-445d-b491-bc44c49f51f9-kube-api-access-wb864\") pod \"59381cd3-3e6c-445d-b491-bc44c49f51f9\" (UID: \"59381cd3-3e6c-445d-b491-bc44c49f51f9\") "
Sep 06 12:47:31.068237 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.068200    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59381cd3-3e6c-445d-b491-bc44c49f51f9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "59381cd3-3e6c-445d-b491-bc44c49f51f9" (UID: "59381cd3-3e6c-445d-b491-bc44c49f51f9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:47:31.070015 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.069981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "59381cd3-3e6c-445d-b491-bc44c49f51f9" (UID: "59381cd3-3e6c-445d-b491-bc44c49f51f9"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:47:31.070162 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.070045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "59381cd3-3e6c-445d-b491-bc44c49f51f9" (UID: "59381cd3-3e6c-445d-b491-bc44c49f51f9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:47:31.070162 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.070067    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59381cd3-3e6c-445d-b491-bc44c49f51f9-kube-api-access-wb864" (OuterVolumeSpecName: "kube-api-access-wb864") pod "59381cd3-3e6c-445d-b491-bc44c49f51f9" (UID: "59381cd3-3e6c-445d-b491-bc44c49f51f9"). InnerVolumeSpecName "kube-api-access-wb864". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:47:31.168680 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.168653    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb864\" (UniqueName: \"kubernetes.io/projected/59381cd3-3e6c-445d-b491-bc44c49f51f9-kube-api-access-wb864\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:31.168680 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.168676    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:31.168844 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.168687    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/59381cd3-3e6c-445d-b491-bc44c49f51f9-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:31.168844 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.168696    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/59381cd3-3e6c-445d-b491-bc44c49f51f9-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:47:31.475865 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.475831    2578 generic.go:356] "Generic (PLEG): container finished" podID="59381cd3-3e6c-445d-b491-bc44c49f51f9" containerID="86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e" exitCode=0
Sep 06 12:47:31.476008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.475873    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"
Sep 06 12:47:31.476008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.475909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l" event={"ID":"59381cd3-3e6c-445d-b491-bc44c49f51f9","Type":"ContainerDied","Data":"86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e"}
Sep 06 12:47:31.476008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.475959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l" event={"ID":"59381cd3-3e6c-445d-b491-bc44c49f51f9","Type":"ContainerDied","Data":"826dd4f9304093e07f0a6b736916dc270abf49c2b6921ec5fca115f3310d8e45"}
Sep 06 12:47:31.476008 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.475981    2578 scope.go:117] "RemoveContainer" containerID="86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e"
Sep 06 12:47:31.486122 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.486106    2578 scope.go:117] "RemoveContainer" containerID="86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e"
Sep 06 12:47:31.486421 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:47:31.486400    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e\": container with ID starting with 86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e not found: ID does not exist" containerID="86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e"
Sep 06 12:47:31.486472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.486429    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e"} err="failed to get container status \"86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e\": rpc error: code = NotFound desc = could not find container \"86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e\": container with ID starting with 86ac8a4ae01ed5ef11c3277c7cde584e115ea0c35078b743e561e336ed40196e not found: ID does not exist"
Sep 06 12:47:31.498197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.498178    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"]
Sep 06 12:47:31.501611 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:31.501591    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-e6515e-79c8b6546b-hl45l"]
Sep 06 12:47:32.668711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:32.668675    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59381cd3-3e6c-445d-b491-bc44c49f51f9" path="/var/lib/kubelet/pods/59381cd3-3e6c-445d-b491-bc44c49f51f9/volumes"
Sep 06 12:47:33.305567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:33.305536    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:47:38.861364 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:38.861334    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:47:38.867061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:38.867039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:47:39.236633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:39.236605    2578 scope.go:117] "RemoveContainer" containerID="7b194feccc5f6497f655aced58aca3687b8958647b0254b481dd8ffb2cb66569"
Sep 06 12:47:43.307346 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:47:43.307306    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:49:01.402089 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:49:01.402011    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:49:28.403859 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:49:28.403823    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:49:35.405164 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:49:35.405117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:49:45.506036 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:49:45.505999    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:50:02.403646 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:02.403611    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:50:09.413827 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:09.413795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:50:14.778010 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:14.777971    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"]
Sep 06 12:50:14.778527 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:14.778175    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv" podUID="69e01e58-9b88-4df8-9116-0e8c0b831f98" containerName="manager" containerID="cri-o://dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393" gracePeriod=10
Sep 06 12:50:15.034871 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.034818    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:50:15.128045 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.128002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2vqp\" (UniqueName: \"kubernetes.io/projected/69e01e58-9b88-4df8-9116-0e8c0b831f98-kube-api-access-b2vqp\") pod \"69e01e58-9b88-4df8-9116-0e8c0b831f98\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") "
Sep 06 12:50:15.128222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.128099    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e01e58-9b88-4df8-9116-0e8c0b831f98-extensions-socket-volume\") pod \"69e01e58-9b88-4df8-9116-0e8c0b831f98\" (UID: \"69e01e58-9b88-4df8-9116-0e8c0b831f98\") "
Sep 06 12:50:15.128464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.128441    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/69e01e58-9b88-4df8-9116-0e8c0b831f98-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "69e01e58-9b88-4df8-9116-0e8c0b831f98" (UID: "69e01e58-9b88-4df8-9116-0e8c0b831f98"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:50:15.129884 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.129868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/69e01e58-9b88-4df8-9116-0e8c0b831f98-kube-api-access-b2vqp" (OuterVolumeSpecName: "kube-api-access-b2vqp") pod "69e01e58-9b88-4df8-9116-0e8c0b831f98" (UID: "69e01e58-9b88-4df8-9116-0e8c0b831f98"). InnerVolumeSpecName "kube-api-access-b2vqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:50:15.229513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.229471    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2vqp\" (UniqueName: \"kubernetes.io/projected/69e01e58-9b88-4df8-9116-0e8c0b831f98-kube-api-access-b2vqp\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:50:15.229513 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.229507    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/69e01e58-9b88-4df8-9116-0e8c0b831f98-extensions-socket-volume\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:50:15.375321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.375249    2578 generic.go:356] "Generic (PLEG): container finished" podID="69e01e58-9b88-4df8-9116-0e8c0b831f98" containerID="dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393" exitCode=0
Sep 06 12:50:15.375321 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.375292    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"
Sep 06 12:50:15.375469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.375339    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv" event={"ID":"69e01e58-9b88-4df8-9116-0e8c0b831f98","Type":"ContainerDied","Data":"dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393"}
Sep 06 12:50:15.375469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.375395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv" event={"ID":"69e01e58-9b88-4df8-9116-0e8c0b831f98","Type":"ContainerDied","Data":"6a586c3afa9206e900c0d0cf84a69ed3b36be63b926bdef01e71652b8e4ea9e9"}
Sep 06 12:50:15.375469 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.375418    2578 scope.go:117] "RemoveContainer" containerID="dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393"
Sep 06 12:50:15.385616 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.385600    2578 scope.go:117] "RemoveContainer" containerID="dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393"
Sep 06 12:50:15.385869 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:50:15.385850    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393\": container with ID starting with dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393 not found: ID does not exist" containerID="dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393"
Sep 06 12:50:15.385915 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.385876    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393"} err="failed to get container status \"dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393\": rpc error: code = NotFound desc = could not find container \"dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393\": container with ID starting with dd74fd4af8ee4fc102eb17acc2786b92ae970e34137bf92a39da8b857e05d393 not found: ID does not exist"
Sep 06 12:50:15.397939 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.397915    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"]
Sep 06 12:50:15.401247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:15.401228    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-z57pv"]
Sep 06 12:50:16.668301 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:50:16.668272    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="69e01e58-9b88-4df8-9116-0e8c0b831f98" path="/var/lib/kubelet/pods/69e01e58-9b88-4df8-9116-0e8c0b831f98/volumes"
Sep 06 12:51:15.449756 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.449714    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"]
Sep 06 12:51:15.450355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450293    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="69e01e58-9b88-4df8-9116-0e8c0b831f98" containerName="manager"
Sep 06 12:51:15.450355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450313    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="69e01e58-9b88-4df8-9116-0e8c0b831f98" containerName="manager"
Sep 06 12:51:15.450355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450325    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy"
Sep 06 12:51:15.450355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450336    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy"
Sep 06 12:51:15.450355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450349    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9e35175-dc9e-4f10-a937-c0d6b02bd158" containerName="maas-api"
Sep 06 12:51:15.450355 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450357    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9e35175-dc9e-4f10-a937-c0d6b02bd158" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450370    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450378    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450389    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ed426ad-cea4-432c-834a-d01403128f93" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450398    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ed426ad-cea4-432c-834a-d01403128f93" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450411    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f41b28d6-f647-4d91-83c8-52f558b49274" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450419    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f41b28d6-f647-4d91-83c8-52f558b49274" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450441    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450450    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450462    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59381cd3-3e6c-445d-b491-bc44c49f51f9" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450470    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="59381cd3-3e6c-445d-b491-bc44c49f51f9" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450482    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450490    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450599    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="59381cd3-3e6c-445d-b491-bc44c49f51f9" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450612    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450621    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="85db5ab0-987a-4850-bd1a-361d2989578d" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="69e01e58-9b88-4df8-9116-0e8c0b831f98" containerName="manager"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450651    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450659    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ed426ad-cea4-432c-834a-d01403128f93" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450669    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9e35175-dc9e-4f10-a937-c0d6b02bd158" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450676    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f41b28d6-f647-4d91-83c8-52f558b49274" containerName="maas-api"
Sep 06 12:51:15.450686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.450684    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy"
Sep 06 12:51:15.453994 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.453973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.457349 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.457328    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-x9427\""
Sep 06 12:51:15.465479 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.465456    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"]
Sep 06 12:51:15.591065 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.591038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/738d6259-1547-4602-a527-9523979b8051-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cm2ds\" (UID: \"738d6259-1547-4602-a527-9523979b8051\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.591221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.591074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdns5\" (UniqueName: \"kubernetes.io/projected/738d6259-1547-4602-a527-9523979b8051-kube-api-access-sdns5\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cm2ds\" (UID: \"738d6259-1547-4602-a527-9523979b8051\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.691562 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.691537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/738d6259-1547-4602-a527-9523979b8051-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cm2ds\" (UID: \"738d6259-1547-4602-a527-9523979b8051\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.691684 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.691571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdns5\" (UniqueName: \"kubernetes.io/projected/738d6259-1547-4602-a527-9523979b8051-kube-api-access-sdns5\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cm2ds\" (UID: \"738d6259-1547-4602-a527-9523979b8051\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.691906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.691886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/738d6259-1547-4602-a527-9523979b8051-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cm2ds\" (UID: \"738d6259-1547-4602-a527-9523979b8051\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.700795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.700736    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdns5\" (UniqueName: \"kubernetes.io/projected/738d6259-1547-4602-a527-9523979b8051-kube-api-access-sdns5\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-cm2ds\" (UID: \"738d6259-1547-4602-a527-9523979b8051\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:15.764458 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:15.764429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:16.044855 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:16.044822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"]
Sep 06 12:51:16.045372 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:51:16.045352    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod738d6259_1547_4602_a527_9523979b8051.slice/crio-ad864afc538e3ba8bd7cecc9e7be84dda28c89ea641b1e9104de4428d713c0e2 WatchSource:0}: Error finding container ad864afc538e3ba8bd7cecc9e7be84dda28c89ea641b1e9104de4428d713c0e2: Status 404 returned error can't find the container with id ad864afc538e3ba8bd7cecc9e7be84dda28c89ea641b1e9104de4428d713c0e2
Sep 06 12:51:16.718113 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:16.718080    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds" event={"ID":"738d6259-1547-4602-a527-9523979b8051","Type":"ContainerStarted","Data":"fbad029015fb99501850608674bce31276befb5f710b8717255dc50a354041b5"}
Sep 06 12:51:16.718496 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:16.718124    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds" event={"ID":"738d6259-1547-4602-a527-9523979b8051","Type":"ContainerStarted","Data":"ad864afc538e3ba8bd7cecc9e7be84dda28c89ea641b1e9104de4428d713c0e2"}
Sep 06 12:51:16.718496 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:16.718168    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:16.740504 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:16.740454    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds" podStartSLOduration=1.740439547 podStartE2EDuration="1.740439547s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:51:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:51:16.736388416 +0000 UTC m=+2018.549812495" watchObservedRunningTime="2026-09-06 12:51:16.740439547 +0000 UTC m=+2018.553863625"
Sep 06 12:51:27.726239 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:27.726204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-cm2ds"
Sep 06 12:51:36.514950 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:36.514913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:51:43.601512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:43.601470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:51:52.721382 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.721348    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"]
Sep 06 12:51:52.721946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.721901    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy"
Sep 06 12:51:52.721946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.721921    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5b4a83-9ce2-4899-9f7f-4778c78d0a1e" containerName="istio-proxy"
Sep 06 12:51:52.722068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.721970    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy"
Sep 06 12:51:52.722068 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.721979    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy"
Sep 06 12:51:52.722271 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.722069    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="23339e77-9c41-4501-aa97-5606fa0a404c" containerName="istio-proxy"
Sep 06 12:51:52.725452 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.725431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.729062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.729041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-73854932-kserve-self-signed-certs\""
Sep 06 12:51:52.742371 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.742348    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"]
Sep 06 12:51:52.785294 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.785270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-model-cache\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.785429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.785305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7mpj\" (UniqueName: \"kubernetes.io/projected/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-kube-api-access-t7mpj\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.785429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.785339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-home\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.785429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.785386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-dshm\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.785429 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.785408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tmp-dir\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.785560 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.785457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tls-certs\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.885906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.885871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-dshm\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.885906 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.885913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tmp-dir\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.885953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tls-certs\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.885974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-model-cache\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.885995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7mpj\" (UniqueName: \"kubernetes.io/projected/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-kube-api-access-t7mpj\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886109 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.886027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-home\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886446 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.886415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-model-cache\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.886453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-home\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.886558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.886428    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tmp-dir\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.888188 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.888168    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-dshm\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.888486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.888446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tls-certs\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.896138 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.896116    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7mpj\" (UniqueName: \"kubernetes.io/projected/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-kube-api-access-t7mpj\") pod \"e2e-same-id-a-73854932-kserve-8fccf4467-p56m7\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") " pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:52.913054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:52.913032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:51:53.033702 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:53.033617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:51:53.314007 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:53.313978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"]
Sep 06 12:51:53.315970 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:51:53.315944    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3fffaf2f_07b9_40dd_9300_15fc7d7bed5d.slice/crio-66a1f024dd06724d040b0eb38c2245090b20962b9d34efb7b05a3fde6a320cdf WatchSource:0}: Error finding container 66a1f024dd06724d040b0eb38c2245090b20962b9d34efb7b05a3fde6a320cdf: Status 404 returned error can't find the container with id 66a1f024dd06724d040b0eb38c2245090b20962b9d34efb7b05a3fde6a320cdf
Sep 06 12:51:53.924776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:53.924743    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7" event={"ID":"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d","Type":"ContainerStarted","Data":"b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205"}
Sep 06 12:51:53.925175 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:53.924785    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7" event={"ID":"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d","Type":"ContainerStarted","Data":"66a1f024dd06724d040b0eb38c2245090b20962b9d34efb7b05a3fde6a320cdf"}
Sep 06 12:51:53.942913 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:51:53.942865    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7" podStartSLOduration=1.9428493260000002 podStartE2EDuration="1.942849326s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:51:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:51:53.940255469 +0000 UTC m=+2055.753679548" watchObservedRunningTime="2026-09-06 12:51:53.942849326 +0000 UTC m=+2055.756273408"
Sep 06 12:52:00.012174 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.012113    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"]
Sep 06 12:52:00.016364 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.016346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.018896 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.018873    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-73854932-kserve-self-signed-certs\""
Sep 06 12:52:00.024305 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.024282    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"]
Sep 06 12:52:00.052090 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.052056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dbh7\" (UniqueName: \"kubernetes.io/projected/329e9a34-3a04-4d35-9cb3-7dfb42470360-kube-api-access-6dbh7\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.052253 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.052191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-model-cache\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.052253 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.052234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329e9a34-3a04-4d35-9cb3-7dfb42470360-tls-certs\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.052344 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.052327    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-home\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.052384 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.052351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-tmp-dir\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.052423 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.052404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-dshm\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.121816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.121785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:52:00.153733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.153702    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-home\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.153733 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.153734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-tmp-dir\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.153946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.153775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-dshm\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.153946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.153842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dbh7\" (UniqueName: \"kubernetes.io/projected/329e9a34-3a04-4d35-9cb3-7dfb42470360-kube-api-access-6dbh7\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.153946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.153916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-model-cache\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.153946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.153940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329e9a34-3a04-4d35-9cb3-7dfb42470360-tls-certs\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.154198 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.154180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-home\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.154547 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.154522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-tmp-dir\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.154897 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.154863    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-model-cache\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.156686 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.156657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-dshm\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.156909 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.156886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329e9a34-3a04-4d35-9cb3-7dfb42470360-tls-certs\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.162010 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.161990    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dbh7\" (UniqueName: \"kubernetes.io/projected/329e9a34-3a04-4d35-9cb3-7dfb42470360-kube-api-access-6dbh7\") pod \"e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") " pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.326792 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.326709    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:00.605413 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.605387    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"]
Sep 06 12:52:00.606841 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:52:00.606816    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod329e9a34_3a04_4d35_9cb3_7dfb42470360.slice/crio-bcf83ccc45e8b809655da941569bc2ff927c1bd41c3ea3fe2bebfd6fa76b51b3 WatchSource:0}: Error finding container bcf83ccc45e8b809655da941569bc2ff927c1bd41c3ea3fe2bebfd6fa76b51b3: Status 404 returned error can't find the container with id bcf83ccc45e8b809655da941569bc2ff927c1bd41c3ea3fe2bebfd6fa76b51b3
Sep 06 12:52:00.968119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.968083    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq" event={"ID":"329e9a34-3a04-4d35-9cb3-7dfb42470360","Type":"ContainerStarted","Data":"e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d"}
Sep 06 12:52:00.968119 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.968126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq" event={"ID":"329e9a34-3a04-4d35-9cb3-7dfb42470360","Type":"ContainerStarted","Data":"bcf83ccc45e8b809655da941569bc2ff927c1bd41c3ea3fe2bebfd6fa76b51b3"}
Sep 06 12:52:00.990851 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:00.990783    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq" podStartSLOduration=1.990762465 podStartE2EDuration="1.990762465s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:51:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:52:00.986065355 +0000 UTC m=+2062.799489434" watchObservedRunningTime="2026-09-06 12:52:00.990762465 +0000 UTC m=+2062.804186546"
Sep 06 12:52:03.033776 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:03.033738    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:52:03.034225 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:03.033797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:52:03.046456 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:03.046426    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:52:03.999025 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:03.998993    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:52:08.709177 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:08.708124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:52:10.327317 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:10.327284    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:10.327795 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:10.327485    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:10.340518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:10.340496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:11.039517 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:11.039484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:35.865046 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:35.865014    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"]
Sep 06 12:52:37.583306 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:37.583262    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"]
Sep 06 12:52:38.303300 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:38.303262    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:52:38.901775 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:38.901748    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:52:38.909390 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:38.909368    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:52:47.308115 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:47.308079    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:52:50.885889 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:50.885848    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7" podUID="3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" containerName="main" containerID="cri-o://b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205" gracePeriod=45
Sep 06 12:52:51.135771 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.135745    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:52:51.196923 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.196897    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7mpj\" (UniqueName: \"kubernetes.io/projected/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-kube-api-access-t7mpj\") pod \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") "
Sep 06 12:52:51.197050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.196957    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-dshm\") pod \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") "
Sep 06 12:52:51.197050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.196976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-home\") pod \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") "
Sep 06 12:52:51.197050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197019    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tls-certs\") pod \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") "
Sep 06 12:52:51.197050 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197036    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-model-cache\") pod \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") "
Sep 06 12:52:51.197260 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197078    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tmp-dir\") pod \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\" (UID: \"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d\") "
Sep 06 12:52:51.197336 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197309    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-home" (OuterVolumeSpecName: "home") pod "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" (UID: "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:51.197402 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197325    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-model-cache" (OuterVolumeSpecName: "model-cache") pod "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" (UID: "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:51.197484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197456    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" (UID: "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:51.197484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197478    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-home\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:51.197576 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.197495    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-model-cache\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:51.199134 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.199110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-kube-api-access-t7mpj" (OuterVolumeSpecName: "kube-api-access-t7mpj") pod "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" (UID: "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d"). InnerVolumeSpecName "kube-api-access-t7mpj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:52:51.199536 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.199514    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-dshm" (OuterVolumeSpecName: "dshm") pod "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" (UID: "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:51.199578 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.199514    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" (UID: "3fffaf2f-07b9-40dd-9300-15fc7d7bed5d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:52:51.257098 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.257072    2578 generic.go:356] "Generic (PLEG): container finished" podID="3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" containerID="b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205" exitCode=0
Sep 06 12:52:51.257234 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.257116    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"
Sep 06 12:52:51.257234 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.257166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7" event={"ID":"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d","Type":"ContainerDied","Data":"b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205"}
Sep 06 12:52:51.257234 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.257210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7" event={"ID":"3fffaf2f-07b9-40dd-9300-15fc7d7bed5d","Type":"ContainerDied","Data":"66a1f024dd06724d040b0eb38c2245090b20962b9d34efb7b05a3fde6a320cdf"}
Sep 06 12:52:51.257234 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.257229    2578 scope.go:117] "RemoveContainer" containerID="b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205"
Sep 06 12:52:51.266574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.266557    2578 scope.go:117] "RemoveContainer" containerID="b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205"
Sep 06 12:52:51.266839 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:52:51.266822    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205\": container with ID starting with b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205 not found: ID does not exist" containerID="b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205"
Sep 06 12:52:51.266898 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.266848    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205"} err="failed to get container status \"b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205\": rpc error: code = NotFound desc = could not find container \"b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205\": container with ID starting with b1b8078255b0e02cd0b3de07e3ccb432c2a6985ca508c22eb85bc93515749205 not found: ID does not exist"
Sep 06 12:52:51.277838 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.277813    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"]
Sep 06 12:52:51.281502 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.281481    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-73854932-kserve-8fccf4467-p56m7"]
Sep 06 12:52:51.298698 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.298671    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tls-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:51.298698 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.298695    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-tmp-dir\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:51.298825 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.298708    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7mpj\" (UniqueName: \"kubernetes.io/projected/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-kube-api-access-t7mpj\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:51.298825 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:51.298722    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d-dshm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:52.603648 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.603607    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq" podUID="329e9a34-3a04-4d35-9cb3-7dfb42470360" containerName="main" containerID="cri-o://e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d" gracePeriod=45
Sep 06 12:52:52.672093 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.672049    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" path="/var/lib/kubelet/pods/3fffaf2f-07b9-40dd-9300-15fc7d7bed5d/volumes"
Sep 06 12:52:52.880735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.880709    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:52.911432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.911400    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329e9a34-3a04-4d35-9cb3-7dfb42470360-tls-certs\") pod \"329e9a34-3a04-4d35-9cb3-7dfb42470360\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") "
Sep 06 12:52:52.911574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.911454    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-home\") pod \"329e9a34-3a04-4d35-9cb3-7dfb42470360\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") "
Sep 06 12:52:52.911574 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.911546    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-dshm\") pod \"329e9a34-3a04-4d35-9cb3-7dfb42470360\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") "
Sep 06 12:52:52.911735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.911580    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-model-cache\") pod \"329e9a34-3a04-4d35-9cb3-7dfb42470360\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") "
Sep 06 12:52:52.911735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.911652    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-tmp-dir\") pod \"329e9a34-3a04-4d35-9cb3-7dfb42470360\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") "
Sep 06 12:52:52.911735 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.911698    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dbh7\" (UniqueName: \"kubernetes.io/projected/329e9a34-3a04-4d35-9cb3-7dfb42470360-kube-api-access-6dbh7\") pod \"329e9a34-3a04-4d35-9cb3-7dfb42470360\" (UID: \"329e9a34-3a04-4d35-9cb3-7dfb42470360\") "
Sep 06 12:52:52.912197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.912026    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-home" (OuterVolumeSpecName: "home") pod "329e9a34-3a04-4d35-9cb3-7dfb42470360" (UID: "329e9a34-3a04-4d35-9cb3-7dfb42470360"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:52.912197 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.912135    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-model-cache" (OuterVolumeSpecName: "model-cache") pod "329e9a34-3a04-4d35-9cb3-7dfb42470360" (UID: "329e9a34-3a04-4d35-9cb3-7dfb42470360"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:52.912411 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.912281    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "329e9a34-3a04-4d35-9cb3-7dfb42470360" (UID: "329e9a34-3a04-4d35-9cb3-7dfb42470360"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:52.914658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.914402    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-dshm" (OuterVolumeSpecName: "dshm") pod "329e9a34-3a04-4d35-9cb3-7dfb42470360" (UID: "329e9a34-3a04-4d35-9cb3-7dfb42470360"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 06 12:52:52.914658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.914609    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/329e9a34-3a04-4d35-9cb3-7dfb42470360-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "329e9a34-3a04-4d35-9cb3-7dfb42470360" (UID: "329e9a34-3a04-4d35-9cb3-7dfb42470360"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:52:52.914658 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:52.914635    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/329e9a34-3a04-4d35-9cb3-7dfb42470360-kube-api-access-6dbh7" (OuterVolumeSpecName: "kube-api-access-6dbh7") pod "329e9a34-3a04-4d35-9cb3-7dfb42470360" (UID: "329e9a34-3a04-4d35-9cb3-7dfb42470360"). InnerVolumeSpecName "kube-api-access-6dbh7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:52:53.012477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.012441    2578 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-dshm\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:53.012477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.012476    2578 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-model-cache\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:53.012717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.012514    2578 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-tmp-dir\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:53.012717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.012531    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dbh7\" (UniqueName: \"kubernetes.io/projected/329e9a34-3a04-4d35-9cb3-7dfb42470360-kube-api-access-6dbh7\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:53.012717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.012544    2578 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/329e9a34-3a04-4d35-9cb3-7dfb42470360-tls-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:53.012717 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.012556    2578 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/329e9a34-3a04-4d35-9cb3-7dfb42470360-home\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:52:53.271370 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.271334    2578 generic.go:356] "Generic (PLEG): container finished" podID="329e9a34-3a04-4d35-9cb3-7dfb42470360" containerID="e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d" exitCode=0
Sep 06 12:52:53.271568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.271398    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"
Sep 06 12:52:53.271568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.271423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq" event={"ID":"329e9a34-3a04-4d35-9cb3-7dfb42470360","Type":"ContainerDied","Data":"e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d"}
Sep 06 12:52:53.271568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.271471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq" event={"ID":"329e9a34-3a04-4d35-9cb3-7dfb42470360","Type":"ContainerDied","Data":"bcf83ccc45e8b809655da941569bc2ff927c1bd41c3ea3fe2bebfd6fa76b51b3"}
Sep 06 12:52:53.271568 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.271488    2578 scope.go:117] "RemoveContainer" containerID="e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d"
Sep 06 12:52:53.280821 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.280806    2578 scope.go:117] "RemoveContainer" containerID="e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d"
Sep 06 12:52:53.281058 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:52:53.281039    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d\": container with ID starting with e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d not found: ID does not exist" containerID="e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d"
Sep 06 12:52:53.281112 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.281065    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d"} err="failed to get container status \"e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d\": rpc error: code = NotFound desc = could not find container \"e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d\": container with ID starting with e203e13a4ab2da81812327f4e08d0bbbeb86c77816b77ff65a75082b6162684d not found: ID does not exist"
Sep 06 12:52:53.293168 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.293130    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"]
Sep 06 12:52:53.295235 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:53.295216    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-73854932-kserve-574db8b6dc-px5rq"]
Sep 06 12:52:54.668907 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:54.668877    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="329e9a34-3a04-4d35-9cb3-7dfb42470360" path="/var/lib/kubelet/pods/329e9a34-3a04-4d35-9cb3-7dfb42470360/volumes"
Sep 06 12:52:55.484797 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.484764    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"]
Sep 06 12:52:55.485186 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.485165    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" containerName="main"
Sep 06 12:52:55.485303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.485184    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" containerName="main"
Sep 06 12:52:55.485303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.485205    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="329e9a34-3a04-4d35-9cb3-7dfb42470360" containerName="main"
Sep 06 12:52:55.485303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.485210    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="329e9a34-3a04-4d35-9cb3-7dfb42470360" containerName="main"
Sep 06 12:52:55.485303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.485298    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="329e9a34-3a04-4d35-9cb3-7dfb42470360" containerName="main"
Sep 06 12:52:55.485303 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.485305    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fffaf2f-07b9-40dd-9300-15fc7d7bed5d" containerName="main"
Sep 06 12:52:55.489732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.489716    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.492497 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.492480    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 06 12:52:55.492876 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.492854    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 06 12:52:55.493869 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.493853    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 06 12:52:55.493977 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.493956    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 06 12:52:55.494033 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.493956    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-w24cl\""
Sep 06 12:52:55.498226 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.498196    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"]
Sep 06 12:52:55.503365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.503344    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"]
Sep 06 12:52:55.506654 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.506635    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.518375 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.518356    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"]
Sep 06 12:52:55.530642 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.530619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-maas-api-tls\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.530737 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.530670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60020d18-7cae-4ded-b609-79a84d903e3a-openshift-service-ca\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.530737 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.530689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-metrics-certs\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.530826 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.530750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plc2v\" (UniqueName: \"kubernetes.io/projected/60020d18-7cae-4ded-b609-79a84d903e3a-kube-api-access-plc2v\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.632170 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60020d18-7cae-4ded-b609-79a84d903e3a-openshift-service-ca\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.632257 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-metrics-certs\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.632257 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plc2v\" (UniqueName: \"kubernetes.io/projected/60020d18-7cae-4ded-b609-79a84d903e3a-kube-api-access-plc2v\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.632341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-openshift-service-ca\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.632341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632295    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-metrics-certs\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.632341 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jnpn\" (UniqueName: \"kubernetes.io/projected/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-kube-api-access-5jnpn\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.632444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-maas-api-tls\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.632444 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-maas-api-tls\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.632808 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.632781    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60020d18-7cae-4ded-b609-79a84d903e3a-openshift-service-ca\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.634662 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.634641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-metrics-certs\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.634732 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.634703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-maas-api-tls\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.639607 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.639577    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-plc2v\" (UniqueName: \"kubernetes.io/projected/60020d18-7cae-4ded-b609-79a84d903e3a-kube-api-access-plc2v\") pod \"maas-api-5b4cdc449f-lcwbs\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") " pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.733077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.733055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-openshift-service-ca\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.733442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.733084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-metrics-certs\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.733442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.733100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jnpn\" (UniqueName: \"kubernetes.io/projected/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-kube-api-access-5jnpn\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.733442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.733235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-maas-api-tls\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.733749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.733730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-openshift-service-ca\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.735264 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.735215    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-metrics-certs\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.735472 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.735456    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-maas-api-tls\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.740552 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.740531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jnpn\" (UniqueName: \"kubernetes.io/projected/34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11-kube-api-access-5jnpn\") pod \"maas-api-7f8ff55747-f994m\" (UID: \"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11\") " pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:55.802108 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.802086    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:55.804796 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.804775    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:52:55.819247 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:55.819228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:56.078759 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:56.078733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"]
Sep 06 12:52:56.080689 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:52:56.080666    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60020d18_7cae_4ded_b609_79a84d903e3a.slice/crio-16fee30f67a8011395fffc5a8f24dca67c71807b872fb5c6f4ae7aa6a5e7d2f6 WatchSource:0}: Error finding container 16fee30f67a8011395fffc5a8f24dca67c71807b872fb5c6f4ae7aa6a5e7d2f6: Status 404 returned error can't find the container with id 16fee30f67a8011395fffc5a8f24dca67c71807b872fb5c6f4ae7aa6a5e7d2f6
Sep 06 12:52:56.081946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:56.081928    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 06 12:52:56.108607 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:56.108586    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"]
Sep 06 12:52:56.109650 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:52:56.109626    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34fd4ca2_12a6_408e_9b2a_2bdbad0e4f11.slice/crio-cfcd105901819e0ec378fdea04136632a7aefee5e68dc874ea19ca5baa062391 WatchSource:0}: Error finding container cfcd105901819e0ec378fdea04136632a7aefee5e68dc874ea19ca5baa062391: Status 404 returned error can't find the container with id cfcd105901819e0ec378fdea04136632a7aefee5e68dc874ea19ca5baa062391
Sep 06 12:52:56.290634 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:56.290603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs" event={"ID":"60020d18-7cae-4ded-b609-79a84d903e3a","Type":"ContainerStarted","Data":"16fee30f67a8011395fffc5a8f24dca67c71807b872fb5c6f4ae7aa6a5e7d2f6"}
Sep 06 12:52:56.292077 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:56.292050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m" event={"ID":"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11","Type":"ContainerStarted","Data":"cfcd105901819e0ec378fdea04136632a7aefee5e68dc874ea19ca5baa062391"}
Sep 06 12:52:57.300058 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:57.300015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs" event={"ID":"60020d18-7cae-4ded-b609-79a84d903e3a","Type":"ContainerStarted","Data":"192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc"}
Sep 06 12:52:57.300497 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:57.300084    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:52:57.301696 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:57.301672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m" event={"ID":"34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11","Type":"ContainerStarted","Data":"63003615b5811b5ea8fd10e1744d5635ebb8bc0296208fe26702ae458a48e2a4"}
Sep 06 12:52:57.301813 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:57.301798    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:52:57.318486 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:57.318440    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs" podStartSLOduration=1.711429479 podStartE2EDuration="2.31842809s" totalImagesPullingTime="606.998611ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:52:57.315692492 +0000 UTC m=+2119.129116570" watchObservedRunningTime="2026-09-06 12:52:57.31842809 +0000 UTC m=+2119.131852165"
Sep 06 12:52:57.334465 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:52:57.334419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m" podStartSLOduration=1.8744355270000002 podStartE2EDuration="2.334406712s" totalImagesPullingTime="459.971185ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:52:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:52:57.331706728 +0000 UTC m=+2119.145130808" watchObservedRunningTime="2026-09-06 12:52:57.334406712 +0000 UTC m=+2119.147830791"
Sep 06 12:53:03.315016 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.314983    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7f8ff55747-f994m"
Sep 06 12:53:03.315504 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.315135    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:53:03.375606 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.375566    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"]
Sep 06 12:53:03.375794 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.375750    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs" podUID="60020d18-7cae-4ded-b609-79a84d903e3a" containerName="maas-api" containerID="cri-o://192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc" gracePeriod=30
Sep 06 12:53:03.625519 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.625495    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:53:03.703480 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.703451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-plc2v\" (UniqueName: \"kubernetes.io/projected/60020d18-7cae-4ded-b609-79a84d903e3a-kube-api-access-plc2v\") pod \"60020d18-7cae-4ded-b609-79a84d903e3a\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") "
Sep 06 12:53:03.703633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.703534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-maas-api-tls\") pod \"60020d18-7cae-4ded-b609-79a84d903e3a\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") "
Sep 06 12:53:03.703633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.703573    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-metrics-certs\") pod \"60020d18-7cae-4ded-b609-79a84d903e3a\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") "
Sep 06 12:53:03.703633 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.703606    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60020d18-7cae-4ded-b609-79a84d903e3a-openshift-service-ca\") pod \"60020d18-7cae-4ded-b609-79a84d903e3a\" (UID: \"60020d18-7cae-4ded-b609-79a84d903e3a\") "
Sep 06 12:53:03.704017 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.703990    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60020d18-7cae-4ded-b609-79a84d903e3a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60020d18-7cae-4ded-b609-79a84d903e3a" (UID: "60020d18-7cae-4ded-b609-79a84d903e3a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 06 12:53:03.705625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.705595    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60020d18-7cae-4ded-b609-79a84d903e3a-kube-api-access-plc2v" (OuterVolumeSpecName: "kube-api-access-plc2v") pod "60020d18-7cae-4ded-b609-79a84d903e3a" (UID: "60020d18-7cae-4ded-b609-79a84d903e3a"). InnerVolumeSpecName "kube-api-access-plc2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 06 12:53:03.705711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.705641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "60020d18-7cae-4ded-b609-79a84d903e3a" (UID: "60020d18-7cae-4ded-b609-79a84d903e3a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:53:03.705711 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.705651    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60020d18-7cae-4ded-b609-79a84d903e3a" (UID: "60020d18-7cae-4ded-b609-79a84d903e3a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 06 12:53:03.805136 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.805105    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-maas-api-tls\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:53:03.805136 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.805132    2578 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60020d18-7cae-4ded-b609-79a84d903e3a-metrics-certs\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:53:03.805311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.805189    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60020d18-7cae-4ded-b609-79a84d903e3a-openshift-service-ca\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:53:03.805311 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:03.805200    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-plc2v\" (UniqueName: \"kubernetes.io/projected/60020d18-7cae-4ded-b609-79a84d903e3a-kube-api-access-plc2v\") on node \"ip-10-0-130-145.ec2.internal\" DevicePath \"\""
Sep 06 12:53:04.113831 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.113805    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:53:04.345946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.345913    2578 generic.go:356] "Generic (PLEG): container finished" podID="60020d18-7cae-4ded-b609-79a84d903e3a" containerID="192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc" exitCode=0
Sep 06 12:53:04.346367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.345956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs" event={"ID":"60020d18-7cae-4ded-b609-79a84d903e3a","Type":"ContainerDied","Data":"192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc"}
Sep 06 12:53:04.346367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.345962    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"
Sep 06 12:53:04.346367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.346007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs" event={"ID":"60020d18-7cae-4ded-b609-79a84d903e3a","Type":"ContainerDied","Data":"16fee30f67a8011395fffc5a8f24dca67c71807b872fb5c6f4ae7aa6a5e7d2f6"}
Sep 06 12:53:04.346367 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.346032    2578 scope.go:117] "RemoveContainer" containerID="192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc"
Sep 06 12:53:04.356195 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.356178    2578 scope.go:117] "RemoveContainer" containerID="192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc"
Sep 06 12:53:04.356500 ip-10-0-130-145 kubenswrapper[2578]: E0906 12:53:04.356480    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc\": container with ID starting with 192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc not found: ID does not exist" containerID="192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc"
Sep 06 12:53:04.356567 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.356510    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc"} err="failed to get container status \"192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc\": rpc error: code = NotFound desc = could not find container \"192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc\": container with ID starting with 192a42d17f833b89422b213844eb8ba7dded2307bba526007bb00c9572d54adc not found: ID does not exist"
Sep 06 12:53:04.372835 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.372755    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"]
Sep 06 12:53:04.377558 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.377537    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-5b4cdc449f-lcwbs"]
Sep 06 12:53:04.669914 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:04.669833    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60020d18-7cae-4ded-b609-79a84d903e3a" path="/var/lib/kubelet/pods/60020d18-7cae-4ded-b609-79a84d903e3a/volumes"
Sep 06 12:53:11.212999 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:11.212965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:53:20.114984 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:20.114949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:53:25.309818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:25.309785    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-tngqp"]
Sep 06 12:53:28.213522 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:28.213487    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574b8bccd4-hz2m9_04ee6c4f-e741-4238-8f70-f037685822d1/authorino/0.log"
Sep 06 12:53:33.367293 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:33.367212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9wq4k_127c40ac-2eb4-479d-b783-bb4866eb4047/manager/0.log"
Sep 06 12:53:33.493244 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:33.493216    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h54xz_d265c7da-ab4e-463e-a791-043b2c25b09c/manager/0.log"
Sep 06 12:53:34.079190 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:34.079136    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-wbqng_3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66/copy-manifests/0.log"
Sep 06 12:53:34.100759 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:34.100729    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-wbqng_3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66/manager/0.log"
Sep 06 12:53:34.653432 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:34.653403    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7f8ff55747-f994m_34fd4ca2-12a6-408e-9b2a-2bdbad0e4f11/maas-api/0.log"
Sep 06 12:53:34.758442 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:34.758419    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29811630-9z5zr_0f939144-4784-48a7-9776-69bae2a68fb8/cleanup/0.log"
Sep 06 12:53:35.709532 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:35.709501    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574b8bccd4-hz2m9_04ee6c4f-e741-4238-8f70-f037685822d1/authorino/0.log"
Sep 06 12:53:35.827254 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:35.827224    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-l7dpz_b1b6b814-d694-4ab4-a6c2-8ed8687507b8/manager/0.log"
Sep 06 12:53:35.934522 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:35.934500    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-vqt2h_a2bbbd20-154a-4317-8281-896ab066350e/manager/0.log"
Sep 06 12:53:36.039194 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:36.039117    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-hmtf4_06aad8dc-bac1-4c34-adc4-7c8971515478/kuadrant-console-plugin/0.log"
Sep 06 12:53:36.166057 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:36.166021    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cm2ds_738d6259-1547-4602-a527-9523979b8051/manager/0.log"
Sep 06 12:53:36.276385 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:36.276361    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-tngqp_94515263-e3fd-4ec8-bfc1-af7f5700f406/limitador/0.log"
Sep 06 12:53:36.394676 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:36.394610    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-fmlzj_7116e89e-63a5-4a93-abc3-6abcb57a3c87/manager/0.log"
Sep 06 12:53:36.945251 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:36.945223    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-6r5bh_849f80c4-72ad-4050-91f1-ee757d142b08/kube-auth-proxy/0.log"
Sep 06 12:53:37.173960 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:37.173925    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/1.log"
Sep 06 12:53:37.524837 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:37.524810    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f9f9784-n5ntv_fe76b0a0-a1ec-4344-bc69-48a6028d51ff/router/0.log"
Sep 06 12:53:37.980710 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:37.980687    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-hgbld_e31cb97c-82be-4c2b-91ce-b3d36f17b8e0/main/0.log"
Sep 06 12:53:43.986018 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.985985    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6h8m/must-gather-vcdkf"]
Sep 06 12:53:43.986511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.986421    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60020d18-7cae-4ded-b609-79a84d903e3a" containerName="maas-api"
Sep 06 12:53:43.986511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.986437    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="60020d18-7cae-4ded-b609-79a84d903e3a" containerName="maas-api"
Sep 06 12:53:43.986511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.986509    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="60020d18-7cae-4ded-b609-79a84d903e3a" containerName="maas-api"
Sep 06 12:53:43.989673 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.989653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:43.992381 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.992361    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6h8m\"/\"openshift-service-ca.crt\""
Sep 06 12:53:43.993343 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.993326    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q6h8m\"/\"kube-root-ca.crt\""
Sep 06 12:53:43.993498 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:43.993414    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q6h8m\"/\"default-dockercfg-lf5lq\""
Sep 06 12:53:44.003356 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.003334    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6h8m/must-gather-vcdkf"]
Sep 06 12:53:44.110957 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.110933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h68pf\" (UniqueName: \"kubernetes.io/projected/a10696f3-18ea-4687-9adc-7a5a3e50f584-kube-api-access-h68pf\") pod \"must-gather-vcdkf\" (UID: \"a10696f3-18ea-4687-9adc-7a5a3e50f584\") " pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.111061 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.110983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a10696f3-18ea-4687-9adc-7a5a3e50f584-must-gather-output\") pod \"must-gather-vcdkf\" (UID: \"a10696f3-18ea-4687-9adc-7a5a3e50f584\") " pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.212405 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.212381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h68pf\" (UniqueName: \"kubernetes.io/projected/a10696f3-18ea-4687-9adc-7a5a3e50f584-kube-api-access-h68pf\") pod \"must-gather-vcdkf\" (UID: \"a10696f3-18ea-4687-9adc-7a5a3e50f584\") " pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.212511 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.212423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a10696f3-18ea-4687-9adc-7a5a3e50f584-must-gather-output\") pod \"must-gather-vcdkf\" (UID: \"a10696f3-18ea-4687-9adc-7a5a3e50f584\") " pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.212712 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.212696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a10696f3-18ea-4687-9adc-7a5a3e50f584-must-gather-output\") pod \"must-gather-vcdkf\" (UID: \"a10696f3-18ea-4687-9adc-7a5a3e50f584\") " pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.222845 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.222814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h68pf\" (UniqueName: \"kubernetes.io/projected/a10696f3-18ea-4687-9adc-7a5a3e50f584-kube-api-access-h68pf\") pod \"must-gather-vcdkf\" (UID: \"a10696f3-18ea-4687-9adc-7a5a3e50f584\") " pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.299253 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.299200    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6h8m/must-gather-vcdkf"
Sep 06 12:53:44.569691 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:44.569668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6h8m/must-gather-vcdkf"]
Sep 06 12:53:44.571250 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:53:44.571213    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda10696f3_18ea_4687_9adc_7a5a3e50f584.slice/crio-8311a4454ae4f2536f1ae6c62a519837043caf0ffd1cf7b7b8b544fa85340f76 WatchSource:0}: Error finding container 8311a4454ae4f2536f1ae6c62a519837043caf0ffd1cf7b7b8b544fa85340f76: Status 404 returned error can't find the container with id 8311a4454ae4f2536f1ae6c62a519837043caf0ffd1cf7b7b8b544fa85340f76
Sep 06 12:53:45.587530 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:45.587493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/must-gather-vcdkf" event={"ID":"a10696f3-18ea-4687-9adc-7a5a3e50f584","Type":"ContainerStarted","Data":"7b25d070cb8cf40da311b4ceaed548bb1eed1f56fc3a127e04e8392fba0a7b4e"}
Sep 06 12:53:45.587933 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:45.587543    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/must-gather-vcdkf" event={"ID":"a10696f3-18ea-4687-9adc-7a5a3e50f584","Type":"ContainerStarted","Data":"8311a4454ae4f2536f1ae6c62a519837043caf0ffd1cf7b7b8b544fa85340f76"}
Sep 06 12:53:46.596349 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:46.596306    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/must-gather-vcdkf" event={"ID":"a10696f3-18ea-4687-9adc-7a5a3e50f584","Type":"ContainerStarted","Data":"7e6dda74b80b80fe5bcec266a0bd33ac8f37d45e8e07d398dcbb4170a8548277"}
Sep 06 12:53:46.613281 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:46.613206    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q6h8m/must-gather-vcdkf" podStartSLOduration=2.7962877969999997 podStartE2EDuration="3.613184482s" totalImagesPullingTime="816.896685ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-06 12:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:53:46.611938101 +0000 UTC m=+2168.425362181" watchObservedRunningTime="2026-09-06 12:53:46.613184482 +0000 UTC m=+2168.426608561"
Sep 06 12:53:46.900675 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:46.900597    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-547dz_511dbd99-611b-4839-8f80-84edaf706c81/global-pull-secret-syncer/0.log"
Sep 06 12:53:47.094389 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:47.094350    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-sgkzn_8d557548-48e4-4b8b-9972-e21bfc1ce33f/konnectivity-agent/0.log"
Sep 06 12:53:47.122388 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:47.122359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-145.ec2.internal_6bfc877ce1180e84a3ed63c00e0e76f9/haproxy/0.log"
Sep 06 12:53:51.824462 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:51.824362    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-574b8bccd4-hz2m9_04ee6c4f-e741-4238-8f70-f037685822d1/authorino/0.log"
Sep 06 12:53:51.861693 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:51.861657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-l7dpz_b1b6b814-d694-4ab4-a6c2-8ed8687507b8/manager/0.log"
Sep 06 12:53:51.890392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:51.890361    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-vqt2h_a2bbbd20-154a-4317-8281-896ab066350e/manager/0.log"
Sep 06 12:53:51.923769 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:51.923741    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-598f86468b-hmtf4_06aad8dc-bac1-4c34-adc4-7c8971515478/kuadrant-console-plugin/0.log"
Sep 06 12:53:51.973961 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:51.973923    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-cm2ds_738d6259-1547-4602-a527-9523979b8051/manager/0.log"
Sep 06 12:53:51.999053 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:51.999019    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-85d9db4d5d-tngqp_94515263-e3fd-4ec8-bfc1-af7f5700f406/limitador/0.log"
Sep 06 12:53:52.092195 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:52.091787    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-fmlzj_7116e89e-63a5-4a93-abc3-6abcb57a3c87/manager/0.log"
Sep 06 12:53:53.635652 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:53.635614    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6cdcc96965-hth6p_8d227759-ce05-4cde-9fc3-e5553262c45a/cluster-monitoring-operator/0.log"
Sep 06 12:53:53.945464 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:53.945430    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptfgs_83d51f69-5c7a-45b3-9353-445e14b5a614/node-exporter/0.log"
Sep 06 12:53:53.968468 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:53.968436    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptfgs_83d51f69-5c7a-45b3-9353-445e14b5a614/kube-rbac-proxy/0.log"
Sep 06 12:53:53.992259 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:53.992227    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ptfgs_83d51f69-5c7a-45b3-9353-445e14b5a614/init-textfile/0.log"
Sep 06 12:53:54.506701 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:54.506626    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7bdc8557-z62cv_e4c85c82-d505-4810-b91e-96693f5258b7/telemeter-client/0.log"
Sep 06 12:53:54.526086 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:54.526036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7bdc8557-z62cv_e4c85c82-d505-4810-b91e-96693f5258b7/reload/0.log"
Sep 06 12:53:54.544570 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:54.544538    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5c7bdc8557-z62cv_e4c85c82-d505-4810-b91e-96693f5258b7/kube-rbac-proxy/0.log"
Sep 06 12:53:55.992572 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:55.992540    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-79977f9844-pbdnq_c79ce967-390b-405f-99c6-f3b8ab2e65d5/networking-console-plugin/0.log"
Sep 06 12:53:56.596949 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:56.596915    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/1.log"
Sep 06 12:53:56.609283 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:56.609229    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-85b454874b-jrpsk_43bf7fc1-0485-4f89-ae8b-043aa756f181/console-operator/2.log"
Sep 06 12:53:57.172984 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.172952    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-7jgf5_ad66a5b3-cfc5-4284-9519-d85963e011fa/download-server/0.log"
Sep 06 12:53:57.280912 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.280874    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"]
Sep 06 12:53:57.289941 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.289912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.296343 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.296315    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"]
Sep 06 12:53:57.347815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.347782    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6cp6\" (UniqueName: \"kubernetes.io/projected/725d0d76-8490-494b-a0af-1e15b3e4df8d-kube-api-access-p6cp6\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.348011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.347845    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-proc\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.348011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.347870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-lib-modules\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.348011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.347913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-sys\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.348011 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.347937    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-podres\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.448625 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.448582    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-proc\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.448818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.448635    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-lib-modules\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.448818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.448695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-sys\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.448818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.448728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-podres\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.448818 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.448796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6cp6\" (UniqueName: \"kubernetes.io/projected/725d0d76-8490-494b-a0af-1e15b3e4df8d-kube-api-access-p6cp6\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.449222 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.449199    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-proc\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.449591 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.449490    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-podres\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.449700 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.449509    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-lib-modules\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.449783 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.449551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/725d0d76-8490-494b-a0af-1e15b3e4df8d-sys\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.458209 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.458182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6cp6\" (UniqueName: \"kubernetes.io/projected/725d0d76-8490-494b-a0af-1e15b3e4df8d-kube-api-access-p6cp6\") pod \"perf-node-gather-daemonset-bnsvt\" (UID: \"725d0d76-8490-494b-a0af-1e15b3e4df8d\") " pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.607243 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.607205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:57.904713 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.904635    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-5vrcj_71eaf0cd-d88a-4a47-8cce-a24170f8d3da/volume-data-source-validator/0.log"
Sep 06 12:53:57.917870 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:57.917836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"]
Sep 06 12:53:57.919788 ip-10-0-130-145 kubenswrapper[2578]: W0906 12:53:57.919753    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod725d0d76_8490_494b_a0af_1e15b3e4df8d.slice/crio-a0962dee29f382652887c92a3f57fbf67ab5cc19d8d8ae5a47f6b63458f260a4 WatchSource:0}: Error finding container a0962dee29f382652887c92a3f57fbf67ab5cc19d8d8ae5a47f6b63458f260a4: Status 404 returned error can't find the container with id a0962dee29f382652887c92a3f57fbf67ab5cc19d8d8ae5a47f6b63458f260a4
Sep 06 12:53:58.714118 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:58.714076    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt" event={"ID":"725d0d76-8490-494b-a0af-1e15b3e4df8d","Type":"ContainerStarted","Data":"b532d1b818fe7fe1bc01baba529659caf632ab7efe6c2b70517f098bf6df7bb2"}
Sep 06 12:53:58.714624 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:58.714157    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt" event={"ID":"725d0d76-8490-494b-a0af-1e15b3e4df8d","Type":"ContainerStarted","Data":"a0962dee29f382652887c92a3f57fbf67ab5cc19d8d8ae5a47f6b63458f260a4"}
Sep 06 12:53:58.714624 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:58.714202    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:53:58.733518 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:58.733457    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt" podStartSLOduration=1.733439187 podStartE2EDuration="1.733439187s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-06 12:53:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-06 12:53:58.728767602 +0000 UTC m=+2180.542191694" watchObservedRunningTime="2026-09-06 12:53:58.733439187 +0000 UTC m=+2180.546863266"
Sep 06 12:53:59.052674 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:59.052578    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jldb_16da98dc-bc62-48e9-80d0-b2916ee630a3/dns/0.log"
Sep 06 12:53:59.070252 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:59.070228    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7jldb_16da98dc-bc62-48e9-80d0-b2916ee630a3/kube-rbac-proxy/0.log"
Sep 06 12:53:59.194816 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:59.194790    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qxrmg_54aa5f32-f784-42ad-a18e-ceb438edf790/dns-node-resolver/0.log"
Sep 06 12:53:59.844484 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:53:59.844455    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-p9t9n_7f2966f7-6de1-4f24-8c25-6cb02f10280d/node-ca/0.log"
Sep 06 12:54:01.093587 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:01.093556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-6r5bh_849f80c4-72ad-4050-91f1-ee757d142b08/kube-auth-proxy/0.log"
Sep 06 12:54:01.140477 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:01.140452    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/0.log"
Sep 06 12:54:01.159626 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:01.159598    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/1.log"
Sep 06 12:54:01.257777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:01.257747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f9f9784-n5ntv_fe76b0a0-a1ec-4344-bc69-48a6028d51ff/router/0.log"
Sep 06 12:54:02.118030 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:02.117997    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6gcp8_42466ce8-ea33-4f18-9e0a-90f730216171/serve-healthcheck-canary/0.log"
Sep 06 12:54:02.586503 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:02.586469    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-5shz2_7822caa6-5117-4f1f-bb80-94a1dcf4213e/insights-operator/1.log"
Sep 06 12:54:02.587808 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:02.587747    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-5shz2_7822caa6-5117-4f1f-bb80-94a1dcf4213e/insights-operator/0.log"
Sep 06 12:54:02.732095 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:02.732044    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlsk9_7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a/kube-rbac-proxy/0.log"
Sep 06 12:54:02.750875 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:02.750841    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlsk9_7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a/exporter/0.log"
Sep 06 12:54:02.769868 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:02.769842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mlsk9_7c0ff89e-93c0-4af8-8c9b-60a7cb079b1a/extractor/0.log"
Sep 06 12:54:04.735221 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:04.735193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q6h8m/perf-node-gather-daemonset-bnsvt"
Sep 06 12:54:04.783946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:04.783915    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-9wq4k_127c40ac-2eb4-479d-b783-bb4866eb4047/manager/0.log"
Sep 06 12:54:05.138946 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:05.138860    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-h54xz_d265c7da-ab4e-463e-a791-043b2c25b09c/manager/0.log"
Sep 06 12:54:05.464766 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:05.464664    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-wbqng_3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66/manager/0.log"
Sep 06 12:54:05.481241 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:05.481213    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bf7c58dfb-wbqng_3f12b1ae-142c-4f5c-b8fb-9d6734d9bb66/copy-manifests/0.log"
Sep 06 12:54:08.086856 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:08.086823    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-6r5bh_849f80c4-72ad-4050-91f1-ee757d142b08/kube-auth-proxy/0.log"
Sep 06 12:54:08.120092 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:08.120059    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/0.log"
Sep 06 12:54:08.134461 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:08.134429    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/1.log"
Sep 06 12:54:08.204029 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:08.203992    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f9f9784-n5ntv_fe76b0a0-a1ec-4344-bc69-48a6028d51ff/router/0.log"
Sep 06 12:54:09.948379 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:09.948346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-766996c99d-6r5bh_849f80c4-72ad-4050-91f1-ee757d142b08/kube-auth-proxy/0.log"
Sep 06 12:54:09.988392 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:09.988360    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/0.log"
Sep 06 12:54:10.007548 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:10.007507    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-78bb78ff78-jkksr_27607480-a933-4b89-8a08-4524be8d55d6/istio-proxy/1.log"
Sep 06 12:54:10.075652 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:10.075625    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-54f9f9784-n5ntv_fe76b0a0-a1ec-4344-bc69-48a6028d51ff/router/0.log"
Sep 06 12:54:12.323062 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:12.323027    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-zlrrs_1ee9628f-34d8-4f2a-8914-cde72e918b82/kube-storage-version-migrator-operator/1.log"
Sep 06 12:54:12.324755 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:12.324728    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-8d7dd4675-zlrrs_1ee9628f-34d8-4f2a-8914-cde72e918b82/kube-storage-version-migrator-operator/0.log"
Sep 06 12:54:13.406041 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.406010    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7zrwz_59896d24-e5ae-4a36-acc4-ba2c934ac026/kube-multus/0.log"
Sep 06 12:54:13.685285 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.685211    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/kube-multus-additional-cni-plugins/0.log"
Sep 06 12:54:13.702365 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.702337    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/egress-router-binary-copy/0.log"
Sep 06 12:54:13.721610 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.721584    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/cni-plugins/0.log"
Sep 06 12:54:13.736749 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.736728    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/bond-cni-plugin/0.log"
Sep 06 12:54:13.754230 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.754208    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/routeoverride-cni/0.log"
Sep 06 12:54:13.771054 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.771036    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/whereabouts-cni-bincopy/0.log"
Sep 06 12:54:13.787703 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.787684    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tchzz_503c81f2-ce8e-4b66-bd05-843066e0308c/whereabouts-cni/0.log"
Sep 06 12:54:13.851900 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.851881    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ffnwb_cbef0fcf-3628-4500-bb73-3af52c312c80/network-metrics-daemon/0.log"
Sep 06 12:54:13.865180 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:13.865135    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ffnwb_cbef0fcf-3628-4500-bb73-3af52c312c80/kube-rbac-proxy/0.log"
Sep 06 12:54:14.666512 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.666398    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/ovn-controller/0.log"
Sep 06 12:54:14.681914 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.681880    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/ovn-acl-logging/0.log"
Sep 06 12:54:14.703467 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.703441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/kube-rbac-proxy-node/0.log"
Sep 06 12:54:14.722777 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.722746    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/kube-rbac-proxy-ovn-metrics/0.log"
Sep 06 12:54:14.738334 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.738307    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/northd/0.log"
Sep 06 12:54:14.759245 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.759209    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/nbdb/0.log"
Sep 06 12:54:14.778140 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.778107    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/sbdb/0.log"
Sep 06 12:54:14.889815 ip-10-0-130-145 kubenswrapper[2578]: I0906 12:54:14.889789    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2mcdg_c115dc27-265a-43ce-b886-bcbb5f407a8b/ovnkube-controller/0.log"