Jul 30 15:08:01.285412 ip-10-0-138-79 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 30 15:08:01.285424 ip-10-0-138-79 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 30 15:08:01.285433 ip-10-0-138-79 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 30 15:08:01.285686 ip-10-0-138-79 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 30 15:08:11.345839 ip-10-0-138-79 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 30 15:08:11.345872 ip-10-0-138-79 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8f1b3934ec1446f4aada3f696b17db84 --
Jul 30 15:10:01.286695 ip-10-0-138-79 systemd[1]: Starting Kubernetes Kubelet...
Jul 30 15:10:01.656562 ip-10-0-138-79 kubenswrapper[2553]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 15:10:01.656562 ip-10-0-138-79 kubenswrapper[2553]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 30 15:10:01.656562 ip-10-0-138-79 kubenswrapper[2553]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 15:10:01.656562 ip-10-0-138-79 kubenswrapper[2553]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 30 15:10:01.656562 ip-10-0-138-79 kubenswrapper[2553]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 30 15:10:01.657126 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.656619    2553 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 30 15:10:01.660882 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660868    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 15:10:01.660882 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660880    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660884    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660888    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660891    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660893    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660896    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660899    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660902    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660904    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660907    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660910    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660912    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660916    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660919    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660922    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660924    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660927    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660930    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660933    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660935    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 15:10:01.660940 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660938    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660941    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660944    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660946    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660949    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660953    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660955    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660958    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660961    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660963    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660966    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660968    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660971    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660973    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660976    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660978    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660981    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660984    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660987    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 15:10:01.661404 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660989    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660991    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660994    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660997    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.660999    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661003    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661007    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661010    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661013    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661015    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661018    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661020    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661024    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661026    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661029    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661032    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661035    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661037    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661040    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661044    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 15:10:01.661903 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661048    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661077    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661081    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661083    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661087    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661091    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661094    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661097    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661100    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661102    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661105    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661109    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661112    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661115    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661117    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661120    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661123    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661125    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661129    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 15:10:01.662383 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661132    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661136    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661139    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661141    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661145    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661147    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661150    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661153    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661156    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661158    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661161    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661164    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661167    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661169    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661172    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661175    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661177    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661180    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661182    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.661185    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 15:10:01.662857 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662804    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662812    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662815    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662819    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662821    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662824    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662827    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662830    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662833    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662836    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662838    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662841    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662844    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662847    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662849    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662852    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662855    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662857    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662860    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662863    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 15:10:01.663330 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662866    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662869    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662872    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662875    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662877    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662880    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662883    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662885    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662888    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662890    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662893    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662896    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662898    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662901    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662906    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662910    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662913    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662916    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662919    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 15:10:01.663828 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662922    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662924    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662926    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662929    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662931    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662934    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662937    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662939    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662942    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662944    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662947    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662950    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662952    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662955    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662957    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662960    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662962    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662965    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662967    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662970    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 15:10:01.664295 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662972    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662975    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662979    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662982    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662985    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662987    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662990    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662994    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.662997    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663000    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663003    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663008    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663012    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663014    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663017    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663019    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663022    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663025    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663027    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663030    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 15:10:01.664825 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663032    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663035    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663038    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663040    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663043    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663046    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663048    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663051    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663053    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663056    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663058    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663061    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663063    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663066    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663068    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663071    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663073    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663075    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663078    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663081    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 15:10:01.665307 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663456    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663462    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663465    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663468    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663474    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663477    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663479    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663482    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663485    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663488    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663490    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663493    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663495    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663499    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663501    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663504    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663506    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663509    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663511    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 15:10:01.665800 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663514    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663517    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663521    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663524    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663527    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663530    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663533    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663536    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663539    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663541    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663544    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663547    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663549    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663551    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663554    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663556    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663559    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663562    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663565    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663567    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 15:10:01.666258 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663570    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663572    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663575    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663577    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663580    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663582    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663585    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663588    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663590    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663593    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663595    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663598    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663600    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663603    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663605    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663608    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663611    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663614    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663616    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663619    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 15:10:01.666762 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663622    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663624    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663627    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663629    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663632    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663634    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663637    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663639    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663642    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663644    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663647    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663649    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663652    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663655    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663657    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663661    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663665    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663668    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663671    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 15:10:01.667237 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663674    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663677    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663679    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663682    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663684    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663687    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663689    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663692    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663695    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663698    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663700    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663703    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663710    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663713    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663715    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663718    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663720    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663725    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663728    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 15:10:01.667747 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663731    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.663734    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663801    2553 flags.go:64] FLAG: --address="0.0.0.0"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663807    2553 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663813    2553 flags.go:64] FLAG: --anonymous-auth="true"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663817    2553 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663821    2553 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663824    2553 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663828    2553 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663835    2553 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663838    2553 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663842    2553 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663845    2553 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663848    2553 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663851    2553 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663854    2553 flags.go:64] FLAG: --cgroup-root=""
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663857    2553 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663859    2553 flags.go:64] FLAG: --client-ca-file=""
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663862    2553 flags.go:64] FLAG: --cloud-provider="external"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663865    2553 flags.go:64] FLAG: --cluster-dns="[]"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663868    2553 flags.go:64] FLAG: --cluster-domain=""
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663871    2553 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663874    2553 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663877    2553 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 30 15:10:01.668194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663880    2553 flags.go:64] FLAG: --container-log-max-files="5"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663884    2553 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663888    2553 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663891    2553 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663894    2553 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663896    2553 flags.go:64] FLAG: --contention-profiling="false"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663899    2553 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663902    2553 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663905    2553 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663908    2553 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663912    2553 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663914    2553 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663921    2553 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663923    2553 flags.go:64] FLAG: --enable-load-reader="false"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663926    2553 flags.go:64] FLAG: --enable-server="true"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663930    2553 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663934    2553 flags.go:64] FLAG: --event-burst="100"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663937    2553 flags.go:64] FLAG: --event-qps="50"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663940    2553 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663943    2553 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663946    2553 flags.go:64] FLAG: --eviction-hard=""
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663949    2553 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663952    2553 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663956    2553 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663959    2553 flags.go:64] FLAG: --eviction-soft=""
Jul 30 15:10:01.668779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663961    2553 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663964    2553 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663967    2553 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663970    2553 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663973    2553 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663976    2553 flags.go:64] FLAG: --fail-swap-on="true"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663978    2553 flags.go:64] FLAG: --feature-gates=""
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663982    2553 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663985    2553 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663989    2553 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663992    2553 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663995    2553 flags.go:64] FLAG: --healthz-port="10248"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.663998    2553 flags.go:64] FLAG: --help="false"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664001    2553 flags.go:64] FLAG: --hostname-override="ip-10-0-138-79.ec2.internal"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664004    2553 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664007    2553 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664009    2553 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664013    2553 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664016    2553 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664020    2553 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664023    2553 flags.go:64] FLAG: --image-service-endpoint=""
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664026    2553 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664029    2553 flags.go:64] FLAG: --kube-api-burst="100"
Jul 30 15:10:01.669358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664032    2553 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664035    2553 flags.go:64] FLAG: --kube-api-qps="50"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664038    2553 flags.go:64] FLAG: --kube-reserved=""
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664041    2553 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664043    2553 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664046    2553 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664049    2553 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664052    2553 flags.go:64] FLAG: --lock-file=""
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664055    2553 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664057    2553 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664060    2553 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664066    2553 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664068    2553 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664071    2553 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664074    2553 flags.go:64] FLAG: --logging-format="text"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664077    2553 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664080    2553 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664083    2553 flags.go:64] FLAG: --manifest-url=""
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664086    2553 flags.go:64] FLAG: --manifest-url-header=""
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664090    2553 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664093    2553 flags.go:64] FLAG: --max-open-files="1000000"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664097    2553 flags.go:64] FLAG: --max-pods="110"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664100    2553 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664103    2553 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664106    2553 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 30 15:10:01.670001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664109    2553 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664111    2553 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664114    2553 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664119    2553 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664125    2553 flags.go:64] FLAG: --node-status-max-images="50"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664128    2553 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664131    2553 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664134    2553 flags.go:64] FLAG: --pod-cidr=""
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664138    2553 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664142    2553 flags.go:64] FLAG: --pod-manifest-path=""
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664145    2553 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664148    2553 flags.go:64] FLAG: --pods-per-core="0"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664151    2553 flags.go:64] FLAG: --port="10250"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664154    2553 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664156    2553 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-095dd91c67ecb5e79"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664159    2553 flags.go:64] FLAG: --qos-reserved=""
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664162    2553 flags.go:64] FLAG: --read-only-port="10255"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664165    2553 flags.go:64] FLAG: --register-node="true"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664168    2553 flags.go:64] FLAG: --register-with-taints=""
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664171    2553 flags.go:64] FLAG: --registry-burst="10"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664174    2553 flags.go:64] FLAG: --registry-qps="5"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664177    2553 flags.go:64] FLAG: --reserved-cpus=""
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664180    2553 flags.go:64] FLAG: --reserved-memory=""
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664183    2553 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664186    2553 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 30 15:10:01.670636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664190    2553 flags.go:64] FLAG: --rotate-certificates="false"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664192    2553 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664195    2553 flags.go:64] FLAG: --runonce="false"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664198    2553 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664201    2553 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664204    2553 flags.go:64] FLAG: --seccomp-default="false"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664206    2553 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664209    2553 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664212    2553 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664215    2553 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664218    2553 flags.go:64] FLAG: --storage-driver-password="root"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664222    2553 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664225    2553 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664228    2553 flags.go:64] FLAG: --storage-driver-user="root"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664231    2553 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664234    2553 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664237    2553 flags.go:64] FLAG: --system-cgroups=""
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664240    2553 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664245    2553 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664248    2553 flags.go:64] FLAG: --tls-cert-file=""
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664250    2553 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664254    2553 flags.go:64] FLAG: --tls-min-version=""
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664256    2553 flags.go:64] FLAG: --tls-private-key-file=""
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664259    2553 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664262    2553 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 30 15:10:01.671225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664265    2553 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664267    2553 flags.go:64] FLAG: --v="2"
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664271    2553 flags.go:64] FLAG: --version="false"
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664275    2553 flags.go:64] FLAG: --vmodule=""
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664278    2553 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.664281    2553 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664389    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664393    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664396    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664399    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664402    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664404    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664407    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664409    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664412    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664427    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664430    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664433    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664436    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664440    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664444    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 15:10:01.671846 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664447    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664449    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664452    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664455    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664458    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664461    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664463    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664466    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664469    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664471    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664474    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664476    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664479    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664482    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664484    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664487    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664490    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664493    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664496    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664498    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 15:10:01.672342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664501    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664504    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664506    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664509    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664511    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664514    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664517    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664520    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664522    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664526    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664529    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664531    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664534    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664536    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664539    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664542    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664545    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664547    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664550    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 15:10:01.672837 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664552    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664556    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664560    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664562    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664565    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664569    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664572    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664575    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664578    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664581    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664584    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664586    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664589    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664592    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664594    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664597    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664599    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664602    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 15:10:01.673292 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664605    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664607    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664610    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664613    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664616    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664619    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664622    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664624    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664627    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664629    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664632    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664634    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664637    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664640    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664643    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664645    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664648    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664650    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664653    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664655    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664658    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 15:10:01.673774 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664660    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664663    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664666    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664669    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664672    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.664675    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.665140    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.672019    2553 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.672034    2553 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.672049    2553 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.672058    2553 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672148    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672152    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672155    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672158    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 15:10:01.674276 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672162    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672167    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672170    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672173    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672176    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672178    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672181    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672183    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672186    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672189    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672191    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672194    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672196    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672199    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672201    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672204    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672206    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672209    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672211    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672214    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 15:10:01.674745 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672217    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672220    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672222    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672225    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672227    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672239    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672242    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672244    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672246    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672249    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672251    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672254    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672256    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672259    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672263    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672266    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672269    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672272    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672275    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 15:10:01.675218 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672278    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672280    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672283    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672285    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672287    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672290    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672293    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672295    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672298    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672300    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672303    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672305    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672307    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672310    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672313    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672315    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672317    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672320    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672322    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672330    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 15:10:01.675671 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672333    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672335    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672338    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672340    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672343    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672346    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672349    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672351    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672354    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672356    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672359    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672361    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672364    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672366    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672369    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672371    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672375    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672378    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672381    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 15:10:01.676157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672384    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672386    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672389    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672391    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672394    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672396    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672399    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672402    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672404    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672407    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672409    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672412    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672414    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672438    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672441    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672444    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 15:10:01.676614 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672446    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.672451    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672602    2553 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672606    2553 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672609    2553 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672612    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672615    2553 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672618    2553 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672620    2553 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672623    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672626    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672628    2553 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672630    2553 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672633    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672636    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 30 15:10:01.677022 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672638    2553 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672641    2553 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672643    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672646    2553 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672648    2553 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672651    2553 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672653    2553 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672656    2553 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672658    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672660    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672663    2553 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672665    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672668    2553 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672670    2553 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672673    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672680    2553 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672683    2553 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672686    2553 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672688    2553 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672691    2553 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 30 15:10:01.677373 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672693    2553 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672696    2553 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672698    2553 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672701    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672703    2553 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672705    2553 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672708    2553 feature_gate.go:328] unrecognized feature gate: Example2
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672711    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672713    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672716    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672718    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672721    2553 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672723    2553 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672726    2553 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672728    2553 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672731    2553 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672733    2553 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672737    2553 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672740    2553 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 30 15:10:01.677954 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672743    2553 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672745    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672748    2553 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672751    2553 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672753    2553 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672756    2553 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672759    2553 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672762    2553 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672764    2553 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672773    2553 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672776    2553 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672778    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672781    2553 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672785    2553 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672788    2553 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672790    2553 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672792    2553 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672795    2553 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672798    2553 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 30 15:10:01.678398 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672802    2553 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672805    2553 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672807    2553 feature_gate.go:328] unrecognized feature gate: Example
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672810    2553 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672813    2553 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672816    2553 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672818    2553 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672821    2553 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672825    2553 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672828    2553 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672830    2553 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672832    2553 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672835    2553 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672837    2553 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672840    2553 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672843    2553 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672845    2553 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672848    2553 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672850    2553 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672855    2553 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 30 15:10:01.678856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672858    2553 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672860    2553 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672863    2553 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672873    2553 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672876    2553 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672878    2553 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672881    2553 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:01.672883    2553 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.672888    2553 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.673017    2553 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.675550    2553 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.676805    2553 server.go:1019] "Starting client certificate rotation"
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.676905    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.676942    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 30 15:10:01.679336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.679206    2553 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 15:10:01.684464 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.684444    2553 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 30 15:10:01.695295 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.695279    2553 log.go:25] "Validated CRI v1 runtime API"
Jul 30 15:10:01.697307 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.697293    2553 log.go:25] "Validated CRI v1 image API"
Jul 30 15:10:01.698096 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.698077    2553 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 30 15:10:01.701849 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.701827    2553 fs.go:135] Filesystem UUIDs: map[1afd051b-7615-4ce2-a9ea-7f63b7d941b4:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 91658d07-7404-4c7e-b190-9429d8b98627:/dev/nvme0n1p3]
Jul 30 15:10:01.701913 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.701850    2553 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 30 15:10:01.704741 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.704723    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 15:10:01.705982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.705878    2553 manager.go:216] Machine: {Timestamp:2026-07-30 15:10:01.705406746 +0000 UTC m=+0.311254839 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3144807 MemoryCapacity:33164484608 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e64f3314dfdc0a5141c7428fa6999 SystemUUID:ec2e64f3-314d-fdc0-a514-1c7428fa6999 BootID:8f1b3934-ec14-46f4-aada-3f696b17db84 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582242304 Type:vfs Inodes:4048399 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0e:54:2d:22:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0e:54:2d:22:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:29:ae:ab:82:fe Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164484608 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 30 15:10:01.705982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.705977    2553 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 30 15:10:01.706081 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.706038    2553 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 30 15:10:01.708962 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.708941    2553 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 30 15:10:01.709093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.708964    2553 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-79.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 30 15:10:01.709665 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.709656    2553 topology_manager.go:138] "Creating topology manager with none policy"
Jul 30 15:10:01.709697 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.709667    2553 container_manager_linux.go:309] "Creating device plugin manager"
Jul 30 15:10:01.709697 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.709674    2553 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 15:10:01.710465 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.710455    2553 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 30 15:10:01.711242 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.711233    2553 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 30 15:10:01.713958 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.713947    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 15:10:01.714094 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714084    2553 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 30 15:10:01.714133 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714115    2553 kubelet.go:486] "Attempting to sync node with API server"
Jul 30 15:10:01.714133 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714124    2553 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 30 15:10:01.714194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714138    2553 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 30 15:10:01.714194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714147    2553 kubelet.go:398] "Adding apiserver pod source"
Jul 30 15:10:01.714194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714155    2553 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 30 15:10:01.714542 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714529    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 15:10:01.714601 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.714553    2553 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 30 15:10:01.721189 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.721167    2553 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 30 15:10:01.722774 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.722761    2553 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 30 15:10:01.722839 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.722795    2553 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 30 15:10:01.724221 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724210    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724225    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724232    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724238    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724249    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724256    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724264    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724269    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724275    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 30 15:10:01.724279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724281    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 30 15:10:01.724617 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724295    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 30 15:10:01.724617 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724300    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 30 15:10:01.724617 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724325    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 30 15:10:01.724617 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.724333    2553 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 30 15:10:01.726982 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.726952    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 30 15:10:01.727071 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.726957    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 30 15:10:01.727071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.726976    2553 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-79.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 30 15:10:01.727477 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.727458    2553 server.go:1268] "Started kubelet"
Jul 30 15:10:01.728116 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.727964    2553 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 30 15:10:01.728116 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.728075    2553 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 30 15:10:01.728259 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.728135    2553 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 30 15:10:01.728217 ip-10-0-138-79 systemd[1]: Started Kubernetes Kubelet.
Jul 30 15:10:01.730319 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.730301    2553 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 30 15:10:01.730551 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.730533    2553 server.go:310] "Adding debug handlers to kubelet server"
Jul 30 15:10:01.734646 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.734624    2553 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 30 15:10:01.735748 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.734995    2553 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-79.ec2.internal.18c719da1558dea8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-79.ec2.internal,UID:ip-10-0-138-79.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-79.ec2.internal,},FirstTimestamp:2026-07-30 15:10:01.72740164 +0000 UTC m=+0.333249735,LastTimestamp:2026-07-30 15:10:01.72740164 +0000 UTC m=+0.333249735,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-79.ec2.internal,}"
Jul 30 15:10:01.738357 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.738340    2553 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 30 15:10:01.738458 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.738362    2553 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 30 15:10:01.738511 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.738489    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:01.739024 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739008    2553 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 30 15:10:01.739557 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739535    2553 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 30 15:10:01.739557 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739558    2553 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 30 15:10:01.739701 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739680    2553 reconstruct.go:97] "Volume reconstruction finished"
Jul 30 15:10:01.739701 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739690    2553 reconciler.go:29] "Reconciler: start to sync state"
Jul 30 15:10:01.739796 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739717    2553 factory.go:153] Registering CRI-O factory
Jul 30 15:10:01.739796 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739729    2553 factory.go:223] Registration of the crio container factory successfully
Jul 30 15:10:01.739796 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739779    2553 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 30 15:10:01.739796 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739788    2553 factory.go:55] Registering systemd factory
Jul 30 15:10:01.739796 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739797    2553 factory.go:223] Registration of the systemd container factory successfully
Jul 30 15:10:01.740025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739798    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2jsbp"
Jul 30 15:10:01.740025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739818    2553 factory.go:103] Registering Raw factory
Jul 30 15:10:01.740025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.739834    2553 manager.go:1196] Started watching for new ooms in manager
Jul 30 15:10:01.740286 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.740270    2553 manager.go:349] Starting recovery of all containers
Jul 30 15:10:01.748233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.748213    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2jsbp"
Jul 30 15:10:01.748372 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.748346    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 30 15:10:01.748587 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.748555    2553 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-79.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 30 15:10:01.750085 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.749975    2553 manager.go:354] Recovery completed
Jul 30 15:10:01.753962 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.753946    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:01.756004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.755986    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:01.756076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.756017    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:01.756076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.756039    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:01.756528 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.756511    2553 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 30 15:10:01.756528 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.756525    2553 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 30 15:10:01.756644 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.756530    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:01.756644 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.756537    2553 state_mem.go:36] "Initialized new in-memory state store"
Jul 30 15:10:01.757568 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.757549    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:01.757663 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.757576    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:01.757663 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.757589    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:01.759221 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.759206    2553 policy_none.go:49] "None policy: Start"
Jul 30 15:10:01.759221 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.759222    2553 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 30 15:10:01.759330 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.759233    2553 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 30 15:10:01.761183 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.761170    2553 policy_none.go:47] "Start"
Jul 30 15:10:01.806007 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.805894    2553 manager.go:337] "Starting Device Plugin manager"
Jul 30 15:10:01.806093 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.806042    2553 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 30 15:10:01.806093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.806056    2553 server.go:87] "Starting device plugin registration server"
Jul 30 15:10:01.806238 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.806227    2553 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 30 15:10:01.806286 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.806238    2553 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 30 15:10:01.806369 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.806349    2553 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 30 15:10:01.806465 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.806454    2553 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 30 15:10:01.806518 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.806467    2553 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 30 15:10:01.806801 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.806784    2553 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 30 15:10:01.806860 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.806834    2553 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:01.906662 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.906607    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:01.908819 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.907453    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:01.908819 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.907475    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:01.908819 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.907485    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:01.908819 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.907506    2553 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-79.ec2.internal"
Jul 30 15:10:01.912959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.912944    2553 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-79.ec2.internal"
Jul 30 15:10:01.913015 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.912964    2553 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-79.ec2.internal\": node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:01.916388 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.916368    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 30 15:10:01.917556 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.917540    2553 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 30 15:10:01.917624 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.917576    2553 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 30 15:10:01.917624 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.917596    2553 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 30 15:10:01.917696 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.917626    2553 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 30 15:10:01.918998 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:01.918978    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 15:10:01.928959 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:01.928943    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.017947 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.017916    2553 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"]
Jul 30 15:10:02.018038 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.017983    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:02.018718 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.018702    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:02.018786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.018728    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:02.018786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.018744    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:02.020888 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.020875    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:02.021003 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.020989    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.021054 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021045    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:02.021593 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021575    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:02.021593 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021586    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:02.021721 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021603    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:02.021721 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021611    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:02.021721 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021614    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:02.021721 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.021623    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:02.023735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.023719    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.023807 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.023745    2553 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 30 15:10:02.024399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.024382    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientMemory"
Jul 30 15:10:02.024485 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.024404    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasNoDiskPressure"
Jul 30 15:10:02.024485 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.024414    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeHasSufficientPID"
Jul 30 15:10:02.029601 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.029586    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.041489 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.041466    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27a73d3d85fd7cafb7f3770fc3d7b112-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal\" (UID: \"27a73d3d85fd7cafb7f3770fc3d7b112\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.041545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.041495    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a73d3d85fd7cafb7f3770fc3d7b112-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal\" (UID: \"27a73d3d85fd7cafb7f3770fc3d7b112\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.041545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.041510    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f20c5851391d507a5ecc4ac9b08f248-config\") pod \"kube-apiserver-proxy-ip-10-0-138-79.ec2.internal\" (UID: \"9f20c5851391d507a5ecc4ac9b08f248\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.054019 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.054000    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-79.ec2.internal\" not found" node="ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.058502 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.058486    2553 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-79.ec2.internal\" not found" node="ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.130645 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.130623    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.141754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.141730    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f20c5851391d507a5ecc4ac9b08f248-config\") pod \"kube-apiserver-proxy-ip-10-0-138-79.ec2.internal\" (UID: \"9f20c5851391d507a5ecc4ac9b08f248\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.141814 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.141757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27a73d3d85fd7cafb7f3770fc3d7b112-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal\" (UID: \"27a73d3d85fd7cafb7f3770fc3d7b112\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.141814 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.141775    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a73d3d85fd7cafb7f3770fc3d7b112-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal\" (UID: \"27a73d3d85fd7cafb7f3770fc3d7b112\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.141895 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.141829    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/27a73d3d85fd7cafb7f3770fc3d7b112-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal\" (UID: \"27a73d3d85fd7cafb7f3770fc3d7b112\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.141895 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.141841    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9f20c5851391d507a5ecc4ac9b08f248-config\") pod \"kube-apiserver-proxy-ip-10-0-138-79.ec2.internal\" (UID: \"9f20c5851391d507a5ecc4ac9b08f248\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.141895 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.141846    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/27a73d3d85fd7cafb7f3770fc3d7b112-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal\" (UID: \"27a73d3d85fd7cafb7f3770fc3d7b112\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.231800 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.231768    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.338390 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.338357    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.357138 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.357111    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.362561 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.362338    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:02.440094 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.440064    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.543917 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.543860    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.644728 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.644707    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.677405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.677378    2553 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 30 15:10:02.677806 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.677539    2553 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 30 15:10:02.744968 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.744941    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.754977 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.754944    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-29 15:05:02 +0000 UTC" deadline="2028-01-11 23:57:03.427741796 +0000 UTC"
Jul 30 15:10:02.754977 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.754972    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12728h47m0.67277293s"
Jul 30 15:10:02.845988 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.845922    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.946999 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:02.946974    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:02.983745 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:02.983725    2553 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 15:10:03.047642 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.047613    2553 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-79.ec2.internal\" not found"
Jul 30 15:10:03.059681 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:03.059654    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f20c5851391d507a5ecc4ac9b08f248.slice/crio-8aad9d11090831c4d28cf24848d839271f814fa18d9584f21162e0ef422a25b5 WatchSource:0}: Error finding container 8aad9d11090831c4d28cf24848d839271f814fa18d9584f21162e0ef422a25b5: Status 404 returned error can't find the container with id 8aad9d11090831c4d28cf24848d839271f814fa18d9584f21162e0ef422a25b5
Jul 30 15:10:03.060124 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:03.060097    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27a73d3d85fd7cafb7f3770fc3d7b112.slice/crio-4ac0cc745918f6cf0ffa30cd60c63483309b1dd0503d603ebf1e5e4458a30861 WatchSource:0}: Error finding container 4ac0cc745918f6cf0ffa30cd60c63483309b1dd0503d603ebf1e5e4458a30861: Status 404 returned error can't find the container with id 4ac0cc745918f6cf0ffa30cd60c63483309b1dd0503d603ebf1e5e4458a30861
Jul 30 15:10:03.066162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.066143    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:10:03.082501 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.082481    2553 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 15:10:03.138769 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.138727    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:03.151938 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.151920    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 15:10:03.152735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.152722    2553 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal"
Jul 30 15:10:03.164997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.164980    2553 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 30 15:10:03.241212 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.241192    2553 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 15:10:03.719481 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.719458    2553 apiserver.go:52] "Watching apiserver"
Jul 30 15:10:03.728320 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.728301    2553 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 30 15:10:03.729555 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.729529    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-jmtsn","openshift-image-registry/node-ca-bnm8k","openshift-multus/multus-zb47k","openshift-multus/network-metrics-daemon-4ql6h","openshift-dns/node-resolver-n8csv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal","openshift-multus/multus-additional-cni-plugins-m2z6f","openshift-network-diagnostics/network-check-target-lbcck","openshift-network-operator/iptables-alerter-tgfh4","openshift-ovn-kubernetes/ovnkube-node-d5cpw","kube-system/global-pull-secret-syncer-bc678","kube-system/konnectivity-agent-j4dkq","kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"]
Jul 30 15:10:03.733712 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.733685    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.735861 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.735839    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.735959 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.735905    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:03.736607 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.736590    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 30 15:10:03.736665 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.736593    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.736930 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.736902    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.737039 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.736958    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b9fwp\""
Jul 30 15:10:03.737039 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.737020    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 30 15:10:03.737160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.736963    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 30 15:10:03.738194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.738174    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.738916 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.738897    2553 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 30 15:10:03.740538 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.740515    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:03.740651 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.740620    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:03.740776 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.740753    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 30 15:10:03.740870 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.740758    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-667p6\""
Jul 30 15:10:03.742927 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.742910    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.745147 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.745128    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zxdsg\""
Jul 30 15:10:03.745275 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.745257    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.745500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.745373    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.745500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.745422    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.747748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.747729    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.749046 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.749025    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-phm5d\""
Jul 30 15:10:03.749521 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.749481    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.749924 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.749901    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 30 15:10:03.750166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.750144    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:03.750269 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.750242    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:03.750411 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.750387    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.751390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751099    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.751390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751039    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-socket-dir-parent\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.751390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751170    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.751635 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751468    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-j75hw\""
Jul 30 15:10:03.751635 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751537    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.751635 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751582    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/909befd3-0fad-48d9-b790-e76e33fb190c-kubelet-config\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.751635 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751616    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/909befd3-0fad-48d9-b790-e76e33fb190c-dbus\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.751832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751650    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6597c1c-2cff-4a02-827f-482bdf341713-cni-binary-copy\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.751832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751625    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 30 15:10:03.751832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-k8s-cni-cncf-io\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.751832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751726    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:03.752068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751829    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-cnibin\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751873    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-multus-certs\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751947    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-os-release\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.751994    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-hostroot\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752051    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-conf-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752092    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6597c1c-2cff-4a02-827f-482bdf341713-multus-daemon-config\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752147    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-system-cni-dir\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752202    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752240    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87lsx\" (UniqueName: \"kubernetes.io/projected/8b8a4368-edf6-4c26-b301-c855ca3ea41e-kube-api-access-87lsx\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752289    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-cni-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752551 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752355    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-cni-bin\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752551 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752407    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-cni-multus\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752551 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752463    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-netns\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752551 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752527    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-kubelet\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752572    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-etc-kubernetes\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752600    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx426\" (UniqueName: \"kubernetes.io/projected/b6597c1c-2cff-4a02-827f-482bdf341713-kube-api-access-jx426\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752632    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752666    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.752982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752750    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwsm9\" (UniqueName: \"kubernetes.io/projected/2e81b505-63c6-4eee-8942-9b954f9ecb8a-kube-api-access-lwsm9\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:03.752982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752787    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cnibin\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752818    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.752982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752882    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-system-cni-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.752982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.752914    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-os-release\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.753276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.753253    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.755784 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.755763    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.756182 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.756159    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.756438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.756406    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 30 15:10:03.756525 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.756449    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.758276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.758257    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.759351 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.759331    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kpcjs\""
Jul 30 15:10:03.760800 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.760781    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.764365 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764344    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 30 15:10:03.764489 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764398    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 30 15:10:03.764588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764512    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.764588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764404    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9wgz9\""
Jul 30 15:10:03.764588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764572    2553 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 30 15:10:03.764764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764598    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.764764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.764612    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 30 15:10:03.765071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.765034    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 30 15:10:03.765071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.765054    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p4j4q\""
Jul 30 15:10:03.765307 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.765287    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 30 15:10:03.765971 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.765950    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:10:03.766100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.765953    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 30 15:10:03.766100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.765959    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 30 15:10:03.768381 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.768364    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-cvkbc\""
Jul 30 15:10:03.776236 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.776215    2553 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 30 15:10:03.799641 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.799624    2553 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-2cx2v"
Jul 30 15:10:03.810976 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.810956    2553 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-2cx2v"
Jul 30 15:10:03.840563 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.840525    2553 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 30 15:10:03.853536 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.853506    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.853639 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.853550    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/909befd3-0fad-48d9-b790-e76e33fb190c-dbus\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.853639 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.853586    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6597c1c-2cff-4a02-827f-482bdf341713-cni-binary-copy\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.853997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.853972    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-run\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.854091 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854041    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-multus-certs\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854091 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854044    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/909befd3-0fad-48d9-b790-e76e33fb190c-dbus\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.854203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854097    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0807f165-3bdd-464c-bada-c74e36fd2a98-tmp\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.854203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854099    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-multus-certs\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854133    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95bf1bae-846c-45b2-b5bf-a1c186e910ed-hosts-file\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.854203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854157    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6597c1c-2cff-4a02-827f-482bdf341713-cni-binary-copy\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854385 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854211    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-iptables-alerter-script\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.854385 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854308    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-slash\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.854385 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854370    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-log-socket\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.854552 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854422    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv2k5\" (UniqueName: \"kubernetes.io/projected/5e139a85-656d-49d7-8651-244393bfcea3-kube-api-access-xv2k5\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.854552 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854493    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-hostroot\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854552 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854540    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-conf-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854577    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-system-cni-dir\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.854706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854585    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-hostroot\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854613    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.854706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854653    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-modprobe-d\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.854706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854663    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-conf-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.854965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854731    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-system-cni-dir\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.854965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.854818    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cni-binary-copy\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855163    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-cni-multus\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855197    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9fqc\" (UniqueName: \"kubernetes.io/projected/95bf1bae-846c-45b2-b5bf-a1c186e910ed-kube-api-access-v9fqc\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855227    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-sys\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855264    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-systemd-units\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855296    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e139a85-656d-49d7-8651-244393bfcea3-ovn-node-metrics-cert\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855332    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-kubelet\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855358    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-etc-kubernetes\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855390    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdf9d136-899b-421a-af75-69c5cc8ef63b-konnectivity-ca\") pod \"konnectivity-agent-j4dkq\" (UID: \"cdf9d136-899b-421a-af75-69c5cc8ef63b\") " pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855420    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysctl-conf\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855449    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-var-lib-kubelet\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855477    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-ovnkube-script-lib\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855527    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855563    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855596    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwsm9\" (UniqueName: \"kubernetes.io/projected/2e81b505-63c6-4eee-8942-9b954f9ecb8a-kube-api-access-lwsm9\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855626    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysctl-d\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855655    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-lib-modules\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.856453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855682    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrl9h\" (UniqueName: \"kubernetes.io/projected/0807f165-3bdd-464c-bada-c74e36fd2a98-kube-api-access-nrl9h\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855691    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855713    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vgh94\" (UniqueName: \"kubernetes.io/projected/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-kube-api-access-vgh94\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855763    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855796    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-cni-multus\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855798    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855840    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-system-cni-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855873    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-os-release\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855913    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b227c78-1fec-4950-8021-2f38835c531c-host\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855941    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-etc-selinux\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.855972    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-kubelet\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856001    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-systemd\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856029    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-ovn\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856061    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/909befd3-0fad-48d9-b790-e76e33fb190c-kubelet-config\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856092    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-k8s-cni-cncf-io\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856124    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856162    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6rxq\" (UniqueName: \"kubernetes.io/projected/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-kube-api-access-j6rxq\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.857363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856190    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-host\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856215    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-var-lib-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856226    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856247    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-cnibin\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856311    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5g2d\" (UniqueName: \"kubernetes.io/projected/4b227c78-1fec-4950-8021-2f38835c531c-kube-api-access-w5g2d\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.856411    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856420    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-etc-kubernetes\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856387    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-kubelet\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856494    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-tuned\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856519    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-cnibin\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856637    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.856835    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856837    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-system-cni-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856854    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-k8s-cni-cncf-io\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856872    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/909befd3-0fad-48d9-b790-e76e33fb190c-kubelet-config\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.856794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-os-release\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.856998    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:04.356693588 +0000 UTC m=+2.962541692 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:03.858148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857029    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-registration-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.857090    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:10:04.357063913 +0000 UTC m=+2.962912014 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857141    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-cni-bin\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857176    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-cni-netd\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857232    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857294    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-ovnkube-config\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857759    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-os-release\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857796    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6597c1c-2cff-4a02-827f-482bdf341713-multus-daemon-config\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857825    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-87lsx\" (UniqueName: \"kubernetes.io/projected/8b8a4368-edf6-4c26-b301-c855ca3ea41e-kube-api-access-87lsx\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857853    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-cni-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857879    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-kubernetes\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857904    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-socket-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857923    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-os-release\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.857928    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-run-netns\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858050    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-cni-bin\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858101    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-var-lib-cni-bin\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858134    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdf9d136-899b-421a-af75-69c5cc8ef63b-agent-certs\") pod \"konnectivity-agent-j4dkq\" (UID: \"cdf9d136-899b-421a-af75-69c5cc8ef63b\") " pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858168    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95bf1bae-846c-45b2-b5bf-a1c186e910ed-tmp-dir\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858213    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysconfig\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858240    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-device-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858277    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-etc-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858307    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-netns\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858335    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx426\" (UniqueName: \"kubernetes.io/projected/b6597c1c-2cff-4a02-827f-482bdf341713-kube-api-access-jx426\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858377    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858392    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-host-run-netns\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858411    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-node-log\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858424    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6597c1c-2cff-4a02-827f-482bdf341713-multus-daemon-config\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858467    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858521    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-host-slash\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858482    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-cni-dir\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858548    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cnibin\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858589    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-socket-dir-parent\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858614    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b227c78-1fec-4950-8021-2f38835c531c-serviceca\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.859727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858664    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6597c1c-2cff-4a02-827f-482bdf341713-multus-socket-dir-parent\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.860508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858692    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-systemd\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.860508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858717    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.860508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858707    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8b8a4368-edf6-4c26-b301-c855ca3ea41e-cnibin\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.860508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858738    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-sys-fs\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.860508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.858755    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-env-overrides\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.866392 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.866353    2553 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 30 15:10:03.870187 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.870157    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwsm9\" (UniqueName: \"kubernetes.io/projected/2e81b505-63c6-4eee-8942-9b954f9ecb8a-kube-api-access-lwsm9\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:03.870273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.870183    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx426\" (UniqueName: \"kubernetes.io/projected/b6597c1c-2cff-4a02-827f-482bdf341713-kube-api-access-jx426\") pod \"multus-zb47k\" (UID: \"b6597c1c-2cff-4a02-827f-482bdf341713\") " pod="openshift-multus/multus-zb47k"
Jul 30 15:10:03.870417 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.870400    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-87lsx\" (UniqueName: \"kubernetes.io/projected/8b8a4368-edf6-4c26-b301-c855ca3ea41e-kube-api-access-87lsx\") pod \"multus-additional-cni-plugins-m2z6f\" (UID: \"8b8a4368-edf6-4c26-b301-c855ca3ea41e\") " pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:03.923497 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.923431    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal" event={"ID":"9f20c5851391d507a5ecc4ac9b08f248","Type":"ContainerStarted","Data":"8aad9d11090831c4d28cf24848d839271f814fa18d9584f21162e0ef422a25b5"}
Jul 30 15:10:03.925378 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.925351    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal" event={"ID":"27a73d3d85fd7cafb7f3770fc3d7b112","Type":"ContainerStarted","Data":"4ac0cc745918f6cf0ffa30cd60c63483309b1dd0503d603ebf1e5e4458a30861"}
Jul 30 15:10:03.959045 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959018    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-run-netns\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959061    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdf9d136-899b-421a-af75-69c5cc8ef63b-agent-certs\") pod \"konnectivity-agent-j4dkq\" (UID: \"cdf9d136-899b-421a-af75-69c5cc8ef63b\") " pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.959150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959087    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95bf1bae-846c-45b2-b5bf-a1c186e910ed-tmp-dir\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.959150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959113    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysconfig\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.959150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959139    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-device-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959149    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-run-netns\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959164    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-etc-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959198    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959225    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-node-log\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959253    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959271    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-host-slash\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959295    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b227c78-1fec-4950-8021-2f38835c531c-serviceca\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959320    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-systemd\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.959380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959370    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-sys-fs\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959395    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-env-overrides\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959440    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-run\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959465    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/95bf1bae-846c-45b2-b5bf-a1c186e910ed-tmp-dir\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959481    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0807f165-3bdd-464c-bada-c74e36fd2a98-tmp\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959508    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95bf1bae-846c-45b2-b5bf-a1c186e910ed-hosts-file\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959526    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-run-ovn-kubernetes\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959534    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-iptables-alerter-script\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959581    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-slash\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959634    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-log-socket\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959663    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv2k5\" (UniqueName: \"kubernetes.io/projected/5e139a85-656d-49d7-8651-244393bfcea3-kube-api-access-xv2k5\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959694    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-modprobe-d\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959700    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-sys-fs\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959704    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-etc-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959721    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v9fqc\" (UniqueName: \"kubernetes.io/projected/95bf1bae-846c-45b2-b5bf-a1c186e910ed-kube-api-access-v9fqc\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959753    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-sys\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959759    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-device-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959781    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-systemd-units\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.959934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959805    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-host-slash\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959808    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e139a85-656d-49d7-8651-244393bfcea3-ovn-node-metrics-cert\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.959856    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-run\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960058    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-node-log\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960072    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-iptables-alerter-script\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960109    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-slash\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960148    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-log-socket\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960286    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4b227c78-1fec-4950-8021-2f38835c531c-serviceca\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960300    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960347    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysconfig\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-systemd\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960442    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-sys\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960448    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-systemd-units\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960458    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-modprobe-d\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960495    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdf9d136-899b-421a-af75-69c5cc8ef63b-konnectivity-ca\") pod \"konnectivity-agent-j4dkq\" (UID: \"cdf9d136-899b-421a-af75-69c5cc8ef63b\") " pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960528    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysctl-conf\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960541    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/95bf1bae-846c-45b2-b5bf-a1c186e910ed-hosts-file\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960552    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-var-lib-kubelet\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.960862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960681    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysctl-conf\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960695    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-ovnkube-script-lib\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960737    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-var-lib-kubelet\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960743    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysctl-d\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960768    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-lib-modules\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960777    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-env-overrides\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960793    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrl9h\" (UniqueName: \"kubernetes.io/projected/0807f165-3bdd-464c-bada-c74e36fd2a98-kube-api-access-nrl9h\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960819    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vgh94\" (UniqueName: \"kubernetes.io/projected/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-kube-api-access-vgh94\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960851    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960878    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b227c78-1fec-4950-8021-2f38835c531c-host\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960903    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-etc-selinux\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960928    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-kubelet\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960952    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-systemd\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960956    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-lib-modules\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.960978    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-ovn\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961019    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j6rxq\" (UniqueName: \"kubernetes.io/projected/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-kube-api-access-j6rxq\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961043    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-host\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.961764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961063    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-sysctl-d\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961069    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-var-lib-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961096    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cdf9d136-899b-421a-af75-69c5cc8ef63b-konnectivity-ca\") pod \"konnectivity-agent-j4dkq\" (UID: \"cdf9d136-899b-421a-af75-69c5cc8ef63b\") " pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961187    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4b227c78-1fec-4950-8021-2f38835c531c-host\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961248    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-var-lib-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961248    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-openvswitch\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961281    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5g2d\" (UniqueName: \"kubernetes.io/projected/4b227c78-1fec-4950-8021-2f38835c531c-kube-api-access-w5g2d\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961302    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-host\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961309    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-tuned\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961336    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-registration-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961344    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-etc-selinux\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961365    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-cni-bin\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-systemd\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961390    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-cni-netd\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961397    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-kubelet\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961416    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-run-ovn\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961427    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.962735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961456    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-cni-bin\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961467    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-ovnkube-config\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961265    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-ovnkube-script-lib\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961519    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-kubernetes\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961470    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961535    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-registration-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961547    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-socket-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961521    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/5e139a85-656d-49d7-8651-244393bfcea3-host-cni-netd\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961584    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-kubernetes\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.961670    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-socket-dir\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.963618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.962014    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/5e139a85-656d-49d7-8651-244393bfcea3-ovnkube-config\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.964950 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.964779    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0807f165-3bdd-464c-bada-c74e36fd2a98-etc-tuned\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.964950 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.964916    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0807f165-3bdd-464c-bada-c74e36fd2a98-tmp\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.965119 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.964961    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/5e139a85-656d-49d7-8651-244393bfcea3-ovn-node-metrics-cert\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.965258 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.965232    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cdf9d136-899b-421a-af75-69c5cc8ef63b-agent-certs\") pod \"konnectivity-agent-j4dkq\" (UID: \"cdf9d136-899b-421a-af75-69c5cc8ef63b\") " pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:03.966345 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.966222    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:03.966345 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.966256    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:03.966345 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.966269    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:03.966345 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:03.966342    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:04.466323789 +0000 UTC m=+3.072171873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:03.972088 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.972001    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv2k5\" (UniqueName: \"kubernetes.io/projected/5e139a85-656d-49d7-8651-244393bfcea3-kube-api-access-xv2k5\") pod \"ovnkube-node-d5cpw\" (UID: \"5e139a85-656d-49d7-8651-244393bfcea3\") " pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:03.972088 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.972032    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5g2d\" (UniqueName: \"kubernetes.io/projected/4b227c78-1fec-4950-8021-2f38835c531c-kube-api-access-w5g2d\") pod \"node-ca-bnm8k\" (UID: \"4b227c78-1fec-4950-8021-2f38835c531c\") " pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:03.972249 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.972101    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vgh94\" (UniqueName: \"kubernetes.io/projected/c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27-kube-api-access-vgh94\") pod \"aws-ebs-csi-driver-node-rl5hw\" (UID: \"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:03.972325 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.972307    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9fqc\" (UniqueName: \"kubernetes.io/projected/95bf1bae-846c-45b2-b5bf-a1c186e910ed-kube-api-access-v9fqc\") pod \"node-resolver-n8csv\" (UID: \"95bf1bae-846c-45b2-b5bf-a1c186e910ed\") " pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:03.972915 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.972866    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrl9h\" (UniqueName: \"kubernetes.io/projected/0807f165-3bdd-464c-bada-c74e36fd2a98-kube-api-access-nrl9h\") pod \"tuned-jmtsn\" (UID: \"0807f165-3bdd-464c-bada-c74e36fd2a98\") " pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:03.973749 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:03.973689    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6rxq\" (UniqueName: \"kubernetes.io/projected/cb3cd735-38f6-4c75-9cba-c5a80f57ecfe-kube-api-access-j6rxq\") pod \"iptables-alerter-tgfh4\" (UID: \"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe\") " pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:04.044094 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.044062    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-m2z6f"
Jul 30 15:10:04.052558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.052538    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zb47k"
Jul 30 15:10:04.055861 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:04.055830    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b8a4368_edf6_4c26_b301_c855ca3ea41e.slice/crio-4b786a6606e459fcc973048db73893576663ac3c07b4c9eb48ca02e3158dc163 WatchSource:0}: Error finding container 4b786a6606e459fcc973048db73893576663ac3c07b4c9eb48ca02e3158dc163: Status 404 returned error can't find the container with id 4b786a6606e459fcc973048db73893576663ac3c07b4c9eb48ca02e3158dc163
Jul 30 15:10:04.063124 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.062880    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-n8csv"
Jul 30 15:10:04.068019 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.067839    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw"
Jul 30 15:10:04.075072 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.075039    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-tgfh4"
Jul 30 15:10:04.080275 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:04.080232    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95bf1bae_846c_45b2_b5bf_a1c186e910ed.slice/crio-7c6baab7f6c97bc1672ffaee96197945b96d1a5f9bf3ad2c35e5249b3f2b02be WatchSource:0}: Error finding container 7c6baab7f6c97bc1672ffaee96197945b96d1a5f9bf3ad2c35e5249b3f2b02be: Status 404 returned error can't find the container with id 7c6baab7f6c97bc1672ffaee96197945b96d1a5f9bf3ad2c35e5249b3f2b02be
Jul 30 15:10:04.081294 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.080960    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bnm8k"
Jul 30 15:10:04.087693 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.087028    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:04.093544 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.093346    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jmtsn"
Jul 30 15:10:04.098262 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.098113    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:04.101067 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:04.100984    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b227c78_1fec_4950_8021_2f38835c531c.slice/crio-cb86d79ecfd057b1baa60745f85b084c094342fbe9335ede178fc8ed80050b82 WatchSource:0}: Error finding container cb86d79ecfd057b1baa60745f85b084c094342fbe9335ede178fc8ed80050b82: Status 404 returned error can't find the container with id cb86d79ecfd057b1baa60745f85b084c094342fbe9335ede178fc8ed80050b82
Jul 30 15:10:04.111682 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:04.111646    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e139a85_656d_49d7_8651_244393bfcea3.slice/crio-f916319e8542cc857190ed5c11a7014a9c3fedf2217febcae040525f18263496 WatchSource:0}: Error finding container f916319e8542cc857190ed5c11a7014a9c3fedf2217febcae040525f18263496: Status 404 returned error can't find the container with id f916319e8542cc857190ed5c11a7014a9c3fedf2217febcae040525f18263496
Jul 30 15:10:04.116616 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:04.116568    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0807f165_3bdd_464c_bada_c74e36fd2a98.slice/crio-297217fb0f46b6c5a07ae68d96e92d2f7c497aab5aa2dbf281f3e5550ea960b9 WatchSource:0}: Error finding container 297217fb0f46b6c5a07ae68d96e92d2f7c497aab5aa2dbf281f3e5550ea960b9: Status 404 returned error can't find the container with id 297217fb0f46b6c5a07ae68d96e92d2f7c497aab5aa2dbf281f3e5550ea960b9
Jul 30 15:10:04.365754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.365648    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:04.365754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.365709    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:04.365967 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.365823    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:04.365967 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.365826    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:04.365967 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.365886    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:10:05.365866746 +0000 UTC m=+3.971714845 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:04.365967 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.365906    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:05.36589655 +0000 UTC m=+3.971744634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:04.467006 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.466971    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:04.467191 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.467173    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:04.467262 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.467198    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:04.467262 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.467212    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:04.467381 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.467275    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:05.46725586 +0000 UTC m=+4.073103964 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:04.814985 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.814921    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 15:05:04 +0000 UTC" deadline="2028-04-19 23:19:48.051560782 +0000 UTC"
Jul 30 15:10:04.814985 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.814979    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15104h9m43.236585991s"
Jul 30 15:10:04.918794 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.918765    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:04.918941 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:04.918891    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:04.928387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.928356    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zb47k" event={"ID":"b6597c1c-2cff-4a02-827f-482bdf341713","Type":"ContainerStarted","Data":"e5c023924bd5cc6ee85a58c8202f20f91e30d938db95d684ca66f3251d7f7b76"}
Jul 30 15:10:04.929700 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.929670    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jmtsn" event={"ID":"0807f165-3bdd-464c-bada-c74e36fd2a98","Type":"ContainerStarted","Data":"297217fb0f46b6c5a07ae68d96e92d2f7c497aab5aa2dbf281f3e5550ea960b9"}
Jul 30 15:10:04.931403 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.931369    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"f916319e8542cc857190ed5c11a7014a9c3fedf2217febcae040525f18263496"}
Jul 30 15:10:04.932763 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.932738    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bnm8k" event={"ID":"4b227c78-1fec-4950-8021-2f38835c531c","Type":"ContainerStarted","Data":"cb86d79ecfd057b1baa60745f85b084c094342fbe9335ede178fc8ed80050b82"}
Jul 30 15:10:04.934010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.933961    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tgfh4" event={"ID":"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe","Type":"ContainerStarted","Data":"e951acd893aca782887a2b160fd83b6c520b221b908f1776c9e50e7d0fd2618c"}
Jul 30 15:10:04.935367 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.935284    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerStarted","Data":"4b786a6606e459fcc973048db73893576663ac3c07b4c9eb48ca02e3158dc163"}
Jul 30 15:10:04.936631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.936601    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4dkq" event={"ID":"cdf9d136-899b-421a-af75-69c5cc8ef63b","Type":"ContainerStarted","Data":"f7df850285b57bfe3cb6b4eb8585d4c4cd9ba3cd937ff758794974730e9bfdf2"}
Jul 30 15:10:04.938011 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.937986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw" event={"ID":"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27","Type":"ContainerStarted","Data":"9f4f03337cf40f5716f3f3fbbec99d51f24960b1369ed010360db94325701eb9"}
Jul 30 15:10:04.939353 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:04.939319    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8csv" event={"ID":"95bf1bae-846c-45b2-b5bf-a1c186e910ed","Type":"ContainerStarted","Data":"7c6baab7f6c97bc1672ffaee96197945b96d1a5f9bf3ad2c35e5249b3f2b02be"}
Jul 30 15:10:05.377685 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.377646    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:05.377883 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.377749    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:05.377968 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.377894    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:05.377968 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.377960    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:07.377939501 +0000 UTC m=+5.983787635 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:05.378492 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.378471    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:05.378594 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.378542    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:10:07.378525417 +0000 UTC m=+5.984373506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:05.478102 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.478067    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:05.478276 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.478237    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:05.478276 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.478259    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:05.478276 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.478274    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:05.478463 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.478331    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:07.478313194 +0000 UTC m=+6.084161301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:05.815907 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.815833    2553 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-29 15:05:04 +0000 UTC" deadline="2028-01-15 09:24:01.965078511 +0000 UTC"
Jul 30 15:10:05.815907 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.815882    2553 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12810h13m56.149202887s"
Jul 30 15:10:05.920524 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.919698    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:05.920524 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.920071    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:05.920524 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.920449    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:05.920929 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:05.920886    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:05.946102 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.946072    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal" event={"ID":"9f20c5851391d507a5ecc4ac9b08f248","Type":"ContainerStarted","Data":"10a65b1f8c6ce11be5dda2b10dac36e7483036d91fc7cd5a6e12b172e8835157"}
Jul 30 15:10:05.963485 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:05.963286    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-79.ec2.internal" podStartSLOduration=2.963266248 podStartE2EDuration="2.963266248s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:05.962743755 +0000 UTC m=+4.568591863" watchObservedRunningTime="2026-07-30 15:10:05.963266248 +0000 UTC m=+4.569114356"
Jul 30 15:10:06.919328 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:06.918812    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:06.919328 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:06.918944    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:06.956839 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:06.956561    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal" event={"ID":"27a73d3d85fd7cafb7f3770fc3d7b112","Type":"ContainerStarted","Data":"3006d8a24b5394c2370991fc605fb3fed07324f2eeb563d49db3c6becce48ac0"}
Jul 30 15:10:07.400832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:07.400000    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:07.400832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:07.400052    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:07.400832 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.400187    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:07.400832 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.400248    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:10:11.400228988 +0000 UTC m=+10.006077072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:07.400832 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.400695    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:07.400832 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.400751    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:11.400734632 +0000 UTC m=+10.006582718 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:07.500401 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:07.500364    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:07.500618 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.500596    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:07.500618 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.500620    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:07.500767 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.500633    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:07.500767 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.500692    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:11.50067322 +0000 UTC m=+10.106521321 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:07.918595 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:07.918566    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:07.918820 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:07.918598    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:07.918820 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.918733    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:07.918939 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:07.918862    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:08.918863 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:08.918564    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:08.918863 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:08.918690    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:09.919480 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:09.919364    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:09.919972 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:09.919537    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:09.919972 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:09.919892    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:09.920115 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:09.919995    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:09.970292 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:09.969724    2553 generic.go:356] "Generic (PLEG): container finished" podID="27a73d3d85fd7cafb7f3770fc3d7b112" containerID="3006d8a24b5394c2370991fc605fb3fed07324f2eeb563d49db3c6becce48ac0" exitCode=0
Jul 30 15:10:09.970292 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:09.969764    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal" event={"ID":"27a73d3d85fd7cafb7f3770fc3d7b112","Type":"ContainerDied","Data":"3006d8a24b5394c2370991fc605fb3fed07324f2eeb563d49db3c6becce48ac0"}
Jul 30 15:10:10.918183 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:10.918143    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:10.918342 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:10.918281    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:11.434781 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:11.434248    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:11.434781 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:11.434360    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:11.434781 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.434381    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:11.434781 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.434458    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:19.434437118 +0000 UTC m=+18.040285200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:11.434781 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.434520    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:11.434781 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.434582    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:10:19.434564334 +0000 UTC m=+18.040412425 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:11.535668 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:11.535116    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:11.535668 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.535277    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:11.535668 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.535298    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:11.535668 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.535310    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:11.535668 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.535360    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:19.535343754 +0000 UTC m=+18.141191851 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:11.919545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:11.918899    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:11.919545 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.919027    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:11.919545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:11.919390    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:11.919545 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:11.919500    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:12.918495 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:12.918435    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:12.918923 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:12.918552    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:13.919162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:13.918556    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:13.919162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:13.918608    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:13.919162 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:13.918713    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:13.919162 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:13.919121    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:14.918735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:14.918709    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:14.918902 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:14.918801    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:15.917928 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:15.917894    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:15.917928 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:15.917906    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:15.918399 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:15.918017    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:15.918399 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:15.918164    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:16.918654 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:16.918622    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:16.919103 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:16.918735    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:17.918883 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:17.918844    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:17.919339 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:17.918956    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:17.919339 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:17.918997    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:17.919339 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:17.919049    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:18.918197 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:18.918171    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:18.918327 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:18.918255    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:19.497048 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:19.497017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:19.497048 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:19.497061    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:19.497549 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.497168    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:19.497549 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.497179    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:19.497549 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.497234    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:10:35.497214151 +0000 UTC m=+34.103062255 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:19.497549 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.497255    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:35.497244685 +0000 UTC m=+34.103092769 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:19.598064 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:19.598032    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:19.598223 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.598205    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:19.598272 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.598230    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:19.598272 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.598242    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:19.598343 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.598300    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:35.598280708 +0000 UTC m=+34.204128805 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:19.918698 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:19.918676    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:19.918698 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:19.918693    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:19.918923 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.918786    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:19.918976 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:19.918929    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:20.918259 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:20.918220    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:20.918775 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:20.918337    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:21.918666 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:21.918629    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:21.919123 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:21.918720    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:21.919123 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:21.918808    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:21.919123 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:21.918929    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:22.918043 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:22.918008    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:22.918191 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:22.918134    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:23.918435 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:23.918283    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:23.919055 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:23.918282    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:23.919055 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:23.918515    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:23.919055 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:23.918580    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:23.993387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:23.993136    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zb47k" event={"ID":"b6597c1c-2cff-4a02-827f-482bdf341713","Type":"ContainerStarted","Data":"091553bf7e49258ac7809ca94a58074cfb3a5f995db62163a7f2d5d2c2302a69"}
Jul 30 15:10:23.995474 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:23.995449    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal" event={"ID":"27a73d3d85fd7cafb7f3770fc3d7b112","Type":"ContainerStarted","Data":"cc4834077df28471bb5c162a0a744db45324971bfb968c69b649f60ffd0cf875"}
Jul 30 15:10:23.997242 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:23.997220    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jmtsn" event={"ID":"0807f165-3bdd-464c-bada-c74e36fd2a98","Type":"ContainerStarted","Data":"9c4545a5ca76d2841e022ba59f7b8b975835141357236076fe8b8b37faf9689b"}
Jul 30 15:10:23.998897 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:23.998874    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"761b85f038a3e7f3c8c883cf4a1bb04ec9b5f472389baded79279b9c82f031bf"}
Jul 30 15:10:24.003452 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.003391    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bnm8k" event={"ID":"4b227c78-1fec-4950-8021-2f38835c531c","Type":"ContainerStarted","Data":"de5809980245246762bedac989e34d9d2cfb2821a96f1f57e58c21b40faacb53"}
Jul 30 15:10:24.005569 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.005544    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b8a4368-edf6-4c26-b301-c855ca3ea41e" containerID="e288ffe9b4672d15ca3a2de8e5d6665cbbfd5cb1e915734fdb2eea2bca893eed" exitCode=0
Jul 30 15:10:24.005684 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.005620    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerDied","Data":"e288ffe9b4672d15ca3a2de8e5d6665cbbfd5cb1e915734fdb2eea2bca893eed"}
Jul 30 15:10:24.007532 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.007509    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j4dkq" event={"ID":"cdf9d136-899b-421a-af75-69c5cc8ef63b","Type":"ContainerStarted","Data":"e64e4100348cc0d6f386c08785971747e978fbd5d8ce9af5b0087acb05af6836"}
Jul 30 15:10:24.009143 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.009121    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw" event={"ID":"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27","Type":"ContainerStarted","Data":"719050c2feaf5f298797934e357efa56b0defa39bd8f3377c5ffcc6a3938430e"}
Jul 30 15:10:24.010655 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.010632    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-n8csv" event={"ID":"95bf1bae-846c-45b2-b5bf-a1c186e910ed","Type":"ContainerStarted","Data":"350988e15300f0bf5888f66bc3db58bc533e1bde35c51a5ac074dc4d530955f8"}
Jul 30 15:10:24.012751 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.012709    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zb47k" podStartSLOduration=2.744433528 podStartE2EDuration="22.012693149s" totalImagesPullingTime="19.268259621s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:24.012681995 +0000 UTC m=+22.618530097" watchObservedRunningTime="2026-07-30 15:10:24.012693149 +0000 UTC m=+22.618541254"
Jul 30 15:10:24.035968 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.035929    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-n8csv" podStartSLOduration=2.795347418 podStartE2EDuration="22.035918438s" totalImagesPullingTime="19.24057102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:24.035897348 +0000 UTC m=+22.641745450" watchObservedRunningTime="2026-07-30 15:10:24.035918438 +0000 UTC m=+22.641766540"
Jul 30 15:10:24.052070 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.052039    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bnm8k" podStartSLOduration=2.831792754 podStartE2EDuration="22.052027753s" totalImagesPullingTime="19.220234999s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:24.051472453 +0000 UTC m=+22.657320556" watchObservedRunningTime="2026-07-30 15:10:24.052027753 +0000 UTC m=+22.657875856"
Jul 30 15:10:24.114040 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.113976    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j4dkq" podStartSLOduration=7.375104469 podStartE2EDuration="22.113964049s" totalImagesPullingTime="14.73885958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:24.113880271 +0000 UTC m=+22.719728375" watchObservedRunningTime="2026-07-30 15:10:24.113964049 +0000 UTC m=+22.719812183"
Jul 30 15:10:24.114235 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.114162    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jmtsn" podStartSLOduration=2.906435693 podStartE2EDuration="22.114153653s" totalImagesPullingTime="19.20771796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:24.085514026 +0000 UTC m=+22.691362129" watchObservedRunningTime="2026-07-30 15:10:24.114153653 +0000 UTC m=+22.720001757"
Jul 30 15:10:24.129268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.129145    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-79.ec2.internal" podStartSLOduration=21.129130999 podStartE2EDuration="21.129130999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:24.12908745 +0000 UTC m=+22.734935554" watchObservedRunningTime="2026-07-30 15:10:24.129130999 +0000 UTC m=+22.734979103"
Jul 30 15:10:24.180948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.180837    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:24.241852 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.241825    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:24.874388 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.874172    2553 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 30 15:10:24.918189 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:24.918155    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:24.918340 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:24.918278    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:25.017761 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.017683    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw" event={"ID":"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27","Type":"ContainerStarted","Data":"2e9cfee7e56e6214ca95bbe43d986e81d68d6d6a21a26f4dbd28e0959cd0ea12"}
Jul 30 15:10:25.021404 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.021376    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"69f5fcd288c7fd89bfd8c9c4afe2deff51663ccc5b2cd9c0cfd3aa5199603fc9"}
Jul 30 15:10:25.021527 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.021458    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"c001a0d95fc873cb3ec28d18303680d29748b058966941e162096885a98ff1a3"}
Jul 30 15:10:25.021527 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.021502    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"74a2bbaf07429904ff488cc24af32bd5b5f4b3222369b4e37a95d7c54b94183d"}
Jul 30 15:10:25.021634 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.021543    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"490f5d6b409ed7994d000655b7ebb1205a97b3712de0059eb2b1ecee227f907c"}
Jul 30 15:10:25.021634 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.021571    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"176e4a10abb5a817b72d53a89e935e64d5369817558c4de097ee4e503bcd2fb8"}
Jul 30 15:10:25.022983 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.022937    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-tgfh4" event={"ID":"cb3cd735-38f6-4c75-9cba-c5a80f57ecfe","Type":"ContainerStarted","Data":"4354f607b57e3ca8e5311bfade0e6d82202a7096fe6b3f2ad918b1f0a76ad0ff"}
Jul 30 15:10:25.039985 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.039948    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-tgfh4" podStartSLOduration=3.816235474 podStartE2EDuration="23.0399352s" totalImagesPullingTime="19.223699726s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:25.039795623 +0000 UTC m=+23.645643717" watchObservedRunningTime="2026-07-30 15:10:25.0399352 +0000 UTC m=+23.645783304"
Jul 30 15:10:25.163283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.163253    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:25.224092 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.224064    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:25.830525 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.830435    2553 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-30T15:10:24.874189563Z","UUID":"25068c2c-aea0-4a2d-90d2-75a9b7b96f2f","Handler":null,"Name":"","Endpoint":""}
Jul 30 15:10:25.833925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.833898    2553 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 30 15:10:25.834064 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.833943    2553 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 30 15:10:25.917933 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.917905    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:25.918136 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:25.917955    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:25.918136 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:25.918034    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:25.918256 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:25.918168    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:26.918052 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:26.917881    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:26.918494 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:26.918137    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:27.029831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:27.029802    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw" event={"ID":"c3dc4e9f-7bd7-4e9a-a77a-6101fbcecf27","Type":"ContainerStarted","Data":"be1a111fd8884f0097e07ca2341fff11886adb2d1e0b172aa814bf4a5add31c0"}
Jul 30 15:10:27.048005 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:27.047955    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rl5hw" podStartSLOduration=7.826265556 podStartE2EDuration="25.047941464s" totalImagesPullingTime="17.221675908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:27.047607763 +0000 UTC m=+25.653455867" watchObservedRunningTime="2026-07-30 15:10:27.047941464 +0000 UTC m=+25.653789567"
Jul 30 15:10:27.289997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:27.289967    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:27.290651 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:27.290632    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:27.918115 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:27.918089    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:27.918115 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:27.918115    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:27.918747 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:27.918206    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:27.918747 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:27.918328    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:28.031748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:28.031720    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:28.032174 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:28.032158    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j4dkq"
Jul 30 15:10:28.105288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:28.105259    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:28.918116 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:28.918048    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:28.918249 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:28.918146    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:29.036103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:29.036070    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"42ef66e83bfa1a6f04043c227c147ae3109d8b3764915cfa442e9dbb0b1132cc"}
Jul 30 15:10:29.037659 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:29.037633    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b8a4368-edf6-4c26-b301-c855ca3ea41e" containerID="7aabffa80ad95092ad954521d225b239a992551d5d515d2f438597b942a55017" exitCode=0
Jul 30 15:10:29.037747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:29.037715    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerDied","Data":"7aabffa80ad95092ad954521d225b239a992551d5d515d2f438597b942a55017"}
Jul 30 15:10:29.918405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:29.918375    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:29.918893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:29.918380    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:29.918893 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:29.918540    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:29.918893 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:29.918602    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:30.918867 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:30.918689    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:30.919351 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:30.918988    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:31.047604 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.047568    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" event={"ID":"5e139a85-656d-49d7-8651-244393bfcea3","Type":"ContainerStarted","Data":"5f88effee919d4c8c439e57de50f4128a917be76e2608694d9d3a520ff7598d5"}
Jul 30 15:10:31.047704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.047682    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:31.047801 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.047787    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:31.049672 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.049649    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b8a4368-edf6-4c26-b301-c855ca3ea41e" containerID="4083fb4c1469a925369b0683f11752e2d38358cab4e6fbfe5559dc461d655b5b" exitCode=0
Jul 30 15:10:31.049796 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.049679    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerDied","Data":"4083fb4c1469a925369b0683f11752e2d38358cab4e6fbfe5559dc461d655b5b"}
Jul 30 15:10:31.063927 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.063910    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:31.079380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.079332    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw" podStartSLOduration=9.337600573 podStartE2EDuration="29.079320822s" totalImagesPullingTime="19.741720249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:31.078915539 +0000 UTC m=+29.684763642" watchObservedRunningTime="2026-07-30 15:10:31.079320822 +0000 UTC m=+29.685168925"
Jul 30 15:10:31.919363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.919330    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:31.919903 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:31.919441    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:31.919903 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:31.919462    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:31.919903 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:31.919502    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:32.053835 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.053811    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:32.071719 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.071698    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:10:32.890041 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.889809    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bc678"]
Jul 30 15:10:32.890156 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.890142    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:32.890273 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:32.890253    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:32.899896 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.899851    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbcck"]
Jul 30 15:10:32.900061 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.899961    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:32.900154 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:32.900053    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:32.900501 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.900482    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4ql6h"]
Jul 30 15:10:32.900598 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:32.900573    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:32.900697 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:32.900672    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:33.057573 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:33.057546    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b8a4368-edf6-4c26-b301-c855ca3ea41e" containerID="f13e5cd3239d5d7a97e83db485fa38fc8483682691648e79b7fe7c05e346917e" exitCode=0
Jul 30 15:10:33.057981 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:33.057628    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerDied","Data":"f13e5cd3239d5d7a97e83db485fa38fc8483682691648e79b7fe7c05e346917e"}
Jul 30 15:10:34.503044 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:34.503012    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:34.603206 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:34.603178    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:34.917850 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:34.917783    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:34.917989 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:34.917783    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:34.917989 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:34.917877    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:34.917989 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:34.917965    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:34.917989 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:34.917784    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:34.918150 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:34.918066    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:35.519669 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:35.519632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:35.520261 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:35.519681    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:35.520261 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.519780    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:35.520261 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.519781    2553 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:35.520261 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.519853    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:11:07.519822965 +0000 UTC m=+66.125671065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 30 15:10:35.520261 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.519872    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret podName:909befd3-0fad-48d9-b790-e76e33fb190c nodeName:}" failed. No retries permitted until 2026-07-30 15:11:07.519862635 +0000 UTC m=+66.125710731 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret") pod "global-pull-secret-syncer-bc678" (UID: "909befd3-0fad-48d9-b790-e76e33fb190c") : object "kube-system"/"original-pull-secret" not registered
Jul 30 15:10:35.620197 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:35.620172    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:35.620323 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.620309    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 30 15:10:35.620359 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.620327    2553 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 30 15:10:35.620359 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.620336    2553 projected.go:196] Error preparing data for projected volume kube-api-access-v98nv for pod openshift-network-diagnostics/network-check-target-lbcck: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:35.620447 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:35.620380    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv podName:4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:07.620365499 +0000 UTC m=+66.226213589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v98nv" (UniqueName: "kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv") pod "network-check-target-lbcck" (UID: "4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 30 15:10:36.918500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:36.918473    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:36.918996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:36.918471    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:36.918996 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:36.918606    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-4ql6h" podUID="2e81b505-63c6-4eee-8942-9b954f9ecb8a"
Jul 30 15:10:36.918996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:36.918473    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:36.918996 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:36.918644    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lbcck" podUID="4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3"
Jul 30 15:10:36.918996 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:36.918719    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bc678" podUID="909befd3-0fad-48d9-b790-e76e33fb190c"
Jul 30 15:10:37.214284 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.214211    2553 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-79.ec2.internal" event="NodeReady"
Jul 30 15:10:37.214451 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.214332    2553 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 30 15:10:37.285310 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.285282    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-jf8wf"]
Jul 30 15:10:37.290229 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.290210    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.293789 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.293764    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 30 15:10:37.293909 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.293795    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7hzbg\""
Jul 30 15:10:37.293909 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.293820    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 30 15:10:37.297704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.297671    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ntn92"]
Jul 30 15:10:37.301021 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.300926    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jf8wf"]
Jul 30 15:10:37.301021 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.301021    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.303752 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.303731    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 30 15:10:37.303752 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.303746    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 30 15:10:37.304243 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.304227    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hpfnt\""
Jul 30 15:10:37.304455 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.304439    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 30 15:10:37.320504 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.320484    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ntn92"]
Jul 30 15:10:37.433368 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.433329    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.433541 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.433394    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3fa587a-1963-44df-9636-941c31324ef0-cert\") pod \"ingress-canary-ntn92\" (UID: \"b3fa587a-1963-44df-9636-941c31324ef0\") " pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.433541 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.433469    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbcfm\" (UniqueName: \"kubernetes.io/projected/b3fa587a-1963-44df-9636-941c31324ef0-kube-api-access-pbcfm\") pod \"ingress-canary-ntn92\" (UID: \"b3fa587a-1963-44df-9636-941c31324ef0\") " pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.433541 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.433498    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lhj4w\" (UniqueName: \"kubernetes.io/projected/9205b071-5e6c-4644-b14a-637631d49163-kube-api-access-lhj4w\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.433698 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.433547    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9205b071-5e6c-4644-b14a-637631d49163-config-volume\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.433698 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.433584    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9205b071-5e6c-4644-b14a-637631d49163-tmp-dir\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.458056 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.458034    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:37.534760 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.534737    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.534854 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.534793    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3fa587a-1963-44df-9636-941c31324ef0-cert\") pod \"ingress-canary-ntn92\" (UID: \"b3fa587a-1963-44df-9636-941c31324ef0\") " pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.534854 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.534816    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbcfm\" (UniqueName: \"kubernetes.io/projected/b3fa587a-1963-44df-9636-941c31324ef0-kube-api-access-pbcfm\") pod \"ingress-canary-ntn92\" (UID: \"b3fa587a-1963-44df-9636-941c31324ef0\") " pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.534854 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.534833    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lhj4w\" (UniqueName: \"kubernetes.io/projected/9205b071-5e6c-4644-b14a-637631d49163-kube-api-access-lhj4w\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.534854 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:37.534844    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:10:37.535050 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.534856    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9205b071-5e6c-4644-b14a-637631d49163-config-volume\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.535050 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.534882    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9205b071-5e6c-4644-b14a-637631d49163-tmp-dir\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.535050 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:37.534901    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:38.034882984 +0000 UTC m=+36.640731082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:10:37.535206 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.535126    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9205b071-5e6c-4644-b14a-637631d49163-tmp-dir\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.535585 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.535550    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/9205b071-5e6c-4644-b14a-637631d49163-config-volume\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.539750 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.539730    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b3fa587a-1963-44df-9636-941c31324ef0-cert\") pod \"ingress-canary-ntn92\" (UID: \"b3fa587a-1963-44df-9636-941c31324ef0\") " pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.547965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.547945    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lhj4w\" (UniqueName: \"kubernetes.io/projected/9205b071-5e6c-4644-b14a-637631d49163-kube-api-access-lhj4w\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:37.548260 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.548219    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbcfm\" (UniqueName: \"kubernetes.io/projected/b3fa587a-1963-44df-9636-941c31324ef0-kube-api-access-pbcfm\") pod \"ingress-canary-ntn92\" (UID: \"b3fa587a-1963-44df-9636-941c31324ef0\") " pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.558390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.558371    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:37.611040 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.611011    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ntn92"
Jul 30 15:10:37.743400 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:37.743379    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ntn92"]
Jul 30 15:10:37.746112 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:37.746080    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3fa587a_1963_44df_9636_941c31324ef0.slice/crio-cbb576a784587b442523c55abbe00e55247f04a18eb857ed3ef0c4e3205412e5 WatchSource:0}: Error finding container cbb576a784587b442523c55abbe00e55247f04a18eb857ed3ef0c4e3205412e5: Status 404 returned error can't find the container with id cbb576a784587b442523c55abbe00e55247f04a18eb857ed3ef0c4e3205412e5
Jul 30 15:10:38.039497 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.039447    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:38.039946 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:38.039551    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:10:38.039946 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:38.039599    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:39.039584259 +0000 UTC m=+37.645432340 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:10:38.071360 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.071328    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b8a4368-edf6-4c26-b301-c855ca3ea41e" containerID="3388c56bbe8ad6e3f78821b5b13cbf8be9e00cb866167283aba0ab2658a3701c" exitCode=0
Jul 30 15:10:38.071471 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.071404    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerDied","Data":"3388c56bbe8ad6e3f78821b5b13cbf8be9e00cb866167283aba0ab2658a3701c"}
Jul 30 15:10:38.072671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.072648    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ntn92" event={"ID":"b3fa587a-1963-44df-9636-941c31324ef0","Type":"ContainerStarted","Data":"cbb576a784587b442523c55abbe00e55247f04a18eb857ed3ef0c4e3205412e5"}
Jul 30 15:10:38.918229 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.918167    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:10:38.918337 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.918171    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:10:38.918337 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.918288    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:10:38.920880 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.920858    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 15:10:38.920989 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.920866    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvhp8\""
Jul 30 15:10:38.920989 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.920901    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 15:10:38.922002 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.921978    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 30 15:10:38.922101 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.922001    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 30 15:10:38.922177 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:38.922100    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-52dkp\""
Jul 30 15:10:39.046100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:39.046074    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:39.046348 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:39.046208    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:10:39.046348 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:39.046264    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:41.046247023 +0000 UTC m=+39.652095106 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:10:39.078265 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:39.078240    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b8a4368-edf6-4c26-b301-c855ca3ea41e" containerID="ece6a51e7b66609f609a35ca7cc3c12adec5c7948f0f736426b1637b036ba1a7" exitCode=0
Jul 30 15:10:39.078367 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:39.078284    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerDied","Data":"ece6a51e7b66609f609a35ca7cc3c12adec5c7948f0f736426b1637b036ba1a7"}
Jul 30 15:10:40.084516 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:40.084474    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" event={"ID":"8b8a4368-edf6-4c26-b301-c855ca3ea41e","Type":"ContainerStarted","Data":"e365dfe55ccee11e8d02bf08cd3db93f880a4262a3d9b0330f4905be86dee90f"}
Jul 30 15:10:40.109087 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:40.109050    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-m2z6f" podStartSLOduration=7.751932988 podStartE2EDuration="38.10903643s" totalImagesPullingTime="30.357103442s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:40.108824316 +0000 UTC m=+38.714672413" watchObservedRunningTime="2026-07-30 15:10:40.10903643 +0000 UTC m=+38.714884532"
Jul 30 15:10:40.433730 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:40.433700    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:40.534451 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:40.534404    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:40.757229 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:40.757155    2553 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log" limit=1024
Jul 30 15:10:41.062018 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:41.061946    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:41.062164 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:41.062099    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:10:41.062227 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:41.062172    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:45.062151271 +0000 UTC m=+43.667999370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:10:42.090115 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:42.090041    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ntn92" event={"ID":"b3fa587a-1963-44df-9636-941c31324ef0","Type":"ContainerStarted","Data":"2db73519396d363a707f5efb13c34748e022dcecfc1720e6e1e5a2275033f5e6"}
Jul 30 15:10:44.394826 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.394756    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ntn92" podStartSLOduration=3.46019327 podStartE2EDuration="7.394737074s" totalImagesPullingTime="3.934543804s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:42.112195559 +0000 UTC m=+40.718043663" watchObservedRunningTime="2026-07-30 15:10:44.394737074 +0000 UTC m=+43.000585234"
Jul 30 15:10:44.396955 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.396914    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"]
Jul 30 15:10:44.429611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.429587    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"]
Jul 30 15:10:44.429730 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.429673    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.434156 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.434124    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 30 15:10:44.434455 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.434439    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 30 15:10:44.435622 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.435594    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 30 15:10:44.435622 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.435606    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mc4m2\""
Jul 30 15:10:44.435817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.435632    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 30 15:10:44.533614 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.533588    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"]
Jul 30 15:10:44.551540 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.551518    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-rlzmh"]
Jul 30 15:10:44.551656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.551637    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.554468 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.554449    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 30 15:10:44.556494 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.556477    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:10:44.556648 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.556602    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 30 15:10:44.556888 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.556868    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 30 15:10:44.571442 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.571405    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rwzdc\""
Jul 30 15:10:44.575554 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.575533    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cntsg"]
Jul 30 15:10:44.575668 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.575646    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.578672 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.578652    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 30 15:10:44.578773 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.578693    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 30 15:10:44.578837 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.578793    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 30 15:10:44.580058 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.580042    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-ww8gv\""
Jul 30 15:10:44.580308 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.580277    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 30 15:10:44.583961 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.583938    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.584063 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.583994    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.584127 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.584062    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4d6gp\" (UniqueName: \"kubernetes.io/projected/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-kube-api-access-4d6gp\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.584329 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.584314    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 30 15:10:44.589589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.589574    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"]
Jul 30 15:10:44.589689 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.589675    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.592504 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.592488    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:10:44.592727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.592696    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 30 15:10:44.592951 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.592877    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 30 15:10:44.593710 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.593697    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 30 15:10:44.594482 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.594465    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-nn77q\""
Jul 30 15:10:44.598314 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.598298    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 30 15:10:44.605648 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.605631    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"]
Jul 30 15:10:44.605753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.605739    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"
Jul 30 15:10:44.609800 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.609530    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 30 15:10:44.609800 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.609783    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:10:44.610555 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.610536    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-49gz8\""
Jul 30 15:10:44.615750 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.615734    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-rlzmh"]
Jul 30 15:10:44.615831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.615758    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"]
Jul 30 15:10:44.615831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.615774    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"]
Jul 30 15:10:44.615831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.615797    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"]
Jul 30 15:10:44.615831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.615813    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"]
Jul 30 15:10:44.615964 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.615911    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:44.618797 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.618777    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 30 15:10:44.618891 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.618846    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjjj2\""
Jul 30 15:10:44.618891 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.618877    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:10:44.618997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.618898    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 30 15:10:44.629892 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.629877    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cntsg"]
Jul 30 15:10:44.629965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.629906    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"]
Jul 30 15:10:44.629965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.629926    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6d9dd87d74-vvl2l"]
Jul 30 15:10:44.630076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.629981    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"
Jul 30 15:10:44.633307 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.633293    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-hml56\""
Jul 30 15:10:44.641917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.641901    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6d9dd87d74-vvl2l"]
Jul 30 15:10:44.641995 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.641970    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.645911 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.645868    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 30 15:10:44.645911 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.645872    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9t9xr\""
Jul 30 15:10:44.646409 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.646388    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 30 15:10:44.646979 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.646963    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 30 15:10:44.653672 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.653657    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 30 15:10:44.684716 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684693    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b19855-054c-4406-a764-aa3856e1059c-tmp\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.684808 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684727    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b19855-054c-4406-a764-aa3856e1059c-serving-cert\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.684808 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684763    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.684916 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684826    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c8b19855-054c-4406-a764-aa3856e1059c-snapshots\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.684916 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684856    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3721f541-44ab-4c63-bf92-5c72093a2f97-config\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.684916 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.684864    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:44.684916 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684879    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.684916 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684909    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3721f541-44ab-4c63-bf92-5c72093a2f97-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.685171 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.684923    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:45.184905121 +0000 UTC m=+43.790753208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:44.685171 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684960    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b19855-054c-4406-a764-aa3856e1059c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.685171 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.684985    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b19855-054c-4406-a764-aa3856e1059c-service-ca-bundle\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.685171 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.685009    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzvzm\" (UniqueName: \"kubernetes.io/projected/c8b19855-054c-4406-a764-aa3856e1059c-kube-api-access-mzvzm\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.685171 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.685042    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4ttc\" (UniqueName: \"kubernetes.io/projected/3721f541-44ab-4c63-bf92-5c72093a2f97-kube-api-access-w4ttc\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.685171 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.685082    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4d6gp\" (UniqueName: \"kubernetes.io/projected/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-kube-api-access-4d6gp\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.685538 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.685521    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.697032 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.697007    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4d6gp\" (UniqueName: \"kubernetes.io/projected/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-kube-api-access-4d6gp\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:44.786149 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786124    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c8b19855-054c-4406-a764-aa3856e1059c-snapshots\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786165    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-config\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.786287 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786267    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3721f541-44ab-4c63-bf92-5c72093a2f97-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.786330 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786291    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b19855-054c-4406-a764-aa3856e1059c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786330 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786316    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-image-registry-private-configuration\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786404 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786332    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-serving-cert\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.786472 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786384    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2h4f5\" (UniqueName: \"kubernetes.io/projected/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-kube-api-access-2h4f5\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:44.786472 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786455    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-bound-sa-token\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786479    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3721f541-44ab-4c63-bf92-5c72093a2f97-config\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.786559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786499    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bvdx\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-kube-api-access-5bvdx\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786517    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdnbn\" (UniqueName: \"kubernetes.io/projected/61720f39-b98d-4ca4-aa55-0bfb8593f79e-kube-api-access-qdnbn\") pod \"network-check-source-7d88cb55d8-mnwh8\" (UID: \"61720f39-b98d-4ca4-aa55-0bfb8593f79e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"
Jul 30 15:10:44.786559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786538    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-installation-pull-secrets\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786571    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b19855-054c-4406-a764-aa3856e1059c-service-ca-bundle\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786593    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzvzm\" (UniqueName: \"kubernetes.io/projected/c8b19855-054c-4406-a764-aa3856e1059c-kube-api-access-mzvzm\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786627    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlvst\" (UniqueName: \"kubernetes.io/projected/1eb4ba49-637f-4261-a229-e3aa67553181-kube-api-access-xlvst\") pod \"volume-data-source-validator-549c6d54cf-tgspz\" (UID: \"1eb4ba49-637f-4261-a229-e3aa67553181\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"
Jul 30 15:10:44.786735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786664    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-ca-trust-extracted\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786721    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-certificates\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786741    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/c8b19855-054c-4406-a764-aa3856e1059c-snapshots\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786762    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-trusted-ca\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786792    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4ttc\" (UniqueName: \"kubernetes.io/projected/3721f541-44ab-4c63-bf92-5c72093a2f97-kube-api-access-w4ttc\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786816    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-trusted-ca\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786843    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b19855-054c-4406-a764-aa3856e1059c-tmp\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786872    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b19855-054c-4406-a764-aa3856e1059c-serving-cert\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.786984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.786895    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.787289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.787108    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:44.787289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.787124    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3721f541-44ab-4c63-bf92-5c72093a2f97-config\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.787289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.787148    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2fs5\" (UniqueName: \"kubernetes.io/projected/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-kube-api-access-z2fs5\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.787289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.787193    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c8b19855-054c-4406-a764-aa3856e1059c-tmp\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.787289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.787260    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b19855-054c-4406-a764-aa3856e1059c-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.787479 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.787458    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b19855-054c-4406-a764-aa3856e1059c-service-ca-bundle\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.788642 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.788624    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3721f541-44ab-4c63-bf92-5c72093a2f97-serving-cert\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.789003 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.788986    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b19855-054c-4406-a764-aa3856e1059c-serving-cert\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.795895 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.795873    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzvzm\" (UniqueName: \"kubernetes.io/projected/c8b19855-054c-4406-a764-aa3856e1059c-kube-api-access-mzvzm\") pod \"insights-operator-5885fdb759-rlzmh\" (UID: \"c8b19855-054c-4406-a764-aa3856e1059c\") " pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.796191 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.796175    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4ttc\" (UniqueName: \"kubernetes.io/projected/3721f541-44ab-4c63-bf92-5c72093a2f97-kube-api-access-w4ttc\") pod \"service-ca-operator-5d6c75f84f-ltwcr\" (UID: \"3721f541-44ab-4c63-bf92-5c72093a2f97\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.860258 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.860239    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"
Jul 30 15:10:44.885410 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.885390    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-rlzmh"
Jul 30 15:10:44.887657 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887641    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2h4f5\" (UniqueName: \"kubernetes.io/projected/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-kube-api-access-2h4f5\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:44.887705 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887679    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-bound-sa-token\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.887705 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887697    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bvdx\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-kube-api-access-5bvdx\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.887777 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887716    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdnbn\" (UniqueName: \"kubernetes.io/projected/61720f39-b98d-4ca4-aa55-0bfb8593f79e-kube-api-access-qdnbn\") pod \"network-check-source-7d88cb55d8-mnwh8\" (UID: \"61720f39-b98d-4ca4-aa55-0bfb8593f79e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"
Jul 30 15:10:44.887777 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887733    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-installation-pull-secrets\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.887777 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887765    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlvst\" (UniqueName: \"kubernetes.io/projected/1eb4ba49-637f-4261-a229-e3aa67553181-kube-api-access-xlvst\") pod \"volume-data-source-validator-549c6d54cf-tgspz\" (UID: \"1eb4ba49-637f-4261-a229-e3aa67553181\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"
Jul 30 15:10:44.887925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887780    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-ca-trust-extracted\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.887925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887797    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-certificates\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.887925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887814    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-trusted-ca\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.887925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887835    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-trusted-ca\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.887925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.887875    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.887950    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.887966    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.888009    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:45.38799253 +0000 UTC m=+43.993840626 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888026    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888053    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2fs5\" (UniqueName: \"kubernetes.io/projected/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-kube-api-access-z2fs5\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888119    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-config\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888158    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-image-registry-private-configuration\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888183    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-serving-cert\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.888232 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.888197    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:10:44.888711 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:44.888258    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:45.388242315 +0000 UTC m=+43.994090399 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:10:44.888711 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888196    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-ca-trust-extracted\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.888711 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888618    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-certificates\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.888847 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888781    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-trusted-ca\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.888907 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888848    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-trusted-ca\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.888907 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.888866    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-config\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.890484 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.890464    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-image-registry-private-configuration\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.890558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.890549    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-serving-cert\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.890614 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.890599    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-installation-pull-secrets\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.897774 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.897727    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdnbn\" (UniqueName: \"kubernetes.io/projected/61720f39-b98d-4ca4-aa55-0bfb8593f79e-kube-api-access-qdnbn\") pod \"network-check-source-7d88cb55d8-mnwh8\" (UID: \"61720f39-b98d-4ca4-aa55-0bfb8593f79e\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"
Jul 30 15:10:44.898148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.898128    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bvdx\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-kube-api-access-5bvdx\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.898988 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.898965    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlvst\" (UniqueName: \"kubernetes.io/projected/1eb4ba49-637f-4261-a229-e3aa67553181-kube-api-access-xlvst\") pod \"volume-data-source-validator-549c6d54cf-tgspz\" (UID: \"1eb4ba49-637f-4261-a229-e3aa67553181\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"
Jul 30 15:10:44.899081 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.899012    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-bound-sa-token\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:44.900160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.900142    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2fs5\" (UniqueName: \"kubernetes.io/projected/8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb-kube-api-access-z2fs5\") pod \"console-operator-584dcb6b54-cntsg\" (UID: \"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb\") " pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:44.900749 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.900732    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2h4f5\" (UniqueName: \"kubernetes.io/projected/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-kube-api-access-2h4f5\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:44.915152 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.915134    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"
Jul 30 15:10:44.937965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:44.937943    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"
Jul 30 15:10:45.035324 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.035299    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr"]
Jul 30 15:10:45.037155 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:45.037096    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3721f541_44ab_4c63_bf92_5c72093a2f97.slice/crio-fe59f30e9b01575c118284b6ba1ebd258e3eb975385641fe8dde40abda66919a WatchSource:0}: Error finding container fe59f30e9b01575c118284b6ba1ebd258e3eb975385641fe8dde40abda66919a: Status 404 returned error can't find the container with id fe59f30e9b01575c118284b6ba1ebd258e3eb975385641fe8dde40abda66919a
Jul 30 15:10:45.088507 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.088382    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-rlzmh"]
Jul 30 15:10:45.089753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.089718    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:45.089888 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.089870    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:10:45.089950 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.089937    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:53.089920214 +0000 UTC m=+51.695768294 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:10:45.091342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:45.091289    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b19855_054c_4406_a764_aa3856e1059c.slice/crio-936a2269dc257fb759b5191fc63c80e412254a238900a8dd0f9d185ad9574075 WatchSource:0}: Error finding container 936a2269dc257fb759b5191fc63c80e412254a238900a8dd0f9d185ad9574075: Status 404 returned error can't find the container with id 936a2269dc257fb759b5191fc63c80e412254a238900a8dd0f9d185ad9574075
Jul 30 15:10:45.097949 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.097906    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" event={"ID":"3721f541-44ab-4c63-bf92-5c72093a2f97","Type":"ContainerStarted","Data":"fe59f30e9b01575c118284b6ba1ebd258e3eb975385641fe8dde40abda66919a"}
Jul 30 15:10:45.099860 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.099783    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rlzmh" event={"ID":"c8b19855-054c-4406-a764-aa3856e1059c","Type":"ContainerStarted","Data":"936a2269dc257fb759b5191fc63c80e412254a238900a8dd0f9d185ad9574075"}
Jul 30 15:10:45.127808 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.127789    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz"]
Jul 30 15:10:45.129758 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:45.129739    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1eb4ba49_637f_4261_a229_e3aa67553181.slice/crio-21a908098e225d8c982bc0057423c8d38cb6fbc07fcd06c9bfd7fdba9643ded8 WatchSource:0}: Error finding container 21a908098e225d8c982bc0057423c8d38cb6fbc07fcd06c9bfd7fdba9643ded8: Status 404 returned error can't find the container with id 21a908098e225d8c982bc0057423c8d38cb6fbc07fcd06c9bfd7fdba9643ded8
Jul 30 15:10:45.145994 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.145975    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8"]
Jul 30 15:10:45.148647 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:45.148591    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61720f39_b98d_4ca4_aa55_0bfb8593f79e.slice/crio-a26180a1491f7c3ad8ba271fca3ca879e4b0c486199403910abb9aaf5469f79e WatchSource:0}: Error finding container a26180a1491f7c3ad8ba271fca3ca879e4b0c486199403910abb9aaf5469f79e: Status 404 returned error can't find the container with id a26180a1491f7c3ad8ba271fca3ca879e4b0c486199403910abb9aaf5469f79e
Jul 30 15:10:45.191017 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.190991    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:45.191120 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.191106    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:45.191160 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.191155    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:46.191141575 +0000 UTC m=+44.796989656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:45.198043 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.198026    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:45.348345 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.348322    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-cntsg"]
Jul 30 15:10:45.350063 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:10:45.350037    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a15885c_7aa3_4aed_8d7c_eebcfd4fc7fb.slice/crio-fa103a59250ffa751aa0cdbe9e9e1a1d7b760ebe23f166aaaf336bc700c5536e WatchSource:0}: Error finding container fa103a59250ffa751aa0cdbe9e9e1a1d7b760ebe23f166aaaf336bc700c5536e: Status 404 returned error can't find the container with id fa103a59250ffa751aa0cdbe9e9e1a1d7b760ebe23f166aaaf336bc700c5536e
Jul 30 15:10:45.393282 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.393256    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:45.393370 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:45.393288    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:45.393411 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.393397    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:10:45.393465 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.393415    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:10:45.393465 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.393438    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:10:45.393522 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.393474    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:46.393460032 +0000 UTC m=+44.999308113 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:10:45.393522 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:45.393487    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:46.393481026 +0000 UTC m=+44.999329107 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:10:46.104734 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:46.104690    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8" event={"ID":"61720f39-b98d-4ca4-aa55-0bfb8593f79e","Type":"ContainerStarted","Data":"a26180a1491f7c3ad8ba271fca3ca879e4b0c486199403910abb9aaf5469f79e"}
Jul 30 15:10:46.106298 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:46.106270    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz" event={"ID":"1eb4ba49-637f-4261-a229-e3aa67553181","Type":"ContainerStarted","Data":"21a908098e225d8c982bc0057423c8d38cb6fbc07fcd06c9bfd7fdba9643ded8"}
Jul 30 15:10:46.108020 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:46.107849    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" event={"ID":"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb","Type":"ContainerStarted","Data":"fa103a59250ffa751aa0cdbe9e9e1a1d7b760ebe23f166aaaf336bc700c5536e"}
Jul 30 15:10:46.199235 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:46.199099    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:46.199235 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.199227    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:46.199456 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.199318    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:48.199294657 +0000 UTC m=+46.805142753 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:46.400434 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:46.400302    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:46.400587 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:46.400465    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:46.400587 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.400477    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:10:46.400587 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.400495    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:10:46.400587 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.400537    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:10:46.400587 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.400553    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:48.400534557 +0000 UTC m=+47.006382659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:10:46.400839 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:46.400613    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:48.40059473 +0000 UTC m=+47.006442811 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:10:47.112158 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:47.112082    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz" event={"ID":"1eb4ba49-637f-4261-a229-e3aa67553181","Type":"ContainerStarted","Data":"66bfb59cbb3ef50b92242d7fe7cafcce3c31df882c6bc44c39ac863bdbdc66b8"}
Jul 30 15:10:47.131716 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:47.131664    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-tgspz" podStartSLOduration=1.446318246 podStartE2EDuration="3.131648095s" totalImagesPullingTime="1.685329849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:47.130817091 +0000 UTC m=+45.736665194" watchObservedRunningTime="2026-07-30 15:10:47.131648095 +0000 UTC m=+45.737496198"
Jul 30 15:10:48.219239 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:48.219204    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:48.219728 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.219396    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:48.219728 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.219491    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:52.219469308 +0000 UTC m=+50.825317403 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:48.420667 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:48.420630    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:48.420833 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:48.420681    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:48.420833 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.420792    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:10:48.420833 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.420815    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:10:48.420976 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.420850    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:10:48.420976 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.420888    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:52.4208728 +0000 UTC m=+51.026720882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:10:48.420976 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:48.420903    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:10:52.420897156 +0000 UTC m=+51.026745237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:10:50.121245 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.121211    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rlzmh" event={"ID":"c8b19855-054c-4406-a764-aa3856e1059c","Type":"ContainerStarted","Data":"2a6818adf89d2ef496571cc60ed4883074aa517911c7478778b3cc585495a7c0"}
Jul 30 15:10:50.124624 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.124604    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8" event={"ID":"61720f39-b98d-4ca4-aa55-0bfb8593f79e","Type":"ContainerStarted","Data":"eaab6033f80de80b821ebfd1915c9fd514175b8f4f9fd91174537e9b5942608b"}
Jul 30 15:10:50.161194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.161133    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-rlzmh" podStartSLOduration=1.296929402 podStartE2EDuration="6.16111235s" totalImagesPullingTime="4.864182948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:50.140902321 +0000 UTC m=+48.746750425" watchObservedRunningTime="2026-07-30 15:10:50.16111235 +0000 UTC m=+48.766960454"
Jul 30 15:10:50.879100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.879046    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-mnwh8" podStartSLOduration=2.071966116 podStartE2EDuration="6.879028169s" totalImagesPullingTime="4.807062053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:10:50.161755328 +0000 UTC m=+48.767603423" watchObservedRunningTime="2026-07-30 15:10:50.879028169 +0000 UTC m=+49.484876250"
Jul 30 15:10:50.879724 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.879705    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wx5tb"]
Jul 30 15:10:50.903113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.903091    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wx5tb"]
Jul 30 15:10:50.903239 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.903199    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:50.906240 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.906214    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6v78w\""
Jul 30 15:10:50.906240 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.906226    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 30 15:10:50.906408 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.906267    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 30 15:10:50.940874 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.940853    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:50.940996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.940929    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26755\" (UniqueName: \"kubernetes.io/projected/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-api-access-26755\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:50.940996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.940964    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f47b2b-28fe-40c7-84aa-8b880ab14679-data-volume\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:50.941102 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.941001    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7f47b2b-28fe-40c7-84aa-8b880ab14679-crio-socket\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:50.941102 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:50.941074    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.041907 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.041878    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f47b2b-28fe-40c7-84aa-8b880ab14679-data-volume\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042035 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.041925    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7f47b2b-28fe-40c7-84aa-8b880ab14679-crio-socket\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.042060    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.042075    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b7f47b2b-28fe-40c7-84aa-8b880ab14679-crio-socket\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042194 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.042155    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 15:10:51.042251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.042188    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042251 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.042211    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:51.542196527 +0000 UTC m=+50.148044609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : configmap "kube-rbac-proxy" not found
Jul 30 15:10:51.042251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.042231    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b7f47b2b-28fe-40c7-84aa-8b880ab14679-data-volume\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.042242    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26755\" (UniqueName: \"kubernetes.io/projected/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-api-access-26755\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.042392 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.042274    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:51.042392 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.042330    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:51.542315907 +0000 UTC m=+50.148163995 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:51.066790 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.066764    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26755\" (UniqueName: \"kubernetes.io/projected/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-api-access-26755\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.128304 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.128281    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/0.log"
Jul 30 15:10:51.128603 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.128323    2553 generic.go:356] "Generic (PLEG): container finished" podID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb" containerID="6f1c9426fb74153a127b88786542a709793f59fda87f01a00e0d2239ed6b14c4" exitCode=255
Jul 30 15:10:51.128603 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.128410    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" event={"ID":"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb","Type":"ContainerDied","Data":"6f1c9426fb74153a127b88786542a709793f59fda87f01a00e0d2239ed6b14c4"}
Jul 30 15:10:51.128603 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.128596    2553 scope.go:117] "RemoveContainer" containerID="6f1c9426fb74153a127b88786542a709793f59fda87f01a00e0d2239ed6b14c4"
Jul 30 15:10:51.548220 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.548182    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.548380 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.548305    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 15:10:51.548380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:51.548359    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:51.548380 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.548369    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:52.548354675 +0000 UTC m=+51.154202759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : configmap "kube-rbac-proxy" not found
Jul 30 15:10:51.548503 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.548493    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:51.548548 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:51.548538    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:52.548526774 +0000 UTC m=+51.154374855 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:52.135957 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.135933    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/1.log"
Jul 30 15:10:52.136365 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.136349    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/0.log"
Jul 30 15:10:52.136408 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.136389    2553 generic.go:356] "Generic (PLEG): container finished" podID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb" containerID="36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1" exitCode=255
Jul 30 15:10:52.136462 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.136441    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" event={"ID":"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb","Type":"ContainerDied","Data":"36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1"}
Jul 30 15:10:52.136538 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.136526    2553 scope.go:117] "RemoveContainer" containerID="6f1c9426fb74153a127b88786542a709793f59fda87f01a00e0d2239ed6b14c4"
Jul 30 15:10:52.136740 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.136727    2553 scope.go:117] "RemoveContainer" containerID="36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1"
Jul 30 15:10:52.136888 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.136871    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:10:52.252690 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.252667    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:10:52.252920 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.252890    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:52.253041 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.252964    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:00.252942494 +0000 UTC m=+58.858790574 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:10:52.454415 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.454389    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:10:52.454562 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.454437    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:10:52.454562 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.454526    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:10:52.454562 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.454547    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:10:52.454724 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.454579    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:10:52.454724 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.454608    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:00.454589393 +0000 UTC m=+59.060437475 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:10:52.454724 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.454632    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:11:00.454619203 +0000 UTC m=+59.060467284 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:10:52.554764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.554742    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:52.554895 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:52.554842    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:52.554895 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.554866    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 15:10:52.554978 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.554929    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:54.554915909 +0000 UTC m=+53.160763993 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : configmap "kube-rbac-proxy" not found
Jul 30 15:10:52.554978 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.554964    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:52.555054 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:52.555014    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:54.55500354 +0000 UTC m=+53.160851621 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:53.140954 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:53.140931    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/1.log"
Jul 30 15:10:53.141463 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:53.141335    2553 scope.go:117] "RemoveContainer" containerID="36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1"
Jul 30 15:10:53.141528 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:53.141509    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:10:53.160155 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:53.160132    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:10:53.160284 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:53.160266    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:10:53.160351 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:53.160326    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:09.160309104 +0000 UTC m=+67.766157186 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:10:53.449166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:53.449144    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8csv_95bf1bae-846c-45b2-b5bf-a1c186e910ed/dns-node-resolver/0.log"
Jul 30 15:10:54.049405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:54.049379    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bnm8k_4b227c78-1fec-4950-8021-2f38835c531c/node-ca/0.log"
Jul 30 15:10:54.570298 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:54.570268    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:54.570674 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:54.570340    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:54.570674 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:54.570414    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 15:10:54.570674 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:54.570457    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:54.570674 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:54.570512    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:58.57049569 +0000 UTC m=+57.176343771 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:54.570674 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:54.570528    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:10:58.570521803 +0000 UTC m=+57.176369884 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : configmap "kube-rbac-proxy" not found
Jul 30 15:10:55.048225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:55.048200    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntn92_b3fa587a-1963-44df-9636-941c31324ef0/serve-healthcheck-canary/0.log"
Jul 30 15:10:55.198324 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:55.198296    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:55.198463 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:55.198353    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:10:55.198715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:55.198699    2553 scope.go:117] "RemoveContainer" containerID="36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1"
Jul 30 15:10:55.198888 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:55.198868    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:10:55.277561 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:55.277525    2553 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0"
Jul 30 15:10:55.277675 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:55.277632    2553 kuberuntime_manager.go:1459] "Unhandled Error" err="container service-ca-operator start failed in pod service-ca-operator-5d6c75f84f-ltwcr_openshift-service-ca-operator(3721f541-44ab-4c63-bf92-5c72093a2f97): ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 30 15:10:55.277778 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:55.277668    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-operator\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" podUID="3721f541-44ab-4c63-bf92-5c72093a2f97"
Jul 30 15:10:56.149262 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:56.149234    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"service-ca-operator\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: initializing source docker://quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:22803f88c4d0c93a40e68a8ec3738d9054a0e40199eccce659372a55b3086fe0: Requesting bearer token: received unexpected HTTP status: 504 Gateway Time-out; artifact err: provided artifact is a container image\"" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" podUID="3721f541-44ab-4c63-bf92-5c72093a2f97"
Jul 30 15:10:58.602512 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:58.602461    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:58.603014 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:58.602589    2553 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 30 15:10:58.603014 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:10:58.602650    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:10:58.603014 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:58.602661    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:06.602644286 +0000 UTC m=+65.208492368 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : configmap "kube-rbac-proxy" not found
Jul 30 15:10:58.603014 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:58.602778    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:10:58.603014 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:10:58.602834    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:06.602820397 +0000 UTC m=+65.208668479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:11:00.316376 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:00.316337    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:11:00.316786 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.316568    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:11:00.316786 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.316630    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:16.31661636 +0000 UTC m=+74.922464445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:11:00.517668 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:00.517638    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:11:00.517797 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:00.517676    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:11:00.517842 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.517796    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:11:00.517842 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.517802    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:11:00.517842 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.517813    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:11:00.517931 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.517863    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:16.517848621 +0000 UTC m=+75.123696706 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:11:00.517931 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:00.517878    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:11:16.517871791 +0000 UTC m=+75.123719872 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:11:04.071943 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:04.071910    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-d5cpw"
Jul 30 15:11:05.918813 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:05.918779    2553 scope.go:117] "RemoveContainer" containerID="36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1"
Jul 30 15:11:06.174342 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.174282    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/2.log"
Jul 30 15:11:06.174742 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.174724    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/1.log"
Jul 30 15:11:06.174806 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.174763    2553 generic.go:356] "Generic (PLEG): container finished" podID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb" containerID="0f194894312f24a2323aa89b7949012bd7e0c3a7bf3262c1476e629dd6f709cf" exitCode=255
Jul 30 15:11:06.174843 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.174816    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" event={"ID":"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb","Type":"ContainerDied","Data":"0f194894312f24a2323aa89b7949012bd7e0c3a7bf3262c1476e629dd6f709cf"}
Jul 30 15:11:06.174904 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.174892    2553 scope.go:117] "RemoveContainer" containerID="36e217b81b47ac65bb56f70731db799a05ca86b03988e88b51bbf30613b9a0f1"
Jul 30 15:11:06.175218 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.175199    2553 scope.go:117] "RemoveContainer" containerID="0f194894312f24a2323aa89b7949012bd7e0c3a7bf3262c1476e629dd6f709cf"
Jul 30 15:11:06.175439 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:06.175398    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:11:06.663763 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.663692    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:06.663913 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:06.663856    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:11:06.663913 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.663862    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:06.664026 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:06.663937    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:22.66391407 +0000 UTC m=+81.269762151 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:11:06.664327 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:06.664303    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b7f47b2b-28fe-40c7-84aa-8b880ab14679-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:07.178948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.178921    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/2.log"
Jul 30 15:11:07.570065 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.569999    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:11:07.570065 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.570055    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:11:07.572881 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.572856    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 30 15:11:07.572881 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.572877    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 30 15:11:07.580832 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:07.580813    2553 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 30 15:11:07.580912 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:07.580871    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs podName:2e81b505-63c6-4eee-8942-9b954f9ecb8a nodeName:}" failed. No retries permitted until 2026-07-30 15:12:11.580854045 +0000 UTC m=+130.186702126 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs") pod "network-metrics-daemon-4ql6h" (UID: "2e81b505-63c6-4eee-8942-9b954f9ecb8a") : secret "metrics-daemon-secret" not found
Jul 30 15:11:07.582982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.582963    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/909befd3-0fad-48d9-b790-e76e33fb190c-original-pull-secret\") pod \"global-pull-secret-syncer-bc678\" (UID: \"909befd3-0fad-48d9-b790-e76e33fb190c\") " pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:11:07.670504 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.670469    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:11:07.672941 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.672911    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v98nv\" (UniqueName: \"kubernetes.io/projected/4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3-kube-api-access-v98nv\") pod \"network-check-target-lbcck\" (UID: \"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3\") " pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:11:07.733969 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.733946    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bc678"
Jul 30 15:11:07.742481 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.742459    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-52dkp\""
Jul 30 15:11:07.749831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.749806    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:11:07.880128 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.880094    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bc678"]
Jul 30 15:11:07.883132 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:11:07.883111    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod909befd3_0fad_48d9_b790_e76e33fb190c.slice/crio-91f71392ebff762c65576d5336ae38b8de1d8f92d441306f268b44b094052d41 WatchSource:0}: Error finding container 91f71392ebff762c65576d5336ae38b8de1d8f92d441306f268b44b094052d41: Status 404 returned error can't find the container with id 91f71392ebff762c65576d5336ae38b8de1d8f92d441306f268b44b094052d41
Jul 30 15:11:07.893850 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:07.893827    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lbcck"]
Jul 30 15:11:07.895153 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:11:07.895135    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f11c7f7_5ed6_450b_bf1a_925a2df9f5b3.slice/crio-adc5848fa4ca40f7b54e050bdedcda908b2ff8c89a26c22184af9e8559d98e23 WatchSource:0}: Error finding container adc5848fa4ca40f7b54e050bdedcda908b2ff8c89a26c22184af9e8559d98e23: Status 404 returned error can't find the container with id adc5848fa4ca40f7b54e050bdedcda908b2ff8c89a26c22184af9e8559d98e23
Jul 30 15:11:08.183556 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:08.183528    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbcck" event={"ID":"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3","Type":"ContainerStarted","Data":"a155ddcc80872f1e8ec232df812aa242106ee9930a312ba6f650863b61dd2936"}
Jul 30 15:11:08.183864 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:08.183573    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lbcck" event={"ID":"4f11c7f7-5ed6-450b-bf1a-925a2df9f5b3","Type":"ContainerStarted","Data":"adc5848fa4ca40f7b54e050bdedcda908b2ff8c89a26c22184af9e8559d98e23"}
Jul 30 15:11:08.183864 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:08.183649    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:11:08.184722 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:08.184696    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bc678" event={"ID":"909befd3-0fad-48d9-b790-e76e33fb190c","Type":"ContainerStarted","Data":"91f71392ebff762c65576d5336ae38b8de1d8f92d441306f268b44b094052d41"}
Jul 30 15:11:08.200959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:08.200918    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lbcck" podStartSLOduration=66.200905044 podStartE2EDuration="1m6.200905044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:11:08.199842965 +0000 UTC m=+66.805691069" watchObservedRunningTime="2026-07-30 15:11:08.200905044 +0000 UTC m=+66.806753146"
Jul 30 15:11:09.182493 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:09.182458    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:11:09.182663 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:09.182570    2553 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 30 15:11:09.182663 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:09.182625    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls podName:9205b071-5e6c-4644-b14a-637631d49163 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:41.182611991 +0000 UTC m=+99.788460073 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls") pod "dns-default-jf8wf" (UID: "9205b071-5e6c-4644-b14a-637631d49163") : secret "dns-default-metrics-tls" not found
Jul 30 15:11:12.203197 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:12.203160    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bc678" event={"ID":"909befd3-0fad-48d9-b790-e76e33fb190c","Type":"ContainerStarted","Data":"63deb7d877cbc19932ac860280533393263cd6b4bcb231f7f5d0431d5dfc1d24"}
Jul 30 15:11:12.225631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:12.225581    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bc678" podStartSLOduration=66.357238307 podStartE2EDuration="1m10.225559742s" totalImagesPullingTime="3.868321435s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:11:12.224598976 +0000 UTC m=+70.830447079" watchObservedRunningTime="2026-07-30 15:11:12.225559742 +0000 UTC m=+70.831407849"
Jul 30 15:11:14.211087 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:14.211051    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" event={"ID":"3721f541-44ab-4c63-bf92-5c72093a2f97","Type":"ContainerStarted","Data":"abb17ad62a041506c0271baf5c2e0b284144617402c335edeb6f6b7fbae166d6"}
Jul 30 15:11:14.236683 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:14.236640    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" podStartSLOduration=1.866483235 podStartE2EDuration="30.236626109s" totalImagesPullingTime="28.370142874s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=1 observedRunningTime="2026-07-30 15:11:14.235161775 +0000 UTC m=+72.841009877" watchObservedRunningTime="2026-07-30 15:11:14.236626109 +0000 UTC m=+72.842474211"
Jul 30 15:11:15.199108 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:15.199075    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:11:15.199310 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:15.199132    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:11:15.199570 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:15.199547    2553 scope.go:117] "RemoveContainer" containerID="0f194894312f24a2323aa89b7949012bd7e0c3a7bf3262c1476e629dd6f709cf"
Jul 30 15:11:15.199776 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:15.199743    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:11:16.335325 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:16.335296    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:11:16.335698 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.335398    2553 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 30 15:11:16.335698 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.335461    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls podName:ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:48.335447652 +0000 UTC m=+106.941295736 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-gt498" (UID: "ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073") : secret "cluster-monitoring-operator-tls" not found
Jul 30 15:11:16.536429 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:16.536399    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") pod \"image-registry-6d9dd87d74-vvl2l\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") " pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:11:16.536550 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:16.536445    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:11:16.536550 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.536528    2553 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 30 15:11:16.536550 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.536532    2553 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 30 15:11:16.536550 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.536549    2553 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6d9dd87d74-vvl2l: secret "image-registry-tls" not found
Jul 30 15:11:16.536717 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.536566    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls podName:1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c nodeName:}" failed. No retries permitted until 2026-07-30 15:11:48.536554471 +0000 UTC m=+107.142402553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls") pod "cluster-samples-operator-6748489656-2r9n2" (UID: "1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c") : secret "samples-operator-tls" not found
Jul 30 15:11:16.536717 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:16.536587    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls podName:f3c7cee0-2bb0-4b73-8c34-9a44d41650a1 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:48.536574016 +0000 UTC m=+107.142422115 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls") pod "image-registry-6d9dd87d74-vvl2l" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1") : secret "image-registry-tls" not found
Jul 30 15:11:22.679705 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:22.679666    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:22.680128 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:22.679790    2553 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 30 15:11:22.680128 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:22.679847    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls podName:b7f47b2b-28fe-40c7-84aa-8b880ab14679 nodeName:}" failed. No retries permitted until 2026-07-30 15:11:54.679830999 +0000 UTC m=+113.285679081 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wx5tb" (UID: "b7f47b2b-28fe-40c7-84aa-8b880ab14679") : secret "insights-runtime-extractor-tls" not found
Jul 30 15:11:27.919224 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:27.919093    2553 scope.go:117] "RemoveContainer" containerID="0f194894312f24a2323aa89b7949012bd7e0c3a7bf3262c1476e629dd6f709cf"
Jul 30 15:11:28.258919 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:28.258862    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:11:28.259318 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:28.259298    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/2.log"
Jul 30 15:11:28.259380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:28.259336    2553 generic.go:356] "Generic (PLEG): container finished" podID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb" containerID="8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5" exitCode=255
Jul 30 15:11:28.259450 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:28.259374    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" event={"ID":"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb","Type":"ContainerDied","Data":"8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5"}
Jul 30 15:11:28.259496 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:28.259463    2553 scope.go:117] "RemoveContainer" containerID="0f194894312f24a2323aa89b7949012bd7e0c3a7bf3262c1476e629dd6f709cf"
Jul 30 15:11:28.259774 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:28.259752    2553 scope.go:117] "RemoveContainer" containerID="8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5"
Jul 30 15:11:28.259962 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:28.259940    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:11:29.263893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:29.263869    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:11:35.198315 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:35.198277    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:11:35.198825 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:35.198338    2553 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:11:35.198825 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:35.198642    2553 scope.go:117] "RemoveContainer" containerID="8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5"
Jul 30 15:11:35.198825 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:35.198783    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:11:39.192462 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:39.192405    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lbcck"
Jul 30 15:11:41.221435 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.221389    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:11:41.223456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.223434    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/9205b071-5e6c-4644-b14a-637631d49163-metrics-tls\") pod \"dns-default-jf8wf\" (UID: \"9205b071-5e6c-4644-b14a-637631d49163\") " pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:11:41.504227 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.504161    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7hzbg\""
Jul 30 15:11:41.511682 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.511656    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:11:41.656095 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.656067    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-jf8wf"]
Jul 30 15:11:41.658972 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:11:41.658940    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9205b071_5e6c_4644_b14a_637631d49163.slice/crio-13ec429573564f8eb9e6040503a0fd47ec5b0a2c955d027b2b96e2fc94b9b213 WatchSource:0}: Error finding container 13ec429573564f8eb9e6040503a0fd47ec5b0a2c955d027b2b96e2fc94b9b213: Status 404 returned error can't find the container with id 13ec429573564f8eb9e6040503a0fd47ec5b0a2c955d027b2b96e2fc94b9b213
Jul 30 15:11:41.881468 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.881400    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"]
Jul 30 15:11:41.884022 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.883999    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:41.887913 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.887887    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 30 15:11:41.888194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.888175    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 30 15:11:41.888286 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.888175    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 30 15:11:41.889082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.889063    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 30 15:11:41.889166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.889105    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 30 15:11:41.889166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.889117    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 30 15:11:41.889490 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.889472    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 30 15:11:41.911579 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.911547    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"]
Jul 30 15:11:41.969333 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:41.969314    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d9dd87d74-vvl2l"]
Jul 30 15:11:41.969514 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:41.969495    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l" podUID="f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"
Jul 30 15:11:42.026739 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.026717    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf379869-c484-4822-ad4e-4eb914bd58ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.026836 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.026747    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8cb2m\" (UniqueName: \"kubernetes.io/projected/cf379869-c484-4822-ad4e-4eb914bd58ed-kube-api-access-8cb2m\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.026836 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.026772    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-ca\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.026836 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.026821    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.026958 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.026889    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-hub\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.026958 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.026909    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.127387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.127359    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-ca\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.127491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.127397    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.127544 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.127491    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-hub\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.127544 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.127518    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.127677 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.127657    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf379869-c484-4822-ad4e-4eb914bd58ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.127711 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.127689    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8cb2m\" (UniqueName: \"kubernetes.io/projected/cf379869-c484-4822-ad4e-4eb914bd58ed-kube-api-access-8cb2m\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.128357 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.128335    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/cf379869-c484-4822-ad4e-4eb914bd58ed-additional-service-ca\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.129835 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.129806    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-hub\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.129924 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.129811    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-ca\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.130120 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.130104    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.130349 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.130329    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/cf379869-c484-4822-ad4e-4eb914bd58ed-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.149973 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.149914    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8cb2m\" (UniqueName: \"kubernetes.io/projected/cf379869-c484-4822-ad4e-4eb914bd58ed-kube-api-access-8cb2m\") pod \"cluster-proxy-proxy-agent-869655c7d9-8lhxl\" (UID: \"cf379869-c484-4822-ad4e-4eb914bd58ed\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.201405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.201382    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"
Jul 30 15:11:42.306248 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.306222    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:11:42.306248 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.306233    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jf8wf" event={"ID":"9205b071-5e6c-4644-b14a-637631d49163","Type":"ContainerStarted","Data":"13ec429573564f8eb9e6040503a0fd47ec5b0a2c955d027b2b96e2fc94b9b213"}
Jul 30 15:11:42.311628 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.311606    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:11:42.336473 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.336449    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl"]
Jul 30 15:11:42.340831 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:11:42.340809    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcf379869_c484_4822_ad4e_4eb914bd58ed.slice/crio-a29ecfc6b4f734e89cb243ae8960993b6b071d907634874d480e3bc77ed48a1f WatchSource:0}: Error finding container a29ecfc6b4f734e89cb243ae8960993b6b071d907634874d480e3bc77ed48a1f: Status 404 returned error can't find the container with id a29ecfc6b4f734e89cb243ae8960993b6b071d907634874d480e3bc77ed48a1f
Jul 30 15:11:42.430557 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430538    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-ca-trust-extracted\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430662 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430567    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5bvdx\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-kube-api-access-5bvdx\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430662 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430636    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-certificates\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430662 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430657    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-installation-pull-secrets\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430672    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-trusted-ca\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430708    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-image-registry-private-configuration\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430740    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-bound-sa-token\") pod \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\" (UID: \"f3c7cee0-2bb0-4b73-8c34-9a44d41650a1\") "
Jul 30 15:11:42.430964 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.430832    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:11:42.431038 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.431011    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:11:42.431088 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.431039    2553 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-ca-trust-extracted\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:42.431301 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.431281    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:11:42.432888 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.432860    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:11:42.432979 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.432917    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:11:42.433188 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.433169    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:11:42.433247 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.433227    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-kube-api-access-5bvdx" (OuterVolumeSpecName: "kube-api-access-5bvdx") pod "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" (UID: "f3c7cee0-2bb0-4b73-8c34-9a44d41650a1"). InnerVolumeSpecName "kube-api-access-5bvdx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:11:42.532113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.532092    2553 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-certificates\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:42.532113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.532112    2553 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-installation-pull-secrets\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:42.532113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.532122    2553 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-trusted-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:42.532297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.532131    2553 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-image-registry-private-configuration\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:42.532297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.532140    2553 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-bound-sa-token\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:42.532297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:42.532149    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5bvdx\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-kube-api-access-5bvdx\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:43.311369 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:43.311266    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6d9dd87d74-vvl2l"
Jul 30 15:11:43.311832 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:43.311573    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl" event={"ID":"cf379869-c484-4822-ad4e-4eb914bd58ed","Type":"ContainerStarted","Data":"a29ecfc6b4f734e89cb243ae8960993b6b071d907634874d480e3bc77ed48a1f"}
Jul 30 15:11:43.382930 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:43.382898    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6d9dd87d74-vvl2l"]
Jul 30 15:11:43.389844 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:43.389818    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6d9dd87d74-vvl2l"]
Jul 30 15:11:43.540559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:43.540523    2553 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1-registry-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:11:43.923436 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:43.923384    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c7cee0-2bb0-4b73-8c34-9a44d41650a1" path="/var/lib/kubelet/pods/f3c7cee0-2bb0-4b73-8c34-9a44d41650a1/volumes"
Jul 30 15:11:47.327292 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.327256    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl" event={"ID":"cf379869-c484-4822-ad4e-4eb914bd58ed","Type":"ContainerStarted","Data":"fd61d6aa6ea297314067d6f6d310f67c6031151cc9981dcf3129b70c69469c72"}
Jul 30 15:11:47.327710 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.327306    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl" event={"ID":"cf379869-c484-4822-ad4e-4eb914bd58ed","Type":"ContainerStarted","Data":"82b449c7ae48b8500792680ad924737d8535233a990f247d072d052ba1e6ea7a"}
Jul 30 15:11:47.327710 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.327324    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl" event={"ID":"cf379869-c484-4822-ad4e-4eb914bd58ed","Type":"ContainerStarted","Data":"6471f9aed4c511a580606a9af46787f654a037da6a9698b84907cb116dc8d1ea"}
Jul 30 15:11:47.328926 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.328903    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jf8wf" event={"ID":"9205b071-5e6c-4644-b14a-637631d49163","Type":"ContainerStarted","Data":"74433563769eb74243fcbdce4673c72731be141f086d8f84e0c16291ef0e9cce"}
Jul 30 15:11:47.329019 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.328945    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-jf8wf" event={"ID":"9205b071-5e6c-4644-b14a-637631d49163","Type":"ContainerStarted","Data":"af9a8d3baaac22f6dba70a417c9e64d551172865589cbf33b410543d4f186543"}
Jul 30 15:11:47.329064 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.329039    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:11:47.399104 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.399037    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-jf8wf" podStartSLOduration=65.207966427 podStartE2EDuration="1m10.399023122s" totalImagesPullingTime="5.191056695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:11:47.398441602 +0000 UTC m=+106.004289696" watchObservedRunningTime="2026-07-30 15:11:47.399023122 +0000 UTC m=+106.004871224"
Jul 30 15:11:47.399235 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:47.399218    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-869655c7d9-8lhxl" podStartSLOduration=1.87466029 podStartE2EDuration="6.39921215s" totalImagesPullingTime="4.52455186s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:11:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:11:47.365913707 +0000 UTC m=+105.971761809" watchObservedRunningTime="2026-07-30 15:11:47.39921215 +0000 UTC m=+106.005060299"
Jul 30 15:11:48.380595 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.380559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:11:48.383163 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.383140    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-gt498\" (UID: \"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:11:48.583142 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.583109    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:11:48.585527 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.585497    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-2r9n2\" (UID: \"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:11:48.641595 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.641535    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mc4m2\""
Jul 30 15:11:48.649005 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.648983    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"
Jul 30 15:11:48.774724 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.774699    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498"]
Jul 30 15:11:48.776910 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:11:48.776879    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab3f8bf7_9abf_4da7_a9b8_d79a3e50b073.slice/crio-3629b0ee1169ec6a0f11cc8c6d79c4f8432dc7f169618b65432ee73977bc71a4 WatchSource:0}: Error finding container 3629b0ee1169ec6a0f11cc8c6d79c4f8432dc7f169618b65432ee73977bc71a4: Status 404 returned error can't find the container with id 3629b0ee1169ec6a0f11cc8c6d79c4f8432dc7f169618b65432ee73977bc71a4
Jul 30 15:11:48.825820 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.825798    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-wjjj2\""
Jul 30 15:11:48.833398 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.833381    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"
Jul 30 15:11:48.950137 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:48.950108    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2"]
Jul 30 15:11:49.338617 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:49.338589    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2" event={"ID":"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c","Type":"ContainerStarted","Data":"86fe0edcc614ca149b40b8a7f27ca3958afb5ce98c52e2d5bdce66a1387dfaac"}
Jul 30 15:11:49.339688 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:49.339662    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498" event={"ID":"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073","Type":"ContainerStarted","Data":"3629b0ee1169ec6a0f11cc8c6d79c4f8432dc7f169618b65432ee73977bc71a4"}
Jul 30 15:11:49.919076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:49.918726    2553 scope.go:117] "RemoveContainer" containerID="8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5"
Jul 30 15:11:49.919076 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:49.918914    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:11:51.349098 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:51.349062    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2" event={"ID":"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c","Type":"ContainerStarted","Data":"18950a3e90b97743406eae2bebe9b7fe8b738027da518060bd8199959a2098c7"}
Jul 30 15:11:51.349537 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:51.349124    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2" event={"ID":"1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c","Type":"ContainerStarted","Data":"bc5dc60b9a359cc062fd0329ba23519e99caa27fe7a36e59b64f6ddc46dabc6d"}
Jul 30 15:11:51.350987 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:51.350938    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498" event={"ID":"ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073","Type":"ContainerStarted","Data":"135a1184762bc9b45a454fefb0538fb3392e08019899dcec3bc46db4add6f7b4"}
Jul 30 15:11:51.369641 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:51.369597    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-2r9n2" podStartSLOduration=65.15997035 podStartE2EDuration="1m7.369581297s" totalImagesPullingTime="2.209610947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:11:51.369003352 +0000 UTC m=+109.974851456" watchObservedRunningTime="2026-07-30 15:11:51.369581297 +0000 UTC m=+109.975429399"
Jul 30 15:11:51.389472 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:51.389407    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-gt498" podStartSLOduration=64.977286328 podStartE2EDuration="1m7.389388622s" totalImagesPullingTime="2.412102294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:11:51.387916155 +0000 UTC m=+109.993764271" watchObservedRunningTime="2026-07-30 15:11:51.389388622 +0000 UTC m=+109.995236726"
Jul 30 15:11:54.729584 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:54.729539    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:54.731918 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:54.731889    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b7f47b2b-28fe-40c7-84aa-8b880ab14679-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wx5tb\" (UID: \"b7f47b2b-28fe-40c7-84aa-8b880ab14679\") " pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:54.820123 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:54.820096    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6v78w\""
Jul 30 15:11:54.823145 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:54.823123    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wx5tb"
Jul 30 15:11:54.972167 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:54.972138    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wx5tb"]
Jul 30 15:11:54.975235 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:11:54.975195    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7f47b2b_28fe_40c7_84aa_8b880ab14679.slice/crio-74ba2178af4c225ac313f707d6d25814a8d0cb9fb71fefc56f896e3e10c3ce7b WatchSource:0}: Error finding container 74ba2178af4c225ac313f707d6d25814a8d0cb9fb71fefc56f896e3e10c3ce7b: Status 404 returned error can't find the container with id 74ba2178af4c225ac313f707d6d25814a8d0cb9fb71fefc56f896e3e10c3ce7b
Jul 30 15:11:55.368621 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:55.368587    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wx5tb" event={"ID":"b7f47b2b-28fe-40c7-84aa-8b880ab14679","Type":"ContainerStarted","Data":"74ba2178af4c225ac313f707d6d25814a8d0cb9fb71fefc56f896e3e10c3ce7b"}
Jul 30 15:11:57.334084 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:57.334046    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-jf8wf"
Jul 30 15:11:59.732006 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.731971    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c45lb"]
Jul 30 15:11:59.735697 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.735674    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.742381 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:59.742322    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"node-exporter-c45lb\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="5a6a19c5-ac50-45ae-a01b-bc11ac846eae" pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.742381 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:59.742327    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-tls\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" type="*v1.Secret"
Jul 30 15:11:59.742381 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:59.742329    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"metrics-client-ca\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" type="*v1.ConfigMap"
Jul 30 15:11:59.743073 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:59.742922    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-dockercfg-tpj8t\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tpj8t\"" type="*v1.Secret"
Jul 30 15:11:59.743073 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:59.742978    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"node-exporter-kube-rbac-proxy-config\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" type="*v1.Secret"
Jul 30 15:11:59.744052 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:11:59.744022    2553 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"node-exporter-accelerators-collector-config\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-monitoring\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" type="*v1.ConfigMap"
Jul 30 15:11:59.765865 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.765840    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.765996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.765885    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-metrics-client-ca\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.765996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.765912    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-accelerators-collector-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.765996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.765941    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfsqs\" (UniqueName: \"kubernetes.io/projected/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-kube-api-access-kfsqs\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.766147 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.766016    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-root\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.766147 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.766075    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-textfile\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.766147 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.766111    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-wtmp\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.766147 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.766138    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-tls\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.766328 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.766206    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-sys\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866660 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866640    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-sys\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866676    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866715    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-metrics-client-ca\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866732    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-sys\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866743    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-accelerators-collector-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866776    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfsqs\" (UniqueName: \"kubernetes.io/projected/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-kube-api-access-kfsqs\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866829    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-root\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866862    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-textfile\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866883    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-wtmp\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866910    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-tls\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.866948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866926    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-root\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.867160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.866997    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-wtmp\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.867160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.867126    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-textfile\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:11:59.882098 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:11:59.882069    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfsqs\" (UniqueName: \"kubernetes.io/projected/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-kube-api-access-kfsqs\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:00.390549 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:00.390508    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wx5tb" event={"ID":"b7f47b2b-28fe-40c7-84aa-8b880ab14679","Type":"ContainerStarted","Data":"56114fc2e1dbdc44cdd6449bb8ec0ce31e43e89aca0cf84872c61216e8cd974d"}
Jul 30 15:12:00.755821 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:00.755789    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 30 15:12:00.758276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:00.758256    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-metrics-client-ca\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:00.772989 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:00.772967    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 30 15:12:00.779117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:00.779096    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-tls\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:00.867170 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:12:00.867145    2553 configmap.go:193] Couldn't get configMap openshift-monitoring/node-exporter-accelerators-collector-config: failed to sync configmap cache: timed out waiting for the condition
Jul 30 15:12:00.867259 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:12:00.867208    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-accelerators-collector-config podName:5a6a19c5-ac50-45ae-a01b-bc11ac846eae nodeName:}" failed. No retries permitted until 2026-07-30 15:12:01.367193011 +0000 UTC m=+119.973041092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-accelerators-collector-config" (UniqueName: "kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-accelerators-collector-config") pod "node-exporter-c45lb" (UID: "5a6a19c5-ac50-45ae-a01b-bc11ac846eae") : failed to sync configmap cache: timed out waiting for the condition
Jul 30 15:12:00.867259 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:12:00.867149    2553 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-kube-rbac-proxy-config: failed to sync secret cache: timed out waiting for the condition
Jul 30 15:12:00.867347 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:12:00.867302    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-kube-rbac-proxy-config podName:5a6a19c5-ac50-45ae-a01b-bc11ac846eae nodeName:}" failed. No retries permitted until 2026-07-30 15:12:01.367285722 +0000 UTC m=+119.973133808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-kube-rbac-proxy-config" (UniqueName: "kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-kube-rbac-proxy-config") pod "node-exporter-c45lb" (UID: "5a6a19c5-ac50-45ae-a01b-bc11ac846eae") : failed to sync secret cache: timed out waiting for the condition
Jul 30 15:12:01.090661 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.090394    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 30 15:12:01.215663 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.215635    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tpj8t\""
Jul 30 15:12:01.219710 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.219682    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 30 15:12:01.378107 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.378020    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:01.378107 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.378079    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-accelerators-collector-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:01.378771 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.378706    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-accelerators-collector-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:01.380822 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.380795    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5a6a19c5-ac50-45ae-a01b-bc11ac846eae-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c45lb\" (UID: \"5a6a19c5-ac50-45ae-a01b-bc11ac846eae\") " pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:01.547324 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:01.547294    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c45lb"
Jul 30 15:12:01.558805 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:12:01.558775    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a6a19c5_ac50_45ae_a01b_bc11ac846eae.slice/crio-d729aba5cf0d376b66cf7a693db6649596b45e5b06da07057d0817109ce6d094 WatchSource:0}: Error finding container d729aba5cf0d376b66cf7a693db6649596b45e5b06da07057d0817109ce6d094: Status 404 returned error can't find the container with id d729aba5cf0d376b66cf7a693db6649596b45e5b06da07057d0817109ce6d094
Jul 30 15:12:02.400309 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:02.400272    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c45lb" event={"ID":"5a6a19c5-ac50-45ae-a01b-bc11ac846eae","Type":"ContainerStarted","Data":"d729aba5cf0d376b66cf7a693db6649596b45e5b06da07057d0817109ce6d094"}
Jul 30 15:12:02.918722 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:02.918696    2553 scope.go:117] "RemoveContainer" containerID="8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5"
Jul 30 15:12:02.918901 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:12:02.918868    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 40s restarting failed container=console-operator pod=console-operator-584dcb6b54-cntsg_openshift-console-operator(8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb)\"" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podUID="8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb"
Jul 30 15:12:04.408847 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:04.408820    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wx5tb" event={"ID":"b7f47b2b-28fe-40c7-84aa-8b880ab14679","Type":"ContainerStarted","Data":"84307c0447d0184c966bf6bfa190cad21b7cf5a66cc69d17baee1c19ee3b5250"}
Jul 30 15:12:04.410342 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:04.410321    2553 generic.go:356] "Generic (PLEG): container finished" podID="5a6a19c5-ac50-45ae-a01b-bc11ac846eae" containerID="ed87e5c4a1ab69f411eee93ae6954722e34c2a7a7b07c078167b257fc7e24438" exitCode=0
Jul 30 15:12:04.410447 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:04.410349    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c45lb" event={"ID":"5a6a19c5-ac50-45ae-a01b-bc11ac846eae","Type":"ContainerDied","Data":"ed87e5c4a1ab69f411eee93ae6954722e34c2a7a7b07c078167b257fc7e24438"}
Jul 30 15:12:05.421108 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:05.421067    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c45lb" event={"ID":"5a6a19c5-ac50-45ae-a01b-bc11ac846eae","Type":"ContainerStarted","Data":"27a8f202c81b4a47de9b68de12a63868d6ffd6ca833b3e65ed19ae171a0760e1"}
Jul 30 15:12:05.421556 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:05.421162    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c45lb" event={"ID":"5a6a19c5-ac50-45ae-a01b-bc11ac846eae","Type":"ContainerStarted","Data":"15c90fee2af6632d95e1546f327cd1ae3019f2ffa8e3966d0adf2dfc5164c660"}
Jul 30 15:12:05.465004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:05.464950    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c45lb" podStartSLOduration=3.7167921980000003 podStartE2EDuration="6.464931947s" totalImagesPullingTime="2.68512821s" totalInitContainerRuntime="63.011539ms" isStatefulPod=true podCreationTimestamp="2026-07-30 15:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:12:05.46417313 +0000 UTC m=+124.070021233" watchObservedRunningTime="2026-07-30 15:12:05.464931947 +0000 UTC m=+124.070780044"
Jul 30 15:12:08.433490 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:08.433438    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wx5tb" event={"ID":"b7f47b2b-28fe-40c7-84aa-8b880ab14679","Type":"ContainerStarted","Data":"5eee29b635fb11153db639e050b0ddcb09be9091d08dcc79ecf8fcd066db96d6"}
Jul 30 15:12:08.473383 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:08.473341    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wx5tb" podStartSLOduration=65.730975562 podStartE2EDuration="1m18.47332582s" totalImagesPullingTime="12.742350258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 15:10:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:12:08.472903805 +0000 UTC m=+127.078751909" watchObservedRunningTime="2026-07-30 15:12:08.47332582 +0000 UTC m=+127.079173958"
Jul 30 15:12:11.660571 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:11.660528    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:12:11.663158 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:11.663129    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e81b505-63c6-4eee-8942-9b954f9ecb8a-metrics-certs\") pod \"network-metrics-daemon-4ql6h\" (UID: \"2e81b505-63c6-4eee-8942-9b954f9ecb8a\") " pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:12:11.931994 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:11.931959    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kvhp8\""
Jul 30 15:12:11.939481 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:11.939460    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-4ql6h"
Jul 30 15:12:12.071518 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:12.071495    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-4ql6h"]
Jul 30 15:12:12.073518 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:12:12.073492    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e81b505_63c6_4eee_8942_9b954f9ecb8a.slice/crio-408c91899a54dc918cf397c4af1e6c75a883008431e3fa58feec720f7acfb91e WatchSource:0}: Error finding container 408c91899a54dc918cf397c4af1e6c75a883008431e3fa58feec720f7acfb91e: Status 404 returned error can't find the container with id 408c91899a54dc918cf397c4af1e6c75a883008431e3fa58feec720f7acfb91e
Jul 30 15:12:12.452935 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:12.452902    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ql6h" event={"ID":"2e81b505-63c6-4eee-8942-9b954f9ecb8a","Type":"ContainerStarted","Data":"408c91899a54dc918cf397c4af1e6c75a883008431e3fa58feec720f7acfb91e"}
Jul 30 15:12:13.458497 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:13.458461    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ql6h" event={"ID":"2e81b505-63c6-4eee-8942-9b954f9ecb8a","Type":"ContainerStarted","Data":"f53a799bfc9e331813c078ced88674adbd1a5e51d358953e07aa031ad95f9506"}
Jul 30 15:12:13.458823 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:13.458515    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-4ql6h" event={"ID":"2e81b505-63c6-4eee-8942-9b954f9ecb8a","Type":"ContainerStarted","Data":"5dd23fa6adbb2b32a6369a737bdbf46be730dda6cdc6d445aec5f4f03a32a0bc"}
Jul 30 15:12:13.478177 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:13.478140    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-4ql6h" podStartSLOduration=130.440576491 podStartE2EDuration="2m11.478124168s" totalImagesPullingTime="1.037547677s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:12:13.476891525 +0000 UTC m=+132.082739628" watchObservedRunningTime="2026-07-30 15:12:13.478124168 +0000 UTC m=+132.083972281"
Jul 30 15:12:15.919008 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:15.918975    2553 scope.go:117] "RemoveContainer" containerID="8c3b39261af1069423d1f31850020ca3bdf492926152b3e02615cb77ca14e8d5"
Jul 30 15:12:16.471476 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.471446    2553 generic.go:356] "Generic (PLEG): container finished" podID="c8b19855-054c-4406-a764-aa3856e1059c" containerID="2a6818adf89d2ef496571cc60ed4883074aa517911c7478778b3cc585495a7c0" exitCode=0
Jul 30 15:12:16.471647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.471523    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rlzmh" event={"ID":"c8b19855-054c-4406-a764-aa3856e1059c","Type":"ContainerDied","Data":"2a6818adf89d2ef496571cc60ed4883074aa517911c7478778b3cc585495a7c0"}
Jul 30 15:12:16.471900 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.471879    2553 scope.go:117] "RemoveContainer" containerID="2a6818adf89d2ef496571cc60ed4883074aa517911c7478778b3cc585495a7c0"
Jul 30 15:12:16.473501 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.473486    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:12:16.473585 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.473539    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" event={"ID":"8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb","Type":"ContainerStarted","Data":"029917713baedf4cda9a47ff92b9c0435bdb886d78cb109545b83c6db184b5b5"}
Jul 30 15:12:16.473996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.473980    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:12:16.480631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.480613    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg"
Jul 30 15:12:16.573276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:16.573227    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-cntsg" podStartSLOduration=87.962527799 podStartE2EDuration="1m32.573211608s" totalImagesPullingTime="4.610683809s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:10:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:12:16.572745142 +0000 UTC m=+135.178593247" watchObservedRunningTime="2026-07-30 15:12:16.573211608 +0000 UTC m=+135.179059711"
Jul 30 15:12:17.481636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:17.480345    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-rlzmh" event={"ID":"c8b19855-054c-4406-a764-aa3856e1059c","Type":"ContainerStarted","Data":"e392bf225b50300c7a58404bf9a3590835f0b58c4a9de7ec09e361054e85e06a"}
Jul 30 15:12:18.168979 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:18.168945    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jf8wf_9205b071-5e6c-4644-b14a-637631d49163/dns/0.log"
Jul 30 15:12:18.371400 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:18.371366    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jf8wf_9205b071-5e6c-4644-b14a-637631d49163/kube-rbac-proxy/0.log"
Jul 30 15:12:19.376414 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:19.376384    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8csv_95bf1bae-846c-45b2-b5bf-a1c186e910ed/dns-node-resolver/0.log"
Jul 30 15:12:19.975328 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:19.975304    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntn92_b3fa587a-1963-44df-9636-941c31324ef0/serve-healthcheck-canary/0.log"
Jul 30 15:12:20.384208 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:20.384132    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-2r9n2_1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c/cluster-samples-operator/0.log"
Jul 30 15:12:20.572547 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:20.572518    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-2r9n2_1dbfe98e-4eb9-48fe-9a00-8dfc99ec774c/cluster-samples-operator-watch/0.log"
Jul 30 15:12:34.544590 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:34.544551    2553 generic.go:356] "Generic (PLEG): container finished" podID="3721f541-44ab-4c63-bf92-5c72093a2f97" containerID="abb17ad62a041506c0271baf5c2e0b284144617402c335edeb6f6b7fbae166d6" exitCode=0
Jul 30 15:12:34.544990 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:34.544626    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" event={"ID":"3721f541-44ab-4c63-bf92-5c72093a2f97","Type":"ContainerDied","Data":"abb17ad62a041506c0271baf5c2e0b284144617402c335edeb6f6b7fbae166d6"}
Jul 30 15:12:34.544990 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:34.544957    2553 scope.go:117] "RemoveContainer" containerID="abb17ad62a041506c0271baf5c2e0b284144617402c335edeb6f6b7fbae166d6"
Jul 30 15:12:35.549938 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:12:35.549905    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-ltwcr" event={"ID":"3721f541-44ab-4c63-bf92-5c72093a2f97","Type":"ContainerStarted","Data":"5155e5ec39ec332f13a36424e674dfed5c17c69abc741f2d197f62a80b3839be"}
Jul 30 15:15:01.746781 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:01.746745    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:15:01.751225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:01.751196    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:15:01.759780 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:01.759755    2553 kubelet.go:1648] "Image garbage collection succeeded"
Jul 30 15:15:38.068568 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.068534    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"]
Jul 30 15:15:38.071667 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.071648    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.075167 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.075138    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 15:15:38.076135 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.076118    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 15:15:38.076197 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.076139    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fvwk8\""
Jul 30 15:15:38.086071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.086047    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"]
Jul 30 15:15:38.199524 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.199497    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.199656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.199552    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc74m\" (UniqueName: \"kubernetes.io/projected/4d017d5e-1327-4efc-8ecf-b54a76857115-kube-api-access-gc74m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.199656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.199622    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.300905 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.300874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc74m\" (UniqueName: \"kubernetes.io/projected/4d017d5e-1327-4efc-8ecf-b54a76857115-kube-api-access-gc74m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.301030 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.300915    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.301030 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.300967    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.301314 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.301290    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.301380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.301323    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.310467 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.310444    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc74m\" (UniqueName: \"kubernetes.io/projected/4d017d5e-1327-4efc-8ecf-b54a76857115-kube-api-access-gc74m\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.386996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.386945    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:38.519947 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.519926    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"]
Jul 30 15:15:38.522362 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:15:38.522334    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d017d5e_1327_4efc_8ecf_b54a76857115.slice/crio-a670e2a6e4fe98efca396d3f7c36bdc9d0c7ab8bcd3f181b151405afc6efce30 WatchSource:0}: Error finding container a670e2a6e4fe98efca396d3f7c36bdc9d0c7ab8bcd3f181b151405afc6efce30: Status 404 returned error can't find the container with id a670e2a6e4fe98efca396d3f7c36bdc9d0c7ab8bcd3f181b151405afc6efce30
Jul 30 15:15:38.524244 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:38.524227    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:15:39.192748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:39.192710    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb" event={"ID":"4d017d5e-1327-4efc-8ecf-b54a76857115","Type":"ContainerStarted","Data":"a670e2a6e4fe98efca396d3f7c36bdc9d0c7ab8bcd3f181b151405afc6efce30"}
Jul 30 15:15:45.218057 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:45.218016    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb" event={"ID":"4d017d5e-1327-4efc-8ecf-b54a76857115","Type":"ContainerStarted","Data":"f954bce05a0fe4365ca0bece2f25b7df394a9bbae41acc369db683444d570228"}
Jul 30 15:15:46.222438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:46.222388    2553 generic.go:356] "Generic (PLEG): container finished" podID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerID="f954bce05a0fe4365ca0bece2f25b7df394a9bbae41acc369db683444d570228" exitCode=0
Jul 30 15:15:46.222813 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:46.222478    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb" event={"ID":"4d017d5e-1327-4efc-8ecf-b54a76857115","Type":"ContainerDied","Data":"f954bce05a0fe4365ca0bece2f25b7df394a9bbae41acc369db683444d570228"}
Jul 30 15:15:49.238183 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:49.238151    2553 generic.go:356] "Generic (PLEG): container finished" podID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerID="ccb7965c91e3658b7c21c7c4debdbe64669e5832890d68c1a8302e88bef97435" exitCode=0
Jul 30 15:15:49.238599 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:49.238243    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb" event={"ID":"4d017d5e-1327-4efc-8ecf-b54a76857115","Type":"ContainerDied","Data":"ccb7965c91e3658b7c21c7c4debdbe64669e5832890d68c1a8302e88bef97435"}
Jul 30 15:15:57.270923 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:57.270891    2553 generic.go:356] "Generic (PLEG): container finished" podID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerID="02959c4b4dfe723b8eb5b02f3d202d32a1a01ffc5e3f1cb0c08da7f2d6115429" exitCode=0
Jul 30 15:15:57.271288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:57.270947    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb" event={"ID":"4d017d5e-1327-4efc-8ecf-b54a76857115","Type":"ContainerDied","Data":"02959c4b4dfe723b8eb5b02f3d202d32a1a01ffc5e3f1cb0c08da7f2d6115429"}
Jul 30 15:15:58.400726 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.400704    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:58.561849 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.561774    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-util\") pod \"4d017d5e-1327-4efc-8ecf-b54a76857115\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") "
Jul 30 15:15:58.561849 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.561836    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc74m\" (UniqueName: \"kubernetes.io/projected/4d017d5e-1327-4efc-8ecf-b54a76857115-kube-api-access-gc74m\") pod \"4d017d5e-1327-4efc-8ecf-b54a76857115\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") "
Jul 30 15:15:58.561849 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.561855    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-bundle\") pod \"4d017d5e-1327-4efc-8ecf-b54a76857115\" (UID: \"4d017d5e-1327-4efc-8ecf-b54a76857115\") "
Jul 30 15:15:58.562531 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.562508    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-bundle" (OuterVolumeSpecName: "bundle") pod "4d017d5e-1327-4efc-8ecf-b54a76857115" (UID: "4d017d5e-1327-4efc-8ecf-b54a76857115"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:15:58.563942 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.563917    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4d017d5e-1327-4efc-8ecf-b54a76857115-kube-api-access-gc74m" (OuterVolumeSpecName: "kube-api-access-gc74m") pod "4d017d5e-1327-4efc-8ecf-b54a76857115" (UID: "4d017d5e-1327-4efc-8ecf-b54a76857115"). InnerVolumeSpecName "kube-api-access-gc74m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:15:58.567707 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.567682    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-util" (OuterVolumeSpecName: "util") pod "4d017d5e-1327-4efc-8ecf-b54a76857115" (UID: "4d017d5e-1327-4efc-8ecf-b54a76857115"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:15:58.662432 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.662388    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:15:58.662432 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.662413    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc74m\" (UniqueName: \"kubernetes.io/projected/4d017d5e-1327-4efc-8ecf-b54a76857115-kube-api-access-gc74m\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:15:58.662432 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:58.662438    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4d017d5e-1327-4efc-8ecf-b54a76857115-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:15:59.280492 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:59.280457    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb" event={"ID":"4d017d5e-1327-4efc-8ecf-b54a76857115","Type":"ContainerDied","Data":"a670e2a6e4fe98efca396d3f7c36bdc9d0c7ab8bcd3f181b151405afc6efce30"}
Jul 30 15:15:59.280492 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:59.280485    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540pjdbb"
Jul 30 15:15:59.280726 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:15:59.280503    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a670e2a6e4fe98efca396d3f7c36bdc9d0c7ab8bcd3f181b151405afc6efce30"
Jul 30 15:16:06.487753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.487719    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"]
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.487995    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="util"
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.488006    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="util"
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.488014    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="pull"
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.488019    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="pull"
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.488024    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="extract"
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.488031    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="extract"
Jul 30 15:16:06.488193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.488083    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4d017d5e-1327-4efc-8ecf-b54a76857115" containerName="extract"
Jul 30 15:16:06.491128 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.491111    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.494576 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.494556    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 30 15:16:06.494784 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.494769    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v22zz\""
Jul 30 15:16:06.498335 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.498317    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 30 15:16:06.510650 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.510628    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"]
Jul 30 15:16:06.616058 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.616032    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67f958ca-aad2-4714-a946-a592c7e7ba06-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rzj6r\" (UID: \"67f958ca-aad2-4714-a946-a592c7e7ba06\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.616193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.616082    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n2p7m\" (UniqueName: \"kubernetes.io/projected/67f958ca-aad2-4714-a946-a592c7e7ba06-kube-api-access-n2p7m\") pod \"cert-manager-operator-controller-manager-55c444bf86-rzj6r\" (UID: \"67f958ca-aad2-4714-a946-a592c7e7ba06\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.716451 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.716404    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67f958ca-aad2-4714-a946-a592c7e7ba06-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rzj6r\" (UID: \"67f958ca-aad2-4714-a946-a592c7e7ba06\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.716593 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.716480    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n2p7m\" (UniqueName: \"kubernetes.io/projected/67f958ca-aad2-4714-a946-a592c7e7ba06-kube-api-access-n2p7m\") pod \"cert-manager-operator-controller-manager-55c444bf86-rzj6r\" (UID: \"67f958ca-aad2-4714-a946-a592c7e7ba06\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.716760 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.716736    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/67f958ca-aad2-4714-a946-a592c7e7ba06-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-rzj6r\" (UID: \"67f958ca-aad2-4714-a946-a592c7e7ba06\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.731932 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.731905    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n2p7m\" (UniqueName: \"kubernetes.io/projected/67f958ca-aad2-4714-a946-a592c7e7ba06-kube-api-access-n2p7m\") pod \"cert-manager-operator-controller-manager-55c444bf86-rzj6r\" (UID: \"67f958ca-aad2-4714-a946-a592c7e7ba06\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.799602 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.799538    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"
Jul 30 15:16:06.932245 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:06.932219    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r"]
Jul 30 15:16:06.935204 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:16:06.935166    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f958ca_aad2_4714_a946_a592c7e7ba06.slice/crio-c83639344febeca41109f1e1c0cf5b4112c07abae882eea8fecf0d59f3b3412e WatchSource:0}: Error finding container c83639344febeca41109f1e1c0cf5b4112c07abae882eea8fecf0d59f3b3412e: Status 404 returned error can't find the container with id c83639344febeca41109f1e1c0cf5b4112c07abae882eea8fecf0d59f3b3412e
Jul 30 15:16:07.311352 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:07.311321    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r" event={"ID":"67f958ca-aad2-4714-a946-a592c7e7ba06","Type":"ContainerStarted","Data":"c83639344febeca41109f1e1c0cf5b4112c07abae882eea8fecf0d59f3b3412e"}
Jul 30 15:16:10.330326 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:10.330288    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r" event={"ID":"67f958ca-aad2-4714-a946-a592c7e7ba06","Type":"ContainerStarted","Data":"1629a6526d97aa018b44cb93698c6f7bdad94a00c4dcb54cb1467e70ef201542"}
Jul 30 15:16:10.354589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:10.354547    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-rzj6r" podStartSLOduration=1.876730567 podStartE2EDuration="4.354533211s" totalImagesPullingTime="2.477802644s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:16:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:16:10.352367414 +0000 UTC m=+368.958215538" watchObservedRunningTime="2026-07-30 15:16:10.354533211 +0000 UTC m=+368.960381314"
Jul 30 15:16:11.363090 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.363061    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"]
Jul 30 15:16:11.366426 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.366399    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.369268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.369244    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 15:16:11.369268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.369267    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 15:16:11.370355 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.370329    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fvwk8\""
Jul 30 15:16:11.379026 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.379006    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"]
Jul 30 15:16:11.449642 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.449622    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.449758 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.449653    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.449758 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.449688    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6m8b\" (UniqueName: \"kubernetes.io/projected/da08c79c-4553-4e07-a684-83e1be5dd3ec-kube-api-access-h6m8b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.549944 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.549919    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.550110 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.549968    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6m8b\" (UniqueName: \"kubernetes.io/projected/da08c79c-4553-4e07-a684-83e1be5dd3ec-kube-api-access-h6m8b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.550110 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.550007    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.550276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.550257    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.550314 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.550282    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.558531 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.558507    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6m8b\" (UniqueName: \"kubernetes.io/projected/da08c79c-4553-4e07-a684-83e1be5dd3ec-kube-api-access-h6m8b\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.675261 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.675239    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:11.801107 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:11.801077    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"]
Jul 30 15:16:11.804585 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:16:11.804561    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda08c79c_4553_4e07_a684_83e1be5dd3ec.slice/crio-6c8e88d0b72c5de71cdbcd618b495d0e94937e507c98f1bcf61f14b888a32404 WatchSource:0}: Error finding container 6c8e88d0b72c5de71cdbcd618b495d0e94937e507c98f1bcf61f14b888a32404: Status 404 returned error can't find the container with id 6c8e88d0b72c5de71cdbcd618b495d0e94937e507c98f1bcf61f14b888a32404
Jul 30 15:16:12.340910 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:12.340875    2553 generic.go:356] "Generic (PLEG): container finished" podID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerID="6764d904aedcefc06ab08f9d5677114478fda58a7895c2d58b23363ab3408bbc" exitCode=0
Jul 30 15:16:12.341086 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:12.340961    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn" event={"ID":"da08c79c-4553-4e07-a684-83e1be5dd3ec","Type":"ContainerDied","Data":"6764d904aedcefc06ab08f9d5677114478fda58a7895c2d58b23363ab3408bbc"}
Jul 30 15:16:12.341086 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:12.341019    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn" event={"ID":"da08c79c-4553-4e07-a684-83e1be5dd3ec","Type":"ContainerStarted","Data":"6c8e88d0b72c5de71cdbcd618b495d0e94937e507c98f1bcf61f14b888a32404"}
Jul 30 15:16:14.350929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:14.350899    2553 generic.go:356] "Generic (PLEG): container finished" podID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerID="b85f4c4af921e78aa3e51b1aac0c6c413736405be414bd165f295bdbada8a174" exitCode=0
Jul 30 15:16:14.351294 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:14.350954    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn" event={"ID":"da08c79c-4553-4e07-a684-83e1be5dd3ec","Type":"ContainerDied","Data":"b85f4c4af921e78aa3e51b1aac0c6c413736405be414bd165f295bdbada8a174"}
Jul 30 15:16:15.356803 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:15.356769    2553 generic.go:356] "Generic (PLEG): container finished" podID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerID="1fdd93d36501220bb079c0b5c4949b4faa8d7286215f1e78bce4a1fcf62a221a" exitCode=0
Jul 30 15:16:15.357173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:15.356822    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn" event={"ID":"da08c79c-4553-4e07-a684-83e1be5dd3ec","Type":"ContainerDied","Data":"1fdd93d36501220bb079c0b5c4949b4faa8d7286215f1e78bce4a1fcf62a221a"}
Jul 30 15:16:16.501363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.501339    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:16.584511 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.584483    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6m8b\" (UniqueName: \"kubernetes.io/projected/da08c79c-4553-4e07-a684-83e1be5dd3ec-kube-api-access-h6m8b\") pod \"da08c79c-4553-4e07-a684-83e1be5dd3ec\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") "
Jul 30 15:16:16.584625 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.584518    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-bundle\") pod \"da08c79c-4553-4e07-a684-83e1be5dd3ec\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") "
Jul 30 15:16:16.584625 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.584550    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-util\") pod \"da08c79c-4553-4e07-a684-83e1be5dd3ec\" (UID: \"da08c79c-4553-4e07-a684-83e1be5dd3ec\") "
Jul 30 15:16:16.584904 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.584876    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-bundle" (OuterVolumeSpecName: "bundle") pod "da08c79c-4553-4e07-a684-83e1be5dd3ec" (UID: "da08c79c-4553-4e07-a684-83e1be5dd3ec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:16:16.586533 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.586510    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da08c79c-4553-4e07-a684-83e1be5dd3ec-kube-api-access-h6m8b" (OuterVolumeSpecName: "kube-api-access-h6m8b") pod "da08c79c-4553-4e07-a684-83e1be5dd3ec" (UID: "da08c79c-4553-4e07-a684-83e1be5dd3ec"). InnerVolumeSpecName "kube-api-access-h6m8b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:16:16.590388 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.590362    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-util" (OuterVolumeSpecName: "util") pod "da08c79c-4553-4e07-a684-83e1be5dd3ec" (UID: "da08c79c-4553-4e07-a684-83e1be5dd3ec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:16:16.685386 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.685362    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6m8b\" (UniqueName: \"kubernetes.io/projected/da08c79c-4553-4e07-a684-83e1be5dd3ec-kube-api-access-h6m8b\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:16:16.685386 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.685382    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:16:16.685386 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:16.685390    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da08c79c-4553-4e07-a684-83e1be5dd3ec-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:16:17.154876 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.154797    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2qspl"]
Jul 30 15:16:17.155071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155058    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="pull"
Jul 30 15:16:17.155117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155072    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="pull"
Jul 30 15:16:17.155117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155089    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="extract"
Jul 30 15:16:17.155117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155095    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="extract"
Jul 30 15:16:17.155117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155100    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="util"
Jul 30 15:16:17.155117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155106    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="util"
Jul 30 15:16:17.155262 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.155148    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="da08c79c-4553-4e07-a684-83e1be5dd3ec" containerName="extract"
Jul 30 15:16:17.156932 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.156914    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.160133 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.160106    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-86plr\""
Jul 30 15:16:17.160239 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.160134    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 30 15:16:17.161213 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.161186    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 30 15:16:17.173791 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.173771    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2qspl"]
Jul 30 15:16:17.188052 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.188032    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bp2b\" (UniqueName: \"kubernetes.io/projected/d18435fb-8826-4620-a2dd-64bce8bf079e-kube-api-access-6bp2b\") pod \"cert-manager-webhook-6486ffd997-2qspl\" (UID: \"d18435fb-8826-4620-a2dd-64bce8bf079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.188138 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.188062    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d18435fb-8826-4620-a2dd-64bce8bf079e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2qspl\" (UID: \"d18435fb-8826-4620-a2dd-64bce8bf079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.288786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.288756    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bp2b\" (UniqueName: \"kubernetes.io/projected/d18435fb-8826-4620-a2dd-64bce8bf079e-kube-api-access-6bp2b\") pod \"cert-manager-webhook-6486ffd997-2qspl\" (UID: \"d18435fb-8826-4620-a2dd-64bce8bf079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.288918 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.288792    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d18435fb-8826-4620-a2dd-64bce8bf079e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2qspl\" (UID: \"d18435fb-8826-4620-a2dd-64bce8bf079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.299870 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.299839    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d18435fb-8826-4620-a2dd-64bce8bf079e-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-2qspl\" (UID: \"d18435fb-8826-4620-a2dd-64bce8bf079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.300735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.300092    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bp2b\" (UniqueName: \"kubernetes.io/projected/d18435fb-8826-4620-a2dd-64bce8bf079e-kube-api-access-6bp2b\") pod \"cert-manager-webhook-6486ffd997-2qspl\" (UID: \"d18435fb-8826-4620-a2dd-64bce8bf079e\") " pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.366765 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.366739    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn" event={"ID":"da08c79c-4553-4e07-a684-83e1be5dd3ec","Type":"ContainerDied","Data":"6c8e88d0b72c5de71cdbcd618b495d0e94937e507c98f1bcf61f14b888a32404"}
Jul 30 15:16:17.366874 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.366777    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmxjmn"
Jul 30 15:16:17.366874 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.366782    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6c8e88d0b72c5de71cdbcd618b495d0e94937e507c98f1bcf61f14b888a32404"
Jul 30 15:16:17.465974 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.465947    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:17.592107 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:17.592090    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-2qspl"]
Jul 30 15:16:17.594648 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:16:17.594620    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd18435fb_8826_4620_a2dd_64bce8bf079e.slice/crio-008b125cda931a503f0baef462fa4df4e5da7a4adc778c69b4b6d7c75bf4e65b WatchSource:0}: Error finding container 008b125cda931a503f0baef462fa4df4e5da7a4adc778c69b4b6d7c75bf4e65b: Status 404 returned error can't find the container with id 008b125cda931a503f0baef462fa4df4e5da7a4adc778c69b4b6d7c75bf4e65b
Jul 30 15:16:18.373078 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:18.373041    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl" event={"ID":"d18435fb-8826-4620-a2dd-64bce8bf079e","Type":"ContainerStarted","Data":"008b125cda931a503f0baef462fa4df4e5da7a4adc778c69b4b6d7c75bf4e65b"}
Jul 30 15:16:20.385440 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:20.385346    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl" event={"ID":"d18435fb-8826-4620-a2dd-64bce8bf079e","Type":"ContainerStarted","Data":"fe9b2a45fd3b41c85e22c037312a9f2fcd725b24c89951c8d13823c811509b58"}
Jul 30 15:16:20.385788 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:20.385531    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:20.416623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:20.416586    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl" podStartSLOduration=0.937895261 podStartE2EDuration="3.416573224s" totalImagesPullingTime="2.478677963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:16:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:16:20.415757131 +0000 UTC m=+379.021605234" watchObservedRunningTime="2026-07-30 15:16:20.416573224 +0000 UTC m=+379.022421327"
Jul 30 15:16:26.392112 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:26.392071    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-2qspl"
Jul 30 15:16:27.949752 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:27.949716    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"]
Jul 30 15:16:27.954395 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:27.954376    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:27.957370 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:27.957352    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-fvwk8\""
Jul 30 15:16:27.957858 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:27.957838    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 30 15:16:27.958447 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:27.958431    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 30 15:16:27.962100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:27.961991    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"]
Jul 30 15:16:28.067739 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.067718    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.067879 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.067766    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttpbz\" (UniqueName: \"kubernetes.io/projected/08c9c4f1-996a-4c21-b678-f1162d041555-kube-api-access-ttpbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.067879 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.067867    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.169111 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.169082    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.169217 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.169143    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.169217 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.169198    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttpbz\" (UniqueName: \"kubernetes.io/projected/08c9c4f1-996a-4c21-b678-f1162d041555-kube-api-access-ttpbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.169441 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.169404    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.169543 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.169489    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.177644 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.177626    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttpbz\" (UniqueName: \"kubernetes.io/projected/08c9c4f1-996a-4c21-b678-f1162d041555-kube-api-access-ttpbz\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.264923 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.264876    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:28.389667 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.389638    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"]
Jul 30 15:16:28.392013 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:16:28.391984    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08c9c4f1_996a_4c21_b678_f1162d041555.slice/crio-3d1023ae0b91fd91e6838e7c1c40234999442678b39ba0c819518a5346dbc7d0 WatchSource:0}: Error finding container 3d1023ae0b91fd91e6838e7c1c40234999442678b39ba0c819518a5346dbc7d0: Status 404 returned error can't find the container with id 3d1023ae0b91fd91e6838e7c1c40234999442678b39ba0c819518a5346dbc7d0
Jul 30 15:16:28.418632 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:28.418605    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff" event={"ID":"08c9c4f1-996a-4c21-b678-f1162d041555","Type":"ContainerStarted","Data":"3d1023ae0b91fd91e6838e7c1c40234999442678b39ba0c819518a5346dbc7d0"}
Jul 30 15:16:29.424803 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:29.424769    2553 generic.go:356] "Generic (PLEG): container finished" podID="08c9c4f1-996a-4c21-b678-f1162d041555" containerID="1c5e2754f9ec32260c35046b4f21afd145863114f427c7fbfcaa061938fbd852" exitCode=0
Jul 30 15:16:29.425196 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:29.424856    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff" event={"ID":"08c9c4f1-996a-4c21-b678-f1162d041555","Type":"ContainerDied","Data":"1c5e2754f9ec32260c35046b4f21afd145863114f427c7fbfcaa061938fbd852"}
Jul 30 15:16:31.435969 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:31.435935    2553 generic.go:356] "Generic (PLEG): container finished" podID="08c9c4f1-996a-4c21-b678-f1162d041555" containerID="00be375f4f678822b79b970eb69f632d7f96ee221c2b917e1eeeb98c348ea67d" exitCode=0
Jul 30 15:16:31.436319 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:31.435997    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff" event={"ID":"08c9c4f1-996a-4c21-b678-f1162d041555","Type":"ContainerDied","Data":"00be375f4f678822b79b970eb69f632d7f96ee221c2b917e1eeeb98c348ea67d"}
Jul 30 15:16:32.441671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:32.441641    2553 generic.go:356] "Generic (PLEG): container finished" podID="08c9c4f1-996a-4c21-b678-f1162d041555" containerID="294fa098ccb56aabf9878f5b42cf1590b50a4bceae2880846f095c33485ef7d4" exitCode=0
Jul 30 15:16:32.442041 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:32.441686    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff" event={"ID":"08c9c4f1-996a-4c21-b678-f1162d041555","Type":"ContainerDied","Data":"294fa098ccb56aabf9878f5b42cf1590b50a4bceae2880846f095c33485ef7d4"}
Jul 30 15:16:33.570413 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.570391    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:33.606865 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.606841    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-util\") pod \"08c9c4f1-996a-4c21-b678-f1162d041555\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") "
Jul 30 15:16:33.606963 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.606874    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-bundle\") pod \"08c9c4f1-996a-4c21-b678-f1162d041555\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") "
Jul 30 15:16:33.606963 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.606900    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttpbz\" (UniqueName: \"kubernetes.io/projected/08c9c4f1-996a-4c21-b678-f1162d041555-kube-api-access-ttpbz\") pod \"08c9c4f1-996a-4c21-b678-f1162d041555\" (UID: \"08c9c4f1-996a-4c21-b678-f1162d041555\") "
Jul 30 15:16:33.607589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.607564    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-bundle" (OuterVolumeSpecName: "bundle") pod "08c9c4f1-996a-4c21-b678-f1162d041555" (UID: "08c9c4f1-996a-4c21-b678-f1162d041555"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:16:33.608889 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.608866    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08c9c4f1-996a-4c21-b678-f1162d041555-kube-api-access-ttpbz" (OuterVolumeSpecName: "kube-api-access-ttpbz") pod "08c9c4f1-996a-4c21-b678-f1162d041555" (UID: "08c9c4f1-996a-4c21-b678-f1162d041555"). InnerVolumeSpecName "kube-api-access-ttpbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:16:33.618117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.618092    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-util" (OuterVolumeSpecName: "util") pod "08c9c4f1-996a-4c21-b678-f1162d041555" (UID: "08c9c4f1-996a-4c21-b678-f1162d041555"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:16:33.707521 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.707471    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:16:33.707521 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.707491    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/08c9c4f1-996a-4c21-b678-f1162d041555-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:16:33.707521 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:33.707500    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttpbz\" (UniqueName: \"kubernetes.io/projected/08c9c4f1-996a-4c21-b678-f1162d041555-kube-api-access-ttpbz\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:16:34.452438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:34.452394    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff"
Jul 30 15:16:34.452591 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:34.452411    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afrdfff" event={"ID":"08c9c4f1-996a-4c21-b678-f1162d041555","Type":"ContainerDied","Data":"3d1023ae0b91fd91e6838e7c1c40234999442678b39ba0c819518a5346dbc7d0"}
Jul 30 15:16:34.452591 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:34.452480    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d1023ae0b91fd91e6838e7c1c40234999442678b39ba0c819518a5346dbc7d0"
Jul 30 15:16:47.293098 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293064    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"]
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293334    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="util"
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293345    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="util"
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293353    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="extract"
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293359    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="extract"
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293371    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="pull"
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293378    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="pull"
Jul 30 15:16:47.293558 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.293440    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="08c9c4f1-996a-4c21-b678-f1162d041555" containerName="extract"
Jul 30 15:16:47.299216 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.299195    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.304396 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.304375    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-t7drl\""
Jul 30 15:16:47.305499 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.305471    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 30 15:16:47.305830 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.305812    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 30 15:16:47.305910 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.305822    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 30 15:16:47.306402 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.306035    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 30 15:16:47.323056 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.323034    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"]
Jul 30 15:16:47.400307 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.400276    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94f09838-36c3-48dd-b84d-d48ce8260ed6-tmp\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.400405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.400335    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94f09838-36c3-48dd-b84d-d48ce8260ed6-webhook-cert\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.400405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.400391    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj745\" (UniqueName: \"kubernetes.io/projected/94f09838-36c3-48dd-b84d-d48ce8260ed6-kube-api-access-jj745\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.400522 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.400447    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94f09838-36c3-48dd-b84d-d48ce8260ed6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.400522 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.400482    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94f09838-36c3-48dd-b84d-d48ce8260ed6-manifests\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.501177 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.501151    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94f09838-36c3-48dd-b84d-d48ce8260ed6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.501283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.501199    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94f09838-36c3-48dd-b84d-d48ce8260ed6-manifests\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.501283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.501245    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94f09838-36c3-48dd-b84d-d48ce8260ed6-tmp\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.501283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.501275    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94f09838-36c3-48dd-b84d-d48ce8260ed6-webhook-cert\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.501483 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.501307    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj745\" (UniqueName: \"kubernetes.io/projected/94f09838-36c3-48dd-b84d-d48ce8260ed6-kube-api-access-jj745\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.501656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.501635    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/94f09838-36c3-48dd-b84d-d48ce8260ed6-manifests\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.503611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.503583    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/94f09838-36c3-48dd-b84d-d48ce8260ed6-tmp\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.503696 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.503660    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/94f09838-36c3-48dd-b84d-d48ce8260ed6-webhook-cert\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.503746 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.503731    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/94f09838-36c3-48dd-b84d-d48ce8260ed6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.510602 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.510580    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj745\" (UniqueName: \"kubernetes.io/projected/94f09838-36c3-48dd-b84d-d48ce8260ed6-kube-api-access-jj745\") pod \"opendatahub-operator-controller-manager-56444d5c7b-58k4m\" (UID: \"94f09838-36c3-48dd-b84d-d48ce8260ed6\") " pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.609637 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.609591    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:47.753358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:47.753333    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"]
Jul 30 15:16:47.756052 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:16:47.756027    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f09838_36c3_48dd_b84d_d48ce8260ed6.slice/crio-0a9b0031d831a299d22a9e3143621a85c24f366737f3170d0f54302ca98efa16 WatchSource:0}: Error finding container 0a9b0031d831a299d22a9e3143621a85c24f366737f3170d0f54302ca98efa16: Status 404 returned error can't find the container with id 0a9b0031d831a299d22a9e3143621a85c24f366737f3170d0f54302ca98efa16
Jul 30 15:16:48.516015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:48.515977    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m" event={"ID":"94f09838-36c3-48dd-b84d-d48ce8260ed6","Type":"ContainerStarted","Data":"0a9b0031d831a299d22a9e3143621a85c24f366737f3170d0f54302ca98efa16"}
Jul 30 15:16:51.530837 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:51.530804    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m" event={"ID":"94f09838-36c3-48dd-b84d-d48ce8260ed6","Type":"ContainerStarted","Data":"b89fb236f5c7d7bcc1882dd998401140073fa171622486b1e9019944401bb228"}
Jul 30 15:16:52.536354 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:52.536321    2553 generic.go:356] "Generic (PLEG): container finished" podID="94f09838-36c3-48dd-b84d-d48ce8260ed6" containerID="b89fb236f5c7d7bcc1882dd998401140073fa171622486b1e9019944401bb228" exitCode=0
Jul 30 15:16:52.536783 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:52.536396    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m" event={"ID":"94f09838-36c3-48dd-b84d-d48ce8260ed6","Type":"ContainerDied","Data":"b89fb236f5c7d7bcc1882dd998401140073fa171622486b1e9019944401bb228"}
Jul 30 15:16:54.546106 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:54.546026    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m" event={"ID":"94f09838-36c3-48dd-b84d-d48ce8260ed6","Type":"ContainerStarted","Data":"7b96fcb02094595abf0650da828234560f033cbb4075c7b312e66412b489ed25"}
Jul 30 15:16:54.546468 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:54.546158    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:16:54.575863 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:16:54.575818    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m" podStartSLOduration=1.779916396 podStartE2EDuration="7.575796362s" totalImagesPullingTime="4.723034623s" totalInitContainerRuntime="1.072845343s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:16:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:16:54.575143047 +0000 UTC m=+413.180991235" watchObservedRunningTime="2026-07-30 15:16:54.575796362 +0000 UTC m=+413.181644878"
Jul 30 15:17:05.552866 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:05.552828    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-56444d5c7b-58k4m"
Jul 30 15:17:08.569390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.569347    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p4846"]
Jul 30 15:17:08.577958 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.577923    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:08.581817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.581789    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 30 15:17:08.582723 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.582702    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-srw4b\""
Jul 30 15:17:08.639404 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.639364    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p4846"]
Jul 30 15:17:08.651670 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.651630    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wfptd\" (UniqueName: \"kubernetes.io/projected/b7540d4d-477a-48f3-99dc-64cb16a8018c-kube-api-access-wfptd\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:08.651861 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.651699    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7540d4d-477a-48f3-99dc-64cb16a8018c-cert\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:08.752467 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.752392    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wfptd\" (UniqueName: \"kubernetes.io/projected/b7540d4d-477a-48f3-99dc-64cb16a8018c-kube-api-access-wfptd\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:08.752738 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.752501    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7540d4d-477a-48f3-99dc-64cb16a8018c-cert\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:08.752738 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:17:08.752606    2553 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 30 15:17:08.752738 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:17:08.752671    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b7540d4d-477a-48f3-99dc-64cb16a8018c-cert podName:b7540d4d-477a-48f3-99dc-64cb16a8018c nodeName:}" failed. No retries permitted until 2026-07-30 15:17:09.252650323 +0000 UTC m=+427.858498403 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b7540d4d-477a-48f3-99dc-64cb16a8018c-cert") pod "odh-model-controller-7998c67dc4-p4846" (UID: "b7540d4d-477a-48f3-99dc-64cb16a8018c") : secret "odh-model-controller-webhook-cert" not found
Jul 30 15:17:08.781130 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:08.781089    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wfptd\" (UniqueName: \"kubernetes.io/projected/b7540d4d-477a-48f3-99dc-64cb16a8018c-kube-api-access-wfptd\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:09.258153 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.258111    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7540d4d-477a-48f3-99dc-64cb16a8018c-cert\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:09.260740 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.260701    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b7540d4d-477a-48f3-99dc-64cb16a8018c-cert\") pod \"odh-model-controller-7998c67dc4-p4846\" (UID: \"b7540d4d-477a-48f3-99dc-64cb16a8018c\") " pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:09.464598 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.464552    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ttgjv"]
Jul 30 15:17:09.468067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.468034    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:09.470910 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.470856    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 30 15:17:09.471116 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.471101    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-kd6kb\""
Jul 30 15:17:09.489695 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.489662    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:09.490389 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.490365    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ttgjv"]
Jul 30 15:17:09.560860 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.560816    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nk6gx\" (UniqueName: \"kubernetes.io/projected/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-kube-api-access-nk6gx\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:09.561032 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.560884    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:09.642648 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.642612    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-p4846"]
Jul 30 15:17:09.645974 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:17:09.645938    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7540d4d_477a_48f3_99dc_64cb16a8018c.slice/crio-8fc79a5ae482c9888dc3ec47b5eab2356bfcb4bbd3cadc7772c3d3b702109c54 WatchSource:0}: Error finding container 8fc79a5ae482c9888dc3ec47b5eab2356bfcb4bbd3cadc7772c3d3b702109c54: Status 404 returned error can't find the container with id 8fc79a5ae482c9888dc3ec47b5eab2356bfcb4bbd3cadc7772c3d3b702109c54
Jul 30 15:17:09.662054 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.662015    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nk6gx\" (UniqueName: \"kubernetes.io/projected/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-kube-api-access-nk6gx\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:09.662248 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.662070    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:09.662248 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:17:09.662168    2553 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jul 30 15:17:09.662248 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:17:09.662230    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-tls-certs podName:a96bbfd4-3a24-4894-a45e-9fc33f5568c9 nodeName:}" failed. No retries permitted until 2026-07-30 15:17:10.162213062 +0000 UTC m=+428.768061143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-tls-certs") pod "model-serving-api-54d89bd5fc-ttgjv" (UID: "a96bbfd4-3a24-4894-a45e-9fc33f5568c9") : secret "model-serving-api-tls" not found
Jul 30 15:17:09.721981 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:09.721946    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nk6gx\" (UniqueName: \"kubernetes.io/projected/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-kube-api-access-nk6gx\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:10.151173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.151136    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"]
Jul 30 15:17:10.155879 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.155851    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.158708 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.158675    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 30 15:17:10.158708 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.158695    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 30 15:17:10.158922 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.158683    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 30 15:17:10.158922 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.158788    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-mkqrq\""
Jul 30 15:17:10.164560 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.164542    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 30 15:17:10.165451 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.165429    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:10.168272 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.168251    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a96bbfd4-3a24-4894-a45e-9fc33f5568c9-tls-certs\") pod \"model-serving-api-54d89bd5fc-ttgjv\" (UID: \"a96bbfd4-3a24-4894-a45e-9fc33f5568c9\") " pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:10.168985 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.168965    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"]
Jul 30 15:17:10.266741 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.266710    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22676ba-2271-4125-951d-12202de0c52b-tls-certs\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.266917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.266751    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-264p4\" (UniqueName: \"kubernetes.io/projected/e22676ba-2271-4125-951d-12202de0c52b-kube-api-access-264p4\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.266917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.266791    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e22676ba-2271-4125-951d-12202de0c52b-tmp\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.368088 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.368053    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e22676ba-2271-4125-951d-12202de0c52b-tmp\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.368254 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.368125    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22676ba-2271-4125-951d-12202de0c52b-tls-certs\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.368254 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.368164    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-264p4\" (UniqueName: \"kubernetes.io/projected/e22676ba-2271-4125-951d-12202de0c52b-kube-api-access-264p4\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.370671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.370634    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e22676ba-2271-4125-951d-12202de0c52b-tmp\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.370829 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.370811    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e22676ba-2271-4125-951d-12202de0c52b-tls-certs\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.379024 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.378989    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:10.381016 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.380991    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-264p4\" (UniqueName: \"kubernetes.io/projected/e22676ba-2271-4125-951d-12202de0c52b-kube-api-access-264p4\") pod \"kube-auth-proxy-6976f6d894-t8w5r\" (UID: \"e22676ba-2271-4125-951d-12202de0c52b\") " pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.465813 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.465671    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"
Jul 30 15:17:10.532475 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.532445    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-ttgjv"]
Jul 30 15:17:10.538856 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:17:10.538809    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda96bbfd4_3a24_4894_a45e_9fc33f5568c9.slice/crio-ad3f66d3fccb77faa8f63cdc13b07340c97885791febe24b6d14c6518aaef0a6 WatchSource:0}: Error finding container ad3f66d3fccb77faa8f63cdc13b07340c97885791febe24b6d14c6518aaef0a6: Status 404 returned error can't find the container with id ad3f66d3fccb77faa8f63cdc13b07340c97885791febe24b6d14c6518aaef0a6
Jul 30 15:17:10.621487 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.621454    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r"]
Jul 30 15:17:10.622256 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.622217    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv" event={"ID":"a96bbfd4-3a24-4894-a45e-9fc33f5568c9","Type":"ContainerStarted","Data":"ad3f66d3fccb77faa8f63cdc13b07340c97885791febe24b6d14c6518aaef0a6"}
Jul 30 15:17:10.623579 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:10.623490    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p4846" event={"ID":"b7540d4d-477a-48f3-99dc-64cb16a8018c","Type":"ContainerStarted","Data":"8fc79a5ae482c9888dc3ec47b5eab2356bfcb4bbd3cadc7772c3d3b702109c54"}
Jul 30 15:17:10.623579 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:17:10.623562    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode22676ba_2271_4125_951d_12202de0c52b.slice/crio-835de33775d4acf0852a9bbf3846953b30d159f0f165662664b03ec717f8ccd6 WatchSource:0}: Error finding container 835de33775d4acf0852a9bbf3846953b30d159f0f165662664b03ec717f8ccd6: Status 404 returned error can't find the container with id 835de33775d4acf0852a9bbf3846953b30d159f0f165662664b03ec717f8ccd6
Jul 30 15:17:11.401948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.401902    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"]
Jul 30 15:17:11.405693 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.405657    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.408618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.408539    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 15:17:11.408618 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.408598    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 30 15:17:11.408892 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.408875    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-45ptg\""
Jul 30 15:17:11.408975 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.408876    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 30 15:17:11.408975 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.408936    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 30 15:17:11.421844 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.421806    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"]
Jul 30 15:17:11.477401 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477365    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.477401 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477406    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b4t\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-kube-api-access-f4b4t\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.477648 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477477    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.477648 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477524    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.477648 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477618    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.477818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/973b5fa3-08f9-4642-bc14-ef17986ffdb5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.477818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.477699    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.579067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579023    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/973b5fa3-08f9-4642-bc14-ef17986ffdb5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579706    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579780    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579835    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b4t\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-kube-api-access-f4b4t\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579869    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.579897    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.581233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.580863    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.585219 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.585146    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.585219 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.585216    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.585819 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.585770    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/973b5fa3-08f9-4642-bc14-ef17986ffdb5-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.586478 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.586450    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.591583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.591551    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b4t\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-kube-api-access-f4b4t\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.591750 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.591557    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rbdr7\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:11.630439 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.630378    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r" event={"ID":"e22676ba-2271-4125-951d-12202de0c52b","Type":"ContainerStarted","Data":"835de33775d4acf0852a9bbf3846953b30d159f0f165662664b03ec717f8ccd6"}
Jul 30 15:17:11.718192 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:11.718139    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:13.340578 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.340543    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"]
Jul 30 15:17:13.342357 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:17:13.342320    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973b5fa3_08f9_4642_bc14_ef17986ffdb5.slice/crio-c36f9fd56b60f197c0d486657cc2981af1ee308b567081417d751a7f7c086ffc WatchSource:0}: Error finding container c36f9fd56b60f197c0d486657cc2981af1ee308b567081417d751a7f7c086ffc: Status 404 returned error can't find the container with id c36f9fd56b60f197c0d486657cc2981af1ee308b567081417d751a7f7c086ffc
Jul 30 15:17:13.642867 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.642767    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv" event={"ID":"a96bbfd4-3a24-4894-a45e-9fc33f5568c9","Type":"ContainerStarted","Data":"e97efdcc20324723871584f9c05a1bd83d3b385a2a10eb1b1b41d9cf5d389a93"}
Jul 30 15:17:13.643154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.642893    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:13.644887 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.644819    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-p4846" event={"ID":"b7540d4d-477a-48f3-99dc-64cb16a8018c","Type":"ContainerStarted","Data":"ede6008f89cfe26444a31887906a028accaba603a5622d3530e916b17b344517"}
Jul 30 15:17:13.645054 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.644912    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:13.646492 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.646459    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7" event={"ID":"973b5fa3-08f9-4642-bc14-ef17986ffdb5","Type":"ContainerStarted","Data":"c36f9fd56b60f197c0d486657cc2981af1ee308b567081417d751a7f7c086ffc"}
Jul 30 15:17:13.699547 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.699483    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv" podStartSLOduration=2.056040889 podStartE2EDuration="4.699455027s" totalImagesPullingTime="2.643414138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:17:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:17:13.697870159 +0000 UTC m=+432.303718265" watchObservedRunningTime="2026-07-30 15:17:13.699455027 +0000 UTC m=+432.305303134"
Jul 30 15:17:13.745732 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:13.745671    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-p4846" podStartSLOduration=2.21026035 podStartE2EDuration="5.745651986s" totalImagesPullingTime="3.535391636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:17:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:17:13.743840026 +0000 UTC m=+432.349688132" watchObservedRunningTime="2026-07-30 15:17:13.745651986 +0000 UTC m=+432.351500088"
Jul 30 15:17:16.271082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.271034    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 15:17:16.271538 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.271134    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 15:17:16.665405 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.665304    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r" event={"ID":"e22676ba-2271-4125-951d-12202de0c52b","Type":"ContainerStarted","Data":"4899a5ba25d6ae6e5c92d2535e42dde6010622fab1ee7a35139a3fbe418017b7"}
Jul 30 15:17:16.667090 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.667057    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7" event={"ID":"973b5fa3-08f9-4642-bc14-ef17986ffdb5","Type":"ContainerStarted","Data":"935407998fd3d07f9919fd8b7c1bf55aa4b01f86398176f4b8bc181da5f7a912"}
Jul 30 15:17:16.667252 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.667189    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:16.689401 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.689339    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6976f6d894-t8w5r" podStartSLOduration=1.1053716630000001 podStartE2EDuration="6.68932257s" totalImagesPullingTime="5.583950907s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:17:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:17:16.686813179 +0000 UTC m=+435.292661283" watchObservedRunningTime="2026-07-30 15:17:16.68932257 +0000 UTC m=+435.295170715"
Jul 30 15:17:16.713079 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:16.713020    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7" podStartSLOduration=2.787135732 podStartE2EDuration="5.713002569s" totalImagesPullingTime="2.925866837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:17:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:17:16.711401896 +0000 UTC m=+435.317250033" watchObservedRunningTime="2026-07-30 15:17:16.713002569 +0000 UTC m=+435.318850672"
Jul 30 15:17:17.674779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:17.674744    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:19.183656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.183617    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"]
Jul 30 15:17:19.187201 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.187182    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.193182 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.193154    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 30 15:17:19.193355 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.193242    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-nhmdm\""
Jul 30 15:17:19.217831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.217749    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"]
Jul 30 15:17:19.255093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.255050    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scvnv\" (UniqueName: \"kubernetes.io/projected/1679d8e2-e7d7-4feb-a909-35a691f63f9c-kube-api-access-scvnv\") pod \"llmisvc-controller-manager-777c6bd7d5-6kgnf\" (UID: \"1679d8e2-e7d7-4feb-a909-35a691f63f9c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.255093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.255104    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1679d8e2-e7d7-4feb-a909-35a691f63f9c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6kgnf\" (UID: \"1679d8e2-e7d7-4feb-a909-35a691f63f9c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.356071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.356032    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-scvnv\" (UniqueName: \"kubernetes.io/projected/1679d8e2-e7d7-4feb-a909-35a691f63f9c-kube-api-access-scvnv\") pod \"llmisvc-controller-manager-777c6bd7d5-6kgnf\" (UID: \"1679d8e2-e7d7-4feb-a909-35a691f63f9c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.356071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.356083    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1679d8e2-e7d7-4feb-a909-35a691f63f9c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6kgnf\" (UID: \"1679d8e2-e7d7-4feb-a909-35a691f63f9c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.358630 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.358606    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1679d8e2-e7d7-4feb-a909-35a691f63f9c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-6kgnf\" (UID: \"1679d8e2-e7d7-4feb-a909-35a691f63f9c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.370835 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.370806    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-scvnv\" (UniqueName: \"kubernetes.io/projected/1679d8e2-e7d7-4feb-a909-35a691f63f9c-kube-api-access-scvnv\") pod \"llmisvc-controller-manager-777c6bd7d5-6kgnf\" (UID: \"1679d8e2-e7d7-4feb-a909-35a691f63f9c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.497682 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.497577    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:19.662656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.662625    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"]
Jul 30 15:17:19.663966 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:17:19.663936    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod1679d8e2_e7d7_4feb_a909_35a691f63f9c.slice/crio-0fb4c21011142b8c3dc560537264ac1545fb6ffc413e8432fdd9629eb399e5f2 WatchSource:0}: Error finding container 0fb4c21011142b8c3dc560537264ac1545fb6ffc413e8432fdd9629eb399e5f2: Status 404 returned error can't find the container with id 0fb4c21011142b8c3dc560537264ac1545fb6ffc413e8432fdd9629eb399e5f2
Jul 30 15:17:19.683459 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:19.683401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf" event={"ID":"1679d8e2-e7d7-4feb-a909-35a691f63f9c","Type":"ContainerStarted","Data":"0fb4c21011142b8c3dc560537264ac1545fb6ffc413e8432fdd9629eb399e5f2"}
Jul 30 15:17:22.404513 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.404468    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"]
Jul 30 15:17:22.405050 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.404701    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7" podUID="973b5fa3-08f9-4642-bc14-ef17986ffdb5" containerName="discovery" containerID="cri-o://935407998fd3d07f9919fd8b7c1bf55aa4b01f86398176f4b8bc181da5f7a912" gracePeriod=30
Jul 30 15:17:22.701837 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.701797    2553 generic.go:356] "Generic (PLEG): container finished" podID="973b5fa3-08f9-4642-bc14-ef17986ffdb5" containerID="935407998fd3d07f9919fd8b7c1bf55aa4b01f86398176f4b8bc181da5f7a912" exitCode=0
Jul 30 15:17:22.702027 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.701864    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7" event={"ID":"973b5fa3-08f9-4642-bc14-ef17986ffdb5","Type":"ContainerDied","Data":"935407998fd3d07f9919fd8b7c1bf55aa4b01f86398176f4b8bc181da5f7a912"}
Jul 30 15:17:22.805645 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.805616    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:22.891045 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891002    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-dns-cert\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891058    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/973b5fa3-08f9-4642-bc14-ef17986ffdb5-local-certs\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891091    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-ca-configmap\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891119    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-kubeconfig\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891144    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-cacerts\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891196    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-token\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891224    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4b4t\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-kube-api-access-f4b4t\") pod \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\" (UID: \"973b5fa3-08f9-4642-bc14-ef17986ffdb5\") "
Jul 30 15:17:22.891706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.891658    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:17:22.893833 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.893793    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/973b5fa3-08f9-4642-bc14-ef17986ffdb5-local-certs" (OuterVolumeSpecName: "local-certs") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:17:22.893984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.893853    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:17:22.893984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.893899    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:17:22.894082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.894001    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-token" (OuterVolumeSpecName: "istio-token") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:17:22.894082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.894056    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-kube-api-access-f4b4t" (OuterVolumeSpecName: "kube-api-access-f4b4t") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "kube-api-access-f4b4t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:17:22.894634 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.894616    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-cacerts" (OuterVolumeSpecName: "cacerts") pod "973b5fa3-08f9-4642-bc14-ef17986ffdb5" (UID: "973b5fa3-08f9-4642-bc14-ef17986ffdb5"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:17:22.992374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992320    2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-dns-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:22.992374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992367    2553 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/973b5fa3-08f9-4642-bc14-ef17986ffdb5-local-certs\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:22.992374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992378    2553 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-csr-ca-configmap\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:22.992374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992386    2553 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-kubeconfig\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:22.992374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992396    2553 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/973b5fa3-08f9-4642-bc14-ef17986ffdb5-cacerts\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:22.992719 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992404    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-istio-token\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:22.992719 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:22.992412    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4b4t\" (UniqueName: \"kubernetes.io/projected/973b5fa3-08f9-4642-bc14-ef17986ffdb5-kube-api-access-f4b4t\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:17:23.708685 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.708652    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"
Jul 30 15:17:23.709220 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.708636    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7" event={"ID":"973b5fa3-08f9-4642-bc14-ef17986ffdb5","Type":"ContainerDied","Data":"c36f9fd56b60f197c0d486657cc2981af1ee308b567081417d751a7f7c086ffc"}
Jul 30 15:17:23.709220 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.708839    2553 scope.go:117] "RemoveContainer" containerID="935407998fd3d07f9919fd8b7c1bf55aa4b01f86398176f4b8bc181da5f7a912"
Jul 30 15:17:23.710464 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.710404    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf" event={"ID":"1679d8e2-e7d7-4feb-a909-35a691f63f9c","Type":"ContainerStarted","Data":"a70c84bafc598d9e5cb0d495e8eca572c9e9ac336204343f5f0a9ba7c94ef726"}
Jul 30 15:17:23.710585 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.710561    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:17:23.740113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.740051    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf" podStartSLOduration=1.701496987 podStartE2EDuration="4.740035597s" totalImagesPullingTime="3.03853861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:17:23.739677778 +0000 UTC m=+442.345525881" watchObservedRunningTime="2026-07-30 15:17:23.740035597 +0000 UTC m=+442.345883700"
Jul 30 15:17:23.759532 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.759494    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"]
Jul 30 15:17:23.765632 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.765596    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rbdr7"]
Jul 30 15:17:23.924280 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:23.924197    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="973b5fa3-08f9-4642-bc14-ef17986ffdb5" path="/var/lib/kubelet/pods/973b5fa3-08f9-4642-bc14-ef17986ffdb5/volumes"
Jul 30 15:17:24.655696 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:24.655664    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-p4846"
Jul 30 15:17:24.657639 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:24.657614    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-ttgjv"
Jul 30 15:17:54.720507 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:17:54.720474    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-6kgnf"
Jul 30 15:18:09.217107 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.217066    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7frlh"]
Jul 30 15:18:09.217545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.217400    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="973b5fa3-08f9-4642-bc14-ef17986ffdb5" containerName="discovery"
Jul 30 15:18:09.217545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.217413    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="973b5fa3-08f9-4642-bc14-ef17986ffdb5" containerName="discovery"
Jul 30 15:18:09.217545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.217493    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="973b5fa3-08f9-4642-bc14-ef17986ffdb5" containerName="discovery"
Jul 30 15:18:09.225631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.225602    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:09.228840 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.228818    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-k2p4m\""
Jul 30 15:18:09.231139 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.231119    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 30 15:18:09.231767 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.231743    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 30 15:18:09.242833 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.242794    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7frlh"]
Jul 30 15:18:09.380264 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.380231    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fg9mh\" (UniqueName: \"kubernetes.io/projected/e1b14157-52cd-4b20-81bc-67d8ce9e2543-kube-api-access-fg9mh\") pod \"kuadrant-operator-catalog-7frlh\" (UID: \"e1b14157-52cd-4b20-81bc-67d8ce9e2543\") " pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:09.430689 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.430647    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7frlh"]
Jul 30 15:18:09.430921 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:18:09.430902    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-fg9mh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-catalog-7frlh" podUID="e1b14157-52cd-4b20-81bc-67d8ce9e2543"
Jul 30 15:18:09.481646 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.481547    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fg9mh\" (UniqueName: \"kubernetes.io/projected/e1b14157-52cd-4b20-81bc-67d8ce9e2543-kube-api-access-fg9mh\") pod \"kuadrant-operator-catalog-7frlh\" (UID: \"e1b14157-52cd-4b20-81bc-67d8ce9e2543\") " pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:09.490504 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.490463    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fg9mh\" (UniqueName: \"kubernetes.io/projected/e1b14157-52cd-4b20-81bc-67d8ce9e2543-kube-api-access-fg9mh\") pod \"kuadrant-operator-catalog-7frlh\" (UID: \"e1b14157-52cd-4b20-81bc-67d8ce9e2543\") " pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:09.642393 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.642352    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tg4dn"]
Jul 30 15:18:09.646114 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.646096    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:09.654931 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.654901    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tg4dn"]
Jul 30 15:18:09.784624 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.784522    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cj6rd\" (UniqueName: \"kubernetes.io/projected/32ce58ac-00f8-4000-a8d7-0989949eb6ad-kube-api-access-cj6rd\") pod \"kuadrant-operator-catalog-tg4dn\" (UID: \"32ce58ac-00f8-4000-a8d7-0989949eb6ad\") " pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:09.885669 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.885629    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cj6rd\" (UniqueName: \"kubernetes.io/projected/32ce58ac-00f8-4000-a8d7-0989949eb6ad-kube-api-access-cj6rd\") pod \"kuadrant-operator-catalog-tg4dn\" (UID: \"32ce58ac-00f8-4000-a8d7-0989949eb6ad\") " pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:09.895241 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.895201    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cj6rd\" (UniqueName: \"kubernetes.io/projected/32ce58ac-00f8-4000-a8d7-0989949eb6ad-kube-api-access-cj6rd\") pod \"kuadrant-operator-catalog-tg4dn\" (UID: \"32ce58ac-00f8-4000-a8d7-0989949eb6ad\") " pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:09.922307 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.922271    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:09.930377 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.930352    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:09.957096 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:09.957056    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:10.086876 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.086839    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fg9mh\" (UniqueName: \"kubernetes.io/projected/e1b14157-52cd-4b20-81bc-67d8ce9e2543-kube-api-access-fg9mh\") pod \"e1b14157-52cd-4b20-81bc-67d8ce9e2543\" (UID: \"e1b14157-52cd-4b20-81bc-67d8ce9e2543\") "
Jul 30 15:18:10.089360 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.089326    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1b14157-52cd-4b20-81bc-67d8ce9e2543-kube-api-access-fg9mh" (OuterVolumeSpecName: "kube-api-access-fg9mh") pod "e1b14157-52cd-4b20-81bc-67d8ce9e2543" (UID: "e1b14157-52cd-4b20-81bc-67d8ce9e2543"). InnerVolumeSpecName "kube-api-access-fg9mh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:18:10.106483 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.100001    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tg4dn"]
Jul 30 15:18:10.188506 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.188465    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fg9mh\" (UniqueName: \"kubernetes.io/projected/e1b14157-52cd-4b20-81bc-67d8ce9e2543-kube-api-access-fg9mh\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:10.928206 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.928178    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7frlh"
Jul 30 15:18:10.928630 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.928169    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn" event={"ID":"32ce58ac-00f8-4000-a8d7-0989949eb6ad","Type":"ContainerStarted","Data":"cbc07f9eb0a05a3b78a440858cfd6b278f4ef5ff3510dbf0f3c86e37b7534e99"}
Jul 30 15:18:10.960299 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.960260    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7frlh"]
Jul 30 15:18:10.963358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:10.963323    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7frlh"]
Jul 30 15:18:11.925256 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:11.925218    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1b14157-52cd-4b20-81bc-67d8ce9e2543" path="/var/lib/kubelet/pods/e1b14157-52cd-4b20-81bc-67d8ce9e2543/volumes"
Jul 30 15:18:12.939636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:12.939595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn" event={"ID":"32ce58ac-00f8-4000-a8d7-0989949eb6ad","Type":"ContainerStarted","Data":"334fa6d1774de8b9a2fc7054fcda0299741b897f76a670d5731b2030a134cd87"}
Jul 30 15:18:12.956759 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:12.956704    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn" podStartSLOduration=1.617196732 podStartE2EDuration="3.956683584s" totalImagesPullingTime="2.339486852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:18:12.95523564 +0000 UTC m=+491.561083744" watchObservedRunningTime="2026-07-30 15:18:12.956683584 +0000 UTC m=+491.562531686"
Jul 30 15:18:19.958051 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:19.958003    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:19.958600 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:19.958074    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:19.981751 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:19.981720    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:20.004458 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:20.004405    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tg4dn"
Jul 30 15:18:24.858081 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.858045    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"]
Jul 30 15:18:24.862628 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.862607    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:24.865363 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.865331    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vzl9h\""
Jul 30 15:18:24.870087 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.870061    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"]
Jul 30 15:18:24.919045 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.918998    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:24.919256 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.919059    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:24.919256 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:24.919090    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mzlz7\" (UniqueName: \"kubernetes.io/projected/c0056682-cdfa-4b0e-9176-9eded49cd7fb-kube-api-access-mzlz7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.020197 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.020157    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.020197 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.020208    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.020528 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.020232    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mzlz7\" (UniqueName: \"kubernetes.io/projected/c0056682-cdfa-4b0e-9176-9eded49cd7fb-kube-api-access-mzlz7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.020653 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.020630    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.020715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.020668    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.029674 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.029644    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mzlz7\" (UniqueName: \"kubernetes.io/projected/c0056682-cdfa-4b0e-9176-9eded49cd7fb-kube-api-access-mzlz7\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.172990 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.172953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:25.317745 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.317715    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"]
Jul 30 15:18:25.319924 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:25.319895    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0056682_cdfa_4b0e_9176_9eded49cd7fb.slice/crio-af31f4b347c90c3cef2c7e27a7d1099c796163ade9c1954426357b5860e8e756 WatchSource:0}: Error finding container af31f4b347c90c3cef2c7e27a7d1099c796163ade9c1954426357b5860e8e756: Status 404 returned error can't find the container with id af31f4b347c90c3cef2c7e27a7d1099c796163ade9c1954426357b5860e8e756
Jul 30 15:18:25.455628 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.455589    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"]
Jul 30 15:18:25.459625 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.459604    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.467076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.467042    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"]
Jul 30 15:18:25.523035 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.522989    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.523247 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.523102    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gqkk\" (UniqueName: \"kubernetes.io/projected/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-kube-api-access-2gqkk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.523247 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.523172    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.623627 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.623584    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.623852 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.623675    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gqkk\" (UniqueName: \"kubernetes.io/projected/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-kube-api-access-2gqkk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.623852 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.623699    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.624069 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.624045    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.624141 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.624057    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.632697 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.632667    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gqkk\" (UniqueName: \"kubernetes.io/projected/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-kube-api-access-2gqkk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.788841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.788742    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:25.929309 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:25.929281    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"]
Jul 30 15:18:25.931238 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:25.931208    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ffdf75d_36a5_42a8_8c57_add5f6af1bbf.slice/crio-91b272ceb2c5f449b32fce2accf6bae0dcb4c362a59d79d2d50ea0db643b6d1f WatchSource:0}: Error finding container 91b272ceb2c5f449b32fce2accf6bae0dcb4c362a59d79d2d50ea0db643b6d1f: Status 404 returned error can't find the container with id 91b272ceb2c5f449b32fce2accf6bae0dcb4c362a59d79d2d50ea0db643b6d1f
Jul 30 15:18:26.001499 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.001459    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl" event={"ID":"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf","Type":"ContainerStarted","Data":"42ea456218506a33c3de1f689c76e654e3cd21680758ff55be5655f26d68a371"}
Jul 30 15:18:26.001717 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.001530    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl" event={"ID":"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf","Type":"ContainerStarted","Data":"91b272ceb2c5f449b32fce2accf6bae0dcb4c362a59d79d2d50ea0db643b6d1f"}
Jul 30 15:18:26.003036 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.002995    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerID="7d79e2aec737077b9888997608e08a76362ea8665db3edeb9fdbaba7af82befa" exitCode=0
Jul 30 15:18:26.003175 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.003038    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42" event={"ID":"c0056682-cdfa-4b0e-9176-9eded49cd7fb","Type":"ContainerDied","Data":"7d79e2aec737077b9888997608e08a76362ea8665db3edeb9fdbaba7af82befa"}
Jul 30 15:18:26.003175 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.003087    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42" event={"ID":"c0056682-cdfa-4b0e-9176-9eded49cd7fb","Type":"ContainerStarted","Data":"af31f4b347c90c3cef2c7e27a7d1099c796163ade9c1954426357b5860e8e756"}
Jul 30 15:18:26.058838 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.058806    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"]
Jul 30 15:18:26.062247 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.062228    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.071454 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.071385    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"]
Jul 30 15:18:26.126927 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.126889    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7psm6\" (UniqueName: \"kubernetes.io/projected/85344533-eb46-4cdf-ad8f-fab1b580e759-kube-api-access-7psm6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.127092 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.126937    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.127092 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.127000    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.227880 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.227831    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7psm6\" (UniqueName: \"kubernetes.io/projected/85344533-eb46-4cdf-ad8f-fab1b580e759-kube-api-access-7psm6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.227880 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.227883    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.228159 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.227922    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.228290 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.228271    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.228336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.228303    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.236814 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.236789    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7psm6\" (UniqueName: \"kubernetes.io/projected/85344533-eb46-4cdf-ad8f-fab1b580e759-kube-api-access-7psm6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.420661 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.420620    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:26.463925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.463891    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"]
Jul 30 15:18:26.467698 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.467680    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.480512 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.480320    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"]
Jul 30 15:18:26.530812 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.530619    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.530812 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.530683    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.530812 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.530719    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t88df\" (UniqueName: \"kubernetes.io/projected/f2a8e55e-fd19-42ab-a418-42199c2b75a0-kube-api-access-t88df\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.566023 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.565994    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"]
Jul 30 15:18:26.568092 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:26.568059    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85344533_eb46_4cdf_ad8f_fab1b580e759.slice/crio-1771d279e47ca0dda3da5876407d084af2ea7e934d7e7058d7db365ffde01f1a WatchSource:0}: Error finding container 1771d279e47ca0dda3da5876407d084af2ea7e934d7e7058d7db365ffde01f1a: Status 404 returned error can't find the container with id 1771d279e47ca0dda3da5876407d084af2ea7e934d7e7058d7db365ffde01f1a
Jul 30 15:18:26.631578 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.631543    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.631736 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.631601    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.631736 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.631642    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t88df\" (UniqueName: \"kubernetes.io/projected/f2a8e55e-fd19-42ab-a418-42199c2b75a0-kube-api-access-t88df\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.632093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.632067    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.632195 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.632136    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.641757 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.641729    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t88df\" (UniqueName: \"kubernetes.io/projected/f2a8e55e-fd19-42ab-a418-42199c2b75a0-kube-api-access-t88df\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.784948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.784909    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:26.930673 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:26.930643    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"]
Jul 30 15:18:26.944433 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:26.944394    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a8e55e_fd19_42ab_a418_42199c2b75a0.slice/crio-5e1f126caabcda7640b1bb4024cbe42b23d6e917cc3d41118c70e2a3ecded6b0 WatchSource:0}: Error finding container 5e1f126caabcda7640b1bb4024cbe42b23d6e917cc3d41118c70e2a3ecded6b0: Status 404 returned error can't find the container with id 5e1f126caabcda7640b1bb4024cbe42b23d6e917cc3d41118c70e2a3ecded6b0
Jul 30 15:18:27.009610 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.009565    2553 generic.go:356] "Generic (PLEG): container finished" podID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerID="b13219408e1e3f3d5c92c8dfec277b6069894504332a6b9ddb6c0a2c03c79379" exitCode=0
Jul 30 15:18:27.009795 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.009620    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q" event={"ID":"85344533-eb46-4cdf-ad8f-fab1b580e759","Type":"ContainerDied","Data":"b13219408e1e3f3d5c92c8dfec277b6069894504332a6b9ddb6c0a2c03c79379"}
Jul 30 15:18:27.009795 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.009675    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q" event={"ID":"85344533-eb46-4cdf-ad8f-fab1b580e759","Type":"ContainerStarted","Data":"1771d279e47ca0dda3da5876407d084af2ea7e934d7e7058d7db365ffde01f1a"}
Jul 30 15:18:27.011650 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.011617    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj" event={"ID":"f2a8e55e-fd19-42ab-a418-42199c2b75a0","Type":"ContainerStarted","Data":"bbb875a68094e772c835dce1d92b690e3bf37cc6699ab65dd682b04f5eb26138"}
Jul 30 15:18:27.011792 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.011674    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj" event={"ID":"f2a8e55e-fd19-42ab-a418-42199c2b75a0","Type":"ContainerStarted","Data":"5e1f126caabcda7640b1bb4024cbe42b23d6e917cc3d41118c70e2a3ecded6b0"}
Jul 30 15:18:27.013434 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.013395    2553 generic.go:356] "Generic (PLEG): container finished" podID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerID="42ea456218506a33c3de1f689c76e654e3cd21680758ff55be5655f26d68a371" exitCode=0
Jul 30 15:18:27.013536 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.013450    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl" event={"ID":"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf","Type":"ContainerDied","Data":"42ea456218506a33c3de1f689c76e654e3cd21680758ff55be5655f26d68a371"}
Jul 30 15:18:27.015522 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.015490    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerID="8233f40d5b265e368d4bb3166bb06a5e9a41a99aab1b28b2cadcebf260f6a878" exitCode=0
Jul 30 15:18:27.015626 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:27.015556    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42" event={"ID":"c0056682-cdfa-4b0e-9176-9eded49cd7fb","Type":"ContainerDied","Data":"8233f40d5b265e368d4bb3166bb06a5e9a41a99aab1b28b2cadcebf260f6a878"}
Jul 30 15:18:28.022373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:28.022330    2553 generic.go:356] "Generic (PLEG): container finished" podID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerID="bbb875a68094e772c835dce1d92b690e3bf37cc6699ab65dd682b04f5eb26138" exitCode=0
Jul 30 15:18:28.022818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:28.022459    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj" event={"ID":"f2a8e55e-fd19-42ab-a418-42199c2b75a0","Type":"ContainerDied","Data":"bbb875a68094e772c835dce1d92b690e3bf37cc6699ab65dd682b04f5eb26138"}
Jul 30 15:18:28.025048 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:28.025023    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerID="4a404f7530be05c566598c32f1f2f4280dab0cae3258372c028e8cc09e18f0c1" exitCode=0
Jul 30 15:18:28.025135 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:28.025078    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42" event={"ID":"c0056682-cdfa-4b0e-9176-9eded49cd7fb","Type":"ContainerDied","Data":"4a404f7530be05c566598c32f1f2f4280dab0cae3258372c028e8cc09e18f0c1"}
Jul 30 15:18:29.031903 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.031870    2553 generic.go:356] "Generic (PLEG): container finished" podID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerID="8e0fc816890b5f0b2952236d3e4930f2a5b6944c2138a51552d790a560dbc122" exitCode=0
Jul 30 15:18:29.032365 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.031910    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl" event={"ID":"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf","Type":"ContainerDied","Data":"8e0fc816890b5f0b2952236d3e4930f2a5b6944c2138a51552d790a560dbc122"}
Jul 30 15:18:29.040008 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.039973    2553 generic.go:356] "Generic (PLEG): container finished" podID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerID="70f7784c4bf89b93548bc3e2b43c7957c3f9f39cd51b38810d2efc965774cdea" exitCode=0
Jul 30 15:18:29.040236 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.040051    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj" event={"ID":"f2a8e55e-fd19-42ab-a418-42199c2b75a0","Type":"ContainerDied","Data":"70f7784c4bf89b93548bc3e2b43c7957c3f9f39cd51b38810d2efc965774cdea"}
Jul 30 15:18:29.307608 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.307577    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:29.353818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.353790    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-bundle\") pod \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") "
Jul 30 15:18:29.353934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.353873    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mzlz7\" (UniqueName: \"kubernetes.io/projected/c0056682-cdfa-4b0e-9176-9eded49cd7fb-kube-api-access-mzlz7\") pod \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") "
Jul 30 15:18:29.353934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.353910    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-util\") pod \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\" (UID: \"c0056682-cdfa-4b0e-9176-9eded49cd7fb\") "
Jul 30 15:18:29.354388 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.354349    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-bundle" (OuterVolumeSpecName: "bundle") pod "c0056682-cdfa-4b0e-9176-9eded49cd7fb" (UID: "c0056682-cdfa-4b0e-9176-9eded49cd7fb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:29.356267 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.356240    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0056682-cdfa-4b0e-9176-9eded49cd7fb-kube-api-access-mzlz7" (OuterVolumeSpecName: "kube-api-access-mzlz7") pod "c0056682-cdfa-4b0e-9176-9eded49cd7fb" (UID: "c0056682-cdfa-4b0e-9176-9eded49cd7fb"). InnerVolumeSpecName "kube-api-access-mzlz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:18:29.360495 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.360461    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-util" (OuterVolumeSpecName: "util") pod "c0056682-cdfa-4b0e-9176-9eded49cd7fb" (UID: "c0056682-cdfa-4b0e-9176-9eded49cd7fb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:29.454733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.454634    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mzlz7\" (UniqueName: \"kubernetes.io/projected/c0056682-cdfa-4b0e-9176-9eded49cd7fb-kube-api-access-mzlz7\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:29.454733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.454667    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:29.454733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:29.454676    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0056682-cdfa-4b0e-9176-9eded49cd7fb-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:30.046733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.046696    2553 generic.go:356] "Generic (PLEG): container finished" podID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerID="0ba4dffe231dbc9bd4735ac59908c4cac0c01ca3512211ebf825d656e26cfe59" exitCode=0
Jul 30 15:18:30.047253 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.046779    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q" event={"ID":"85344533-eb46-4cdf-ad8f-fab1b580e759","Type":"ContainerDied","Data":"0ba4dffe231dbc9bd4735ac59908c4cac0c01ca3512211ebf825d656e26cfe59"}
Jul 30 15:18:30.049230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.049204    2553 generic.go:356] "Generic (PLEG): container finished" podID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerID="3e6c8808f907bdfc9c617f81623b84c9f77f449eb51ac51a2768bd22786220a3" exitCode=0
Jul 30 15:18:30.049344 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.049321    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj" event={"ID":"f2a8e55e-fd19-42ab-a418-42199c2b75a0","Type":"ContainerDied","Data":"3e6c8808f907bdfc9c617f81623b84c9f77f449eb51ac51a2768bd22786220a3"}
Jul 30 15:18:30.051540 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.051517    2553 generic.go:356] "Generic (PLEG): container finished" podID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerID="3cb224ecc996d90d38203270e64c0d1f1d155af8265b3d37ed5649a0ada03164" exitCode=0
Jul 30 15:18:30.051829 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.051589    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl" event={"ID":"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf","Type":"ContainerDied","Data":"3cb224ecc996d90d38203270e64c0d1f1d155af8265b3d37ed5649a0ada03164"}
Jul 30 15:18:30.053536 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.053509    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42" event={"ID":"c0056682-cdfa-4b0e-9176-9eded49cd7fb","Type":"ContainerDied","Data":"af31f4b347c90c3cef2c7e27a7d1099c796163ade9c1954426357b5860e8e756"}
Jul 30 15:18:30.053632 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.053547    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42"
Jul 30 15:18:30.053680 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:30.053553    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="af31f4b347c90c3cef2c7e27a7d1099c796163ade9c1954426357b5860e8e756"
Jul 30 15:18:31.061884 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.061843    2553 generic.go:356] "Generic (PLEG): container finished" podID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerID="2a7ea6f9e966c2184aec2021e7276376765318f8a89b880b81c5f88fcb4bf9de" exitCode=0
Jul 30 15:18:31.062387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.061925    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q" event={"ID":"85344533-eb46-4cdf-ad8f-fab1b580e759","Type":"ContainerDied","Data":"2a7ea6f9e966c2184aec2021e7276376765318f8a89b880b81c5f88fcb4bf9de"}
Jul 30 15:18:31.222102 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.222076    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:31.224824 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.224803    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:31.269899 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.269860    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-bundle\") pod \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") "
Jul 30 15:18:31.270091 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.269921    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gqkk\" (UniqueName: \"kubernetes.io/projected/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-kube-api-access-2gqkk\") pod \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") "
Jul 30 15:18:31.270091 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.269989    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-util\") pod \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\" (UID: \"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf\") "
Jul 30 15:18:31.270209 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.270085    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t88df\" (UniqueName: \"kubernetes.io/projected/f2a8e55e-fd19-42ab-a418-42199c2b75a0-kube-api-access-t88df\") pod \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") "
Jul 30 15:18:31.270209 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.270137    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-bundle\") pod \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") "
Jul 30 15:18:31.270209 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.270177    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-util\") pod \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\" (UID: \"f2a8e55e-fd19-42ab-a418-42199c2b75a0\") "
Jul 30 15:18:31.270631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.270605    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-bundle" (OuterVolumeSpecName: "bundle") pod "7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" (UID: "7ffdf75d-36a5-42a8-8c57-add5f6af1bbf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:31.270917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.270893    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-bundle" (OuterVolumeSpecName: "bundle") pod "f2a8e55e-fd19-42ab-a418-42199c2b75a0" (UID: "f2a8e55e-fd19-42ab-a418-42199c2b75a0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:31.271182 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.271165    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:31.271237 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.271187    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:31.272822 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.272791    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2a8e55e-fd19-42ab-a418-42199c2b75a0-kube-api-access-t88df" (OuterVolumeSpecName: "kube-api-access-t88df") pod "f2a8e55e-fd19-42ab-a418-42199c2b75a0" (UID: "f2a8e55e-fd19-42ab-a418-42199c2b75a0"). InnerVolumeSpecName "kube-api-access-t88df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:18:31.272822 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.272803    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-kube-api-access-2gqkk" (OuterVolumeSpecName: "kube-api-access-2gqkk") pod "7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" (UID: "7ffdf75d-36a5-42a8-8c57-add5f6af1bbf"). InnerVolumeSpecName "kube-api-access-2gqkk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:18:31.276166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.276128    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-util" (OuterVolumeSpecName: "util") pod "f2a8e55e-fd19-42ab-a418-42199c2b75a0" (UID: "f2a8e55e-fd19-42ab-a418-42199c2b75a0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:31.277973 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.277924    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-util" (OuterVolumeSpecName: "util") pod "7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" (UID: "7ffdf75d-36a5-42a8-8c57-add5f6af1bbf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:31.371729 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.371636    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:31.371729 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.371668    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t88df\" (UniqueName: \"kubernetes.io/projected/f2a8e55e-fd19-42ab-a418-42199c2b75a0-kube-api-access-t88df\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:31.371729 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.371678    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f2a8e55e-fd19-42ab-a418-42199c2b75a0-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:31.371729 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:31.371687    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gqkk\" (UniqueName: \"kubernetes.io/projected/7ffdf75d-36a5-42a8-8c57-add5f6af1bbf-kube-api-access-2gqkk\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:32.068653 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.068606    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj" event={"ID":"f2a8e55e-fd19-42ab-a418-42199c2b75a0","Type":"ContainerDied","Data":"5e1f126caabcda7640b1bb4024cbe42b23d6e917cc3d41118c70e2a3ecded6b0"}
Jul 30 15:18:32.069110 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.068673    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5e1f126caabcda7640b1bb4024cbe42b23d6e917cc3d41118c70e2a3ecded6b0"
Jul 30 15:18:32.069110 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.068630    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj"
Jul 30 15:18:32.070864 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.070803    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl" event={"ID":"7ffdf75d-36a5-42a8-8c57-add5f6af1bbf","Type":"ContainerDied","Data":"91b272ceb2c5f449b32fce2accf6bae0dcb4c362a59d79d2d50ea0db643b6d1f"}
Jul 30 15:18:32.070864 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.070862    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="91b272ceb2c5f449b32fce2accf6bae0dcb4c362a59d79d2d50ea0db643b6d1f"
Jul 30 15:18:32.071098 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.071068    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl"
Jul 30 15:18:32.200450 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.200369    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:32.280234 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.280194    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-bundle\") pod \"85344533-eb46-4cdf-ad8f-fab1b580e759\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") "
Jul 30 15:18:32.280234 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.280239    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-util\") pod \"85344533-eb46-4cdf-ad8f-fab1b580e759\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") "
Jul 30 15:18:32.280517 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.280305    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7psm6\" (UniqueName: \"kubernetes.io/projected/85344533-eb46-4cdf-ad8f-fab1b580e759-kube-api-access-7psm6\") pod \"85344533-eb46-4cdf-ad8f-fab1b580e759\" (UID: \"85344533-eb46-4cdf-ad8f-fab1b580e759\") "
Jul 30 15:18:32.280732 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.280707    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-bundle" (OuterVolumeSpecName: "bundle") pod "85344533-eb46-4cdf-ad8f-fab1b580e759" (UID: "85344533-eb46-4cdf-ad8f-fab1b580e759"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:32.282497 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.282472    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85344533-eb46-4cdf-ad8f-fab1b580e759-kube-api-access-7psm6" (OuterVolumeSpecName: "kube-api-access-7psm6") pod "85344533-eb46-4cdf-ad8f-fab1b580e759" (UID: "85344533-eb46-4cdf-ad8f-fab1b580e759"). InnerVolumeSpecName "kube-api-access-7psm6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:18:32.284851 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.284826    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-util" (OuterVolumeSpecName: "util") pod "85344533-eb46-4cdf-ad8f-fab1b580e759" (UID: "85344533-eb46-4cdf-ad8f-fab1b580e759"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:18:32.381694 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.381651    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7psm6\" (UniqueName: \"kubernetes.io/projected/85344533-eb46-4cdf-ad8f-fab1b580e759-kube-api-access-7psm6\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:32.381694 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.381688    2553 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-bundle\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:32.381694 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:32.381697    2553 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/85344533-eb46-4cdf-ad8f-fab1b580e759-util\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:18:33.078455 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.078404    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q" event={"ID":"85344533-eb46-4cdf-ad8f-fab1b580e759","Type":"ContainerDied","Data":"1771d279e47ca0dda3da5876407d084af2ea7e934d7e7058d7db365ffde01f1a"}
Jul 30 15:18:33.078960 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.078483    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1771d279e47ca0dda3da5876407d084af2ea7e934d7e7058d7db365ffde01f1a"
Jul 30 15:18:33.078960 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.078412    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q"
Jul 30 15:18:33.111142 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:18:33.111092    2553 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85344533_eb46_4cdf_ad8f_fab1b580e759.slice\": RecentStats: unable to find data in memory cache]"
Jul 30 15:18:33.124869 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.124833    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-648c8ccbc8-j2nd8"]
Jul 30 15:18:33.125182 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125168    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="extract"
Jul 30 15:18:33.125230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125186    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="extract"
Jul 30 15:18:33.125230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125200    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="util"
Jul 30 15:18:33.125230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125206    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="util"
Jul 30 15:18:33.125230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125213    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="extract"
Jul 30 15:18:33.125230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125219    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="extract"
Jul 30 15:18:33.125230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125231    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="util"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125237    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="util"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125245    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="util"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125250    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="util"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125256    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="util"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125261    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="util"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125273    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125280    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125287    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125292    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125297    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125302    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125308    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125312    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125318    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125323    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125328    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125333    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="pull"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125393    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="85344533-eb46-4cdf-ad8f-fab1b580e759" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125402    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ffdf75d-36a5-42a8-8c57-add5f6af1bbf" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125409    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2a8e55e-fd19-42ab-a418-42199c2b75a0" containerName="extract"
Jul 30 15:18:33.125500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.125434    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0056682-cdfa-4b0e-9176-9eded49cd7fb" containerName="extract"
Jul 30 15:18:33.129577 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.129547    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.133689 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.133664    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 30 15:18:33.133956 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.133939    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 30 15:18:33.134185 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.134163    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 30 15:18:33.134276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.134197    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 30 15:18:33.134276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.134223    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 30 15:18:33.134576 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.134558    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 30 15:18:33.134671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.134559    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 30 15:18:33.138950 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.138919    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-zcgz2\""
Jul 30 15:18:33.140897 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.140879    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 30 15:18:33.144324 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.144302    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648c8ccbc8-j2nd8"]
Jul 30 15:18:33.187519 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187469    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-oauth-serving-cert\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.187519 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187525    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-console-config\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.187728 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187594    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84085413-9518-4297-a8dd-4744911c15c9-console-oauth-config\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.187728 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187610    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-service-ca\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.187728 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187629    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59992\" (UniqueName: \"kubernetes.io/projected/84085413-9518-4297-a8dd-4744911c15c9-kube-api-access-59992\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.187888 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187727    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-trusted-ca-bundle\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.187888 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.187774    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84085413-9518-4297-a8dd-4744911c15c9-console-serving-cert\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.288683 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288640    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-trusted-ca-bundle\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.288683 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288692    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84085413-9518-4297-a8dd-4744911c15c9-console-serving-cert\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.288911 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288811    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-oauth-serving-cert\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.288911 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288853    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-console-config\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.288911 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288908    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84085413-9518-4297-a8dd-4744911c15c9-console-oauth-config\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.289052 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288931    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-service-ca\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.289052 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.288964    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59992\" (UniqueName: \"kubernetes.io/projected/84085413-9518-4297-a8dd-4744911c15c9-kube-api-access-59992\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.289644 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.289615    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-oauth-serving-cert\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.289756 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.289659    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-trusted-ca-bundle\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.289756 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.289688    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-service-ca\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.289756 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.289706    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/84085413-9518-4297-a8dd-4744911c15c9-console-config\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.291398 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.291373    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/84085413-9518-4297-a8dd-4744911c15c9-console-serving-cert\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.291535 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.291440    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/84085413-9518-4297-a8dd-4744911c15c9-console-oauth-config\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.298532 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.298496    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-59992\" (UniqueName: \"kubernetes.io/projected/84085413-9518-4297-a8dd-4744911c15c9-kube-api-access-59992\") pod \"console-648c8ccbc8-j2nd8\" (UID: \"84085413-9518-4297-a8dd-4744911c15c9\") " pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.441413 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.441377    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:33.585726 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:33.585696    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-648c8ccbc8-j2nd8"]
Jul 30 15:18:33.587494 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:33.587457    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84085413_9518_4297_a8dd_4744911c15c9.slice/crio-35915a9aa2fbfcd41f2fc0f6778963187eebb09e8f1106eda75a655e1d4bc4dd WatchSource:0}: Error finding container 35915a9aa2fbfcd41f2fc0f6778963187eebb09e8f1106eda75a655e1d4bc4dd: Status 404 returned error can't find the container with id 35915a9aa2fbfcd41f2fc0f6778963187eebb09e8f1106eda75a655e1d4bc4dd
Jul 30 15:18:34.084545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:34.084507    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648c8ccbc8-j2nd8" event={"ID":"84085413-9518-4297-a8dd-4744911c15c9","Type":"ContainerStarted","Data":"35915a9aa2fbfcd41f2fc0f6778963187eebb09e8f1106eda75a655e1d4bc4dd"}
Jul 30 15:18:38.109106 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:38.109004    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-648c8ccbc8-j2nd8" event={"ID":"84085413-9518-4297-a8dd-4744911c15c9","Type":"ContainerStarted","Data":"78f5e5fcf1d7558ca38b5773ba523a5bca5287906f4d3f2b74e28c86ff53d7d9"}
Jul 30 15:18:38.131520 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:38.131453    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-648c8ccbc8-j2nd8" podStartSLOduration=0.873699434 podStartE2EDuration="5.131409796s" totalImagesPullingTime="4.257710362s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:18:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:18:38.131206865 +0000 UTC m=+516.737054969" watchObservedRunningTime="2026-07-30 15:18:38.131409796 +0000 UTC m=+516.737257911"
Jul 30 15:18:41.261717 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.261682    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"]
Jul 30 15:18:41.265334 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.265312    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:41.270600 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.270576    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-5k5zk\""
Jul 30 15:18:41.279588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.279557    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"]
Jul 30 15:18:41.363789 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.363741    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l54s\" (UniqueName: \"kubernetes.io/projected/f15acef9-3a6c-4f74-a4e1-0f2139661ad7-kube-api-access-9l54s\") pod \"limitador-operator-controller-manager-859d7b78bd-758lv\" (UID: \"f15acef9-3a6c-4f74-a4e1-0f2139661ad7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:41.464489 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.464410    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l54s\" (UniqueName: \"kubernetes.io/projected/f15acef9-3a6c-4f74-a4e1-0f2139661ad7-kube-api-access-9l54s\") pod \"limitador-operator-controller-manager-859d7b78bd-758lv\" (UID: \"f15acef9-3a6c-4f74-a4e1-0f2139661ad7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:41.474369 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.474326    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l54s\" (UniqueName: \"kubernetes.io/projected/f15acef9-3a6c-4f74-a4e1-0f2139661ad7-kube-api-access-9l54s\") pod \"limitador-operator-controller-manager-859d7b78bd-758lv\" (UID: \"f15acef9-3a6c-4f74-a4e1-0f2139661ad7\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:41.575948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.575829    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:41.719212 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:41.719185    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"]
Jul 30 15:18:41.721119 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:41.721090    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf15acef9_3a6c_4f74_a4e1_0f2139661ad7.slice/crio-2617c470a71e8292419a97a4da0d17f7528e30346d73526740e6d568e3be6a34 WatchSource:0}: Error finding container 2617c470a71e8292419a97a4da0d17f7528e30346d73526740e6d568e3be6a34: Status 404 returned error can't find the container with id 2617c470a71e8292419a97a4da0d17f7528e30346d73526740e6d568e3be6a34
Jul 30 15:18:42.130009 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:42.129967    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv" event={"ID":"f15acef9-3a6c-4f74-a4e1-0f2139661ad7","Type":"ContainerStarted","Data":"2617c470a71e8292419a97a4da0d17f7528e30346d73526740e6d568e3be6a34"}
Jul 30 15:18:43.441640 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:43.441594    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:43.442046 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:43.441678    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:43.447061 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:43.447031    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:44.145533 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:44.145339    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv" event={"ID":"f15acef9-3a6c-4f74-a4e1-0f2139661ad7","Type":"ContainerStarted","Data":"a3929b70c7421dd5bb27683a0fd31d7db4ed8b2ec3237a1800865ad90a4e3a73"}
Jul 30 15:18:44.145533 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:44.145472    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:44.151177 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:44.151144    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-648c8ccbc8-j2nd8"
Jul 30 15:18:44.165151 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:44.165090    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv" podStartSLOduration=1.429153792 podStartE2EDuration="3.165073113s" totalImagesPullingTime="1.735919321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:18:44.162599357 +0000 UTC m=+522.768447462" watchObservedRunningTime="2026-07-30 15:18:44.165073113 +0000 UTC m=+522.770921215"
Jul 30 15:18:45.310261 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.310219    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"]
Jul 30 15:18:45.313857 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.313839    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:45.317151 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.317122    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sv5q2\""
Jul 30 15:18:45.326438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.326394    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"]
Jul 30 15:18:45.401559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.401507    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptfcb\" (UniqueName: \"kubernetes.io/projected/6b650aa8-b6ec-41f0-add4-24fea93d01b6-kube-api-access-ptfcb\") pod \"authorino-operator-75cc8d5cb7-mmnhc\" (UID: \"6b650aa8-b6ec-41f0-add4-24fea93d01b6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:45.502742 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.502697    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptfcb\" (UniqueName: \"kubernetes.io/projected/6b650aa8-b6ec-41f0-add4-24fea93d01b6-kube-api-access-ptfcb\") pod \"authorino-operator-75cc8d5cb7-mmnhc\" (UID: \"6b650aa8-b6ec-41f0-add4-24fea93d01b6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:45.513438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.513390    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptfcb\" (UniqueName: \"kubernetes.io/projected/6b650aa8-b6ec-41f0-add4-24fea93d01b6-kube-api-access-ptfcb\") pod \"authorino-operator-75cc8d5cb7-mmnhc\" (UID: \"6b650aa8-b6ec-41f0-add4-24fea93d01b6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:45.624754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.624650    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:45.790574 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:45.790545    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"]
Jul 30 15:18:45.793265 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:45.793235    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b650aa8_b6ec_41f0_add4_24fea93d01b6.slice/crio-ca677c5982bda9b6aa8e54c29514aa14385c4d51e0ca84f8e20c8d7348ae4a41 WatchSource:0}: Error finding container ca677c5982bda9b6aa8e54c29514aa14385c4d51e0ca84f8e20c8d7348ae4a41: Status 404 returned error can't find the container with id ca677c5982bda9b6aa8e54c29514aa14385c4d51e0ca84f8e20c8d7348ae4a41
Jul 30 15:18:46.155872 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:46.155819    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc" event={"ID":"6b650aa8-b6ec-41f0-add4-24fea93d01b6","Type":"ContainerStarted","Data":"ca677c5982bda9b6aa8e54c29514aa14385c4d51e0ca84f8e20c8d7348ae4a41"}
Jul 30 15:18:48.168725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:48.168689    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc" event={"ID":"6b650aa8-b6ec-41f0-add4-24fea93d01b6","Type":"ContainerStarted","Data":"2a403d71672722468b64dae8b54bcfb6169acb728cc2c831c2eb5a37a792b07b"}
Jul 30 15:18:48.169166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:48.168859    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:48.193851 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:48.193796    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc" podStartSLOduration=0.917554589 podStartE2EDuration="3.193779852s" totalImagesPullingTime="2.276225263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:18:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:18:48.191522162 +0000 UTC m=+526.797370610" watchObservedRunningTime="2026-07-30 15:18:48.193779852 +0000 UTC m=+526.799627954"
Jul 30 15:18:50.359456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.357198    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"]
Jul 30 15:18:50.363173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.363139    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.366789 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.366764    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ctjh9\""
Jul 30 15:18:50.376904 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.376871    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"]
Jul 30 15:18:50.450371 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.450325    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.450624 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.450469    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99mcz\" (UniqueName: \"kubernetes.io/projected/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-kube-api-access-99mcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.551710 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.551660    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.551937 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.551768    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99mcz\" (UniqueName: \"kubernetes.io/projected/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-kube-api-access-99mcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.552094 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.552070    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.573302 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.573273    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99mcz\" (UniqueName: \"kubernetes.io/projected/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-kube-api-access-99mcz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.673621 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.673583    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:50.824409 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:50.824381    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"]
Jul 30 15:18:50.825561 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:50.825537    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27425ec5_e20f_4e7c_8ba7_0cb4a20b1fc3.slice/crio-8b6f2088df93afc3d01857a8d5266dbb9eef89eb2b16cad61dfe4280b295b69f WatchSource:0}: Error finding container 8b6f2088df93afc3d01857a8d5266dbb9eef89eb2b16cad61dfe4280b295b69f: Status 404 returned error can't find the container with id 8b6f2088df93afc3d01857a8d5266dbb9eef89eb2b16cad61dfe4280b295b69f
Jul 30 15:18:51.187323 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:51.187285    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw" event={"ID":"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3","Type":"ContainerStarted","Data":"8b6f2088df93afc3d01857a8d5266dbb9eef89eb2b16cad61dfe4280b295b69f"}
Jul 30 15:18:55.152076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:55.151980    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:18:56.220328 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:56.220277    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw" event={"ID":"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3","Type":"ContainerStarted","Data":"ede1e0cfaf98131dc7746e3fe16a3e9bd1b8003af45278e8aa57fc32557a3594"}
Jul 30 15:18:56.220766 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:56.220444    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:18:56.277639 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:56.277577    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw" podStartSLOduration=0.973507256 podStartE2EDuration="6.277558548s" totalImagesPullingTime="5.304051292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:18:56.271822118 +0000 UTC m=+534.877670222" watchObservedRunningTime="2026-07-30 15:18:56.277558548 +0000 UTC m=+534.883406650"
Jul 30 15:18:59.035562 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.035520    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"]
Jul 30 15:18:59.040647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.040616    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.044301 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.044275    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 30 15:18:59.044301 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.044291    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 30 15:18:59.044576 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.044563    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vzl9h\""
Jul 30 15:18:59.069040 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.069001    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"]
Jul 30 15:18:59.131799 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.131757    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.132004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.131867    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhx8j\" (UniqueName: \"kubernetes.io/projected/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-kube-api-access-jhx8j\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.132004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.131886    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.178168 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.178133    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mmnhc"
Jul 30 15:18:59.232452 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.232389    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.232661 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.232518    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhx8j\" (UniqueName: \"kubernetes.io/projected/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-kube-api-access-jhx8j\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.232661 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.232542    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.233322 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.233281    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.235130 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.235099    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.242165 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.242134    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhx8j\" (UniqueName: \"kubernetes.io/projected/1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214-kube-api-access-jhx8j\") pod \"kuadrant-console-plugin-66b5774985-fp9mk\" (UID: \"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.349940 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.349847    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"
Jul 30 15:18:59.495994 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:18:59.495967    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk"]
Jul 30 15:18:59.498532 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:18:59.498492    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1a09e2c2_bd1e_416a_b7f9_eb2eb8c28214.slice/crio-5c30b78f25b3f214bb3b47a4864de0f11e05aeb477eb8b32f72108fe9f98933d WatchSource:0}: Error finding container 5c30b78f25b3f214bb3b47a4864de0f11e05aeb477eb8b32f72108fe9f98933d: Status 404 returned error can't find the container with id 5c30b78f25b3f214bb3b47a4864de0f11e05aeb477eb8b32f72108fe9f98933d
Jul 30 15:19:00.245653 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:00.245605    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk" event={"ID":"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214","Type":"ContainerStarted","Data":"5c30b78f25b3f214bb3b47a4864de0f11e05aeb477eb8b32f72108fe9f98933d"}
Jul 30 15:19:07.228273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:07.228232    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:08.515808 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.515766    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"]
Jul 30 15:19:08.536813 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.536778    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.541389 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.538570    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"]
Jul 30 15:19:08.632410 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.632351    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"]
Jul 30 15:19:08.632845 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:08.632800    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-zcpjc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2" podUID="6de0db2c-6594-4ff1-b939-260f73e52656"
Jul 30 15:19:08.685321 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.685276    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"]
Jul 30 15:19:08.689477 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.689446    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:08.701151 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.701114    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"]
Jul 30 15:19:08.726483 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.726438    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de0db2c-6594-4ff1-b939-260f73e52656-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.726699 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.726594    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcpjc\" (UniqueName: \"kubernetes.io/projected/6de0db2c-6594-4ff1-b939-260f73e52656-kube-api-access-zcpjc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.827175 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.827083    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcpjc\" (UniqueName: \"kubernetes.io/projected/6de0db2c-6594-4ff1-b939-260f73e52656-kube-api-access-zcpjc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.827175 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.827141    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98818bdc-801d-400e-a833-3e6970eb1cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:08.827465 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.827219    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tvqf\" (UniqueName: \"kubernetes.io/projected/98818bdc-801d-400e-a833-3e6970eb1cbc-kube-api-access-4tvqf\") pod \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:08.827465 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.827318    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de0db2c-6594-4ff1-b939-260f73e52656-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.827722 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.827698    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de0db2c-6594-4ff1-b939-260f73e52656-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.838045 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.837972    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcpjc\" (UniqueName: \"kubernetes.io/projected/6de0db2c-6594-4ff1-b939-260f73e52656-kube-api-access-zcpjc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:08.927912 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.927869    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98818bdc-801d-400e-a833-3e6970eb1cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:08.928128 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.927976    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tvqf\" (UniqueName: \"kubernetes.io/projected/98818bdc-801d-400e-a833-3e6970eb1cbc-kube-api-access-4tvqf\") pod \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:08.928375 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.928356    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98818bdc-801d-400e-a833-3e6970eb1cbc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:08.937902 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:08.937847    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tvqf\" (UniqueName: \"kubernetes.io/projected/98818bdc-801d-400e-a833-3e6970eb1cbc-kube-api-access-4tvqf\") pod \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:09.003166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.003128    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:09.091977 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.091877    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"]
Jul 30 15:19:09.099103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.099069    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"]
Jul 30 15:19:09.115644 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.115601    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"]
Jul 30 15:19:09.121170 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.121134    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"]
Jul 30 15:19:09.125842 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.125807    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"]
Jul 30 15:19:09.131399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.131369    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.137223 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.137185    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"]
Jul 30 15:19:09.137493 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.137458    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" containerName="manager" containerID="cri-o://ede1e0cfaf98131dc7746e3fe16a3e9bd1b8003af45278e8aa57fc32557a3594" gracePeriod=2
Jul 30 15:19:09.149453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.149382    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"]
Jul 30 15:19:09.153111 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.153083    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"]
Jul 30 15:19:09.166057 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.166018    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"]
Jul 30 15:19:09.166366 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.166285    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" containerName="manager" containerID="cri-o://a3929b70c7421dd5bb27683a0fd31d7db4ed8b2ec3237a1800865ad90a4e3a73" gracePeriod=2
Jul 30 15:19:09.175598 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.175537    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:09.194410 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.194343    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"]
Jul 30 15:19:09.195271 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.194909    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" containerName="manager"
Jul 30 15:19:09.195271 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.194932    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" containerName="manager"
Jul 30 15:19:09.195271 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.195022    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" containerName="manager"
Jul 30 15:19:09.199388 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.199331    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"]
Jul 30 15:19:09.199567 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.199502    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.221356 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.221313    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"]
Jul 30 15:19:09.231700 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.231571    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgqwb\" (UniqueName: \"kubernetes.io/projected/dcff242a-1c64-4578-a304-2fe6523ac407-kube-api-access-xgqwb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsnfm\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.231700 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.231627    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcff242a-1c64-4578-a304-2fe6523ac407-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsnfm\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.231700 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.231676    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c6c2bfb-2b7a-49eb-8483-d381f6891145-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mtgx\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.232009 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.231724    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bv6k\" (UniqueName: \"kubernetes.io/projected/2c6c2bfb-2b7a-49eb-8483-d381f6891145-kube-api-access-4bv6k\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mtgx\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.248604 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.248468    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:09.251595 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.251485    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:09.304868 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.304831    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:09.307649 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.307600    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:09.309813 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.309765    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="6de0db2c-6594-4ff1-b939-260f73e52656" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:09.311947 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.311907    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:09.318309 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.318276    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:09.320889 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.320852    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="6de0db2c-6594-4ff1-b939-260f73e52656" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:09.323067 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.323031    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:09.325251 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:09.325215    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:09.332814 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.332761    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgqwb\" (UniqueName: \"kubernetes.io/projected/dcff242a-1c64-4578-a304-2fe6523ac407-kube-api-access-xgqwb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsnfm\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.333015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.332826    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcff242a-1c64-4578-a304-2fe6523ac407-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsnfm\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.333015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.332860    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c6c2bfb-2b7a-49eb-8483-d381f6891145-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mtgx\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.333015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.332903    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bv6k\" (UniqueName: \"kubernetes.io/projected/2c6c2bfb-2b7a-49eb-8483-d381f6891145-kube-api-access-4bv6k\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mtgx\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.333517 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.333470    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcff242a-1c64-4578-a304-2fe6523ac407-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsnfm\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.334087 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.333622    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c6c2bfb-2b7a-49eb-8483-d381f6891145-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mtgx\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.344970 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.344883    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bv6k\" (UniqueName: \"kubernetes.io/projected/2c6c2bfb-2b7a-49eb-8483-d381f6891145-kube-api-access-4bv6k\") pod \"kuadrant-operator-controller-manager-55467d9f7-8mtgx\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.344970 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.344883    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgqwb\" (UniqueName: \"kubernetes.io/projected/dcff242a-1c64-4578-a304-2fe6523ac407-kube-api-access-xgqwb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bsnfm\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.434073 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.434039    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zcpjc\" (UniqueName: \"kubernetes.io/projected/6de0db2c-6594-4ff1-b939-260f73e52656-kube-api-access-zcpjc\") pod \"6de0db2c-6594-4ff1-b939-260f73e52656\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") "
Jul 30 15:19:09.434250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.434104    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de0db2c-6594-4ff1-b939-260f73e52656-extensions-socket-volume\") pod \"6de0db2c-6594-4ff1-b939-260f73e52656\" (UID: \"6de0db2c-6594-4ff1-b939-260f73e52656\") "
Jul 30 15:19:09.434399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.434368    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6de0db2c-6594-4ff1-b939-260f73e52656-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6de0db2c-6594-4ff1-b939-260f73e52656" (UID: "6de0db2c-6594-4ff1-b939-260f73e52656"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:19:09.436609 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.436558    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6de0db2c-6594-4ff1-b939-260f73e52656-kube-api-access-zcpjc" (OuterVolumeSpecName: "kube-api-access-zcpjc") pod "6de0db2c-6594-4ff1-b939-260f73e52656" (UID: "6de0db2c-6594-4ff1-b939-260f73e52656"). InnerVolumeSpecName "kube-api-access-zcpjc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:19:09.449777 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.449742    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:09.535358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.535313    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zcpjc\" (UniqueName: \"kubernetes.io/projected/6de0db2c-6594-4ff1-b939-260f73e52656-kube-api-access-zcpjc\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:09.535358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.535354    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6de0db2c-6594-4ff1-b939-260f73e52656-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:09.557141 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.557102    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:09.930966 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:09.930929    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6de0db2c-6594-4ff1-b939-260f73e52656" path="/var/lib/kubelet/pods/6de0db2c-6594-4ff1-b939-260f73e52656/volumes"
Jul 30 15:19:10.311127 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:10.311034    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:10.316655 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:10.316614    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="6de0db2c-6594-4ff1-b939-260f73e52656" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:11.923599 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:11.923547    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-n7gf2\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="6de0db2c-6594-4ff1-b939-260f73e52656" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-n7gf2"
Jul 30 15:19:21.382288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.381643    2553 generic.go:356] "Generic (PLEG): container finished" podID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" containerID="a3929b70c7421dd5bb27683a0fd31d7db4ed8b2ec3237a1800865ad90a4e3a73" exitCode=0
Jul 30 15:19:21.383958 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.383927    2553 generic.go:356] "Generic (PLEG): container finished" podID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" containerID="ede1e0cfaf98131dc7746e3fe16a3e9bd1b8003af45278e8aa57fc32557a3594" exitCode=0
Jul 30 15:19:21.458072 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.457986    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:21.460589 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:21.460550    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:21.466164 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.466140    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"]
Jul 30 15:19:21.468700 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:19:21.468658    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcff242a_1c64_4578_a304_2fe6523ac407.slice/crio-84fb8bcff66765b2a3bf369bcfa16b27560e3950632a81b965827ee002a7df68 WatchSource:0}: Error finding container 84fb8bcff66765b2a3bf369bcfa16b27560e3950632a81b965827ee002a7df68: Status 404 returned error can't find the container with id 84fb8bcff66765b2a3bf369bcfa16b27560e3950632a81b965827ee002a7df68
Jul 30 15:19:21.470377 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.470353    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:21.472690 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:21.472656    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:21.474788 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:21.474756    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:21.485201 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.485118    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"]
Jul 30 15:19:21.487338 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:19:21.487315    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c6c2bfb_2b7a_49eb_8483_d381f6891145.slice/crio-53a27b822f20d49e4644d073b71679c6fe4edb8f647041bc65c141d5bef8cd56 WatchSource:0}: Error finding container 53a27b822f20d49e4644d073b71679c6fe4edb8f647041bc65c141d5bef8cd56: Status 404 returned error can't find the container with id 53a27b822f20d49e4644d073b71679c6fe4edb8f647041bc65c141d5bef8cd56
Jul 30 15:19:21.525373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.525329    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-extensions-socket-volume\") pod \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") "
Jul 30 15:19:21.525550 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.525475    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l54s\" (UniqueName: \"kubernetes.io/projected/f15acef9-3a6c-4f74-a4e1-0f2139661ad7-kube-api-access-9l54s\") pod \"f15acef9-3a6c-4f74-a4e1-0f2139661ad7\" (UID: \"f15acef9-3a6c-4f74-a4e1-0f2139661ad7\") "
Jul 30 15:19:21.525550 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.525546    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99mcz\" (UniqueName: \"kubernetes.io/projected/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-kube-api-access-99mcz\") pod \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\" (UID: \"27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3\") "
Jul 30 15:19:21.526117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.526081    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" (UID: "27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:19:21.528144 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.528108    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f15acef9-3a6c-4f74-a4e1-0f2139661ad7-kube-api-access-9l54s" (OuterVolumeSpecName: "kube-api-access-9l54s") pod "f15acef9-3a6c-4f74-a4e1-0f2139661ad7" (UID: "f15acef9-3a6c-4f74-a4e1-0f2139661ad7"). InnerVolumeSpecName "kube-api-access-9l54s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:19:21.528356 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.528330    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-kube-api-access-99mcz" (OuterVolumeSpecName: "kube-api-access-99mcz") pod "27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" (UID: "27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3"). InnerVolumeSpecName "kube-api-access-99mcz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:19:21.626270 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.626230    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l54s\" (UniqueName: \"kubernetes.io/projected/f15acef9-3a6c-4f74-a4e1-0f2139661ad7-kube-api-access-9l54s\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:21.626270 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.626263    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99mcz\" (UniqueName: \"kubernetes.io/projected/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-kube-api-access-99mcz\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:21.626270 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.626275    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:21.924893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.924855    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" path="/var/lib/kubelet/pods/27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3/volumes"
Jul 30 15:19:21.925221 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:21.925191    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:21.925367 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:21.925350    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" path="/var/lib/kubelet/pods/f15acef9-3a6c-4f74-a4e1-0f2139661ad7/volumes"
Jul 30 15:19:21.929072 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:21.929042    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:22.397581 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.397550    2553 scope.go:117] "RemoveContainer" containerID="a3929b70c7421dd5bb27683a0fd31d7db4ed8b2ec3237a1800865ad90a4e3a73"
Jul 30 15:19:22.398052 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.397547    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:22.399366 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.399346    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:22.400297 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.400266    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:22.401462 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.401432    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk" event={"ID":"1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214","Type":"ContainerStarted","Data":"a4d66757f1ea559842ce2cdc6013535fa479031f48c115dfdbf6c15aed7e69b9"}
Jul 30 15:19:22.402673 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.402647    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:22.403502 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.403476    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm" event={"ID":"dcff242a-1c64-4578-a304-2fe6523ac407","Type":"ContainerStarted","Data":"7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a"}
Jul 30 15:19:22.403603 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.403567    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:22.403603 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.403595    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm" event={"ID":"dcff242a-1c64-4578-a304-2fe6523ac407","Type":"ContainerStarted","Data":"84fb8bcff66765b2a3bf369bcfa16b27560e3950632a81b965827ee002a7df68"}
Jul 30 15:19:22.404740 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.404715    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:22.405186 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.405164    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx" event={"ID":"2c6c2bfb-2b7a-49eb-8483-d381f6891145","Type":"ContainerStarted","Data":"ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611"}
Jul 30 15:19:22.405283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.405214    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx" event={"ID":"2c6c2bfb-2b7a-49eb-8483-d381f6891145","Type":"ContainerStarted","Data":"53a27b822f20d49e4644d073b71679c6fe4edb8f647041bc65c141d5bef8cd56"}
Jul 30 15:19:22.405283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.405244    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:22.408145 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.408128    2553 scope.go:117] "RemoveContainer" containerID="ede1e0cfaf98131dc7746e3fe16a3e9bd1b8003af45278e8aa57fc32557a3594"
Jul 30 15:19:22.434670 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.434608    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-fp9mk" podStartSLOduration=1.5473334140000001 podStartE2EDuration="23.434590927s" totalImagesPullingTime="21.887257513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:18:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:19:22.431762596 +0000 UTC m=+561.037610699" watchObservedRunningTime="2026-07-30 15:19:22.434590927 +0000 UTC m=+561.040439024"
Jul 30 15:19:22.463805 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.463749    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:22.464065 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.464026    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm" podStartSLOduration=13.464011108 podStartE2EDuration="13.464011108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:19:22.461221564 +0000 UTC m=+561.067069666" watchObservedRunningTime="2026-07-30 15:19:22.464011108 +0000 UTC m=+561.069859211"
Jul 30 15:19:22.465824 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.465790    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:22.488157 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:22.488103    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx" podStartSLOduration=13.488086533 podStartE2EDuration="13.488086533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:19:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:19:22.486180271 +0000 UTC m=+561.092028447" watchObservedRunningTime="2026-07-30 15:19:22.488086533 +0000 UTC m=+561.093934718"
Jul 30 15:19:22.488752 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.488715    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-k8pxw\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="27425ec5-e20f-4e7c-8ba7-0cb4a20b1fc3" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-k8pxw"
Jul 30 15:19:22.490907 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:22.490878    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-758lv\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-758lv"
Jul 30 15:19:23.823313 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:23.823269    2553 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-m7kq8_kuadrant-system_98818bdc-801d-400e-a833-3e6970eb1cbc_0(437a9b3655a9930ac5edffae5e53840df3c6b539e0ead97919bbbe1b560f4c8b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-m7kq8 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 30 15:19:23.823669 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:23.823358    2553 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-m7kq8_kuadrant-system_98818bdc-801d-400e-a833-3e6970eb1cbc_0(437a9b3655a9930ac5edffae5e53840df3c6b539e0ead97919bbbe1b560f4c8b): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-m7kq8 to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:24.419514 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.419473    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:24.422254 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:24.422221    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="98818bdc-801d-400e-a833-3e6970eb1cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:24.428686 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.428658    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:24.431576 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:24.431528    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="98818bdc-801d-400e-a833-3e6970eb1cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:24.452683 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.452648    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4tvqf\" (UniqueName: \"kubernetes.io/projected/98818bdc-801d-400e-a833-3e6970eb1cbc-kube-api-access-4tvqf\") pod \"98818bdc-801d-400e-a833-3e6970eb1cbc\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") "
Jul 30 15:19:24.452852 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.452742    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98818bdc-801d-400e-a833-3e6970eb1cbc-extensions-socket-volume\") pod \"98818bdc-801d-400e-a833-3e6970eb1cbc\" (UID: \"98818bdc-801d-400e-a833-3e6970eb1cbc\") "
Jul 30 15:19:24.453049 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.453024    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/98818bdc-801d-400e-a833-3e6970eb1cbc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "98818bdc-801d-400e-a833-3e6970eb1cbc" (UID: "98818bdc-801d-400e-a833-3e6970eb1cbc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:19:24.454864 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.454827    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/98818bdc-801d-400e-a833-3e6970eb1cbc-kube-api-access-4tvqf" (OuterVolumeSpecName: "kube-api-access-4tvqf") pod "98818bdc-801d-400e-a833-3e6970eb1cbc" (UID: "98818bdc-801d-400e-a833-3e6970eb1cbc"). InnerVolumeSpecName "kube-api-access-4tvqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:19:24.553725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.553684    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/98818bdc-801d-400e-a833-3e6970eb1cbc-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:24.553725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:24.553717    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4tvqf\" (UniqueName: \"kubernetes.io/projected/98818bdc-801d-400e-a833-3e6970eb1cbc-kube-api-access-4tvqf\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:25.424572 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:25.424527    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:25.427031 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:25.426995    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="98818bdc-801d-400e-a833-3e6970eb1cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:25.433126 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:25.433087    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-m7kq8\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="98818bdc-801d-400e-a833-3e6970eb1cbc" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-m7kq8"
Jul 30 15:19:25.924499 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:25.924464    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98818bdc-801d-400e-a833-3e6970eb1cbc" path="/var/lib/kubelet/pods/98818bdc-801d-400e-a833-3e6970eb1cbc/volumes"
Jul 30 15:19:33.416362 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.416325    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:33.416875 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.416403    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:33.500909 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.500871    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"]
Jul 30 15:19:33.501106 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.501083    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm" podUID="dcff242a-1c64-4578-a304-2fe6523ac407" containerName="manager" containerID="cri-o://7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a" gracePeriod=10
Jul 30 15:19:33.757614 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.757591    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:33.764011 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.763982    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"]
Jul 30 15:19:33.764321 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.764310    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" containerName="manager"
Jul 30 15:19:33.764361 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.764323    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" containerName="manager"
Jul 30 15:19:33.764361 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.764339    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcff242a-1c64-4578-a304-2fe6523ac407" containerName="manager"
Jul 30 15:19:33.764361 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.764345    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcff242a-1c64-4578-a304-2fe6523ac407" containerName="manager"
Jul 30 15:19:33.764471 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.764403    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f15acef9-3a6c-4f74-a4e1-0f2139661ad7" containerName="manager"
Jul 30 15:19:33.764471 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.764412    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcff242a-1c64-4578-a304-2fe6523ac407" containerName="manager"
Jul 30 15:19:33.768008 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.767989    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:33.786892 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.786856    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"]
Jul 30 15:19:33.837355 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.837324    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgqwb\" (UniqueName: \"kubernetes.io/projected/dcff242a-1c64-4578-a304-2fe6523ac407-kube-api-access-xgqwb\") pod \"dcff242a-1c64-4578-a304-2fe6523ac407\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") "
Jul 30 15:19:33.837542 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.837366    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcff242a-1c64-4578-a304-2fe6523ac407-extensions-socket-volume\") pod \"dcff242a-1c64-4578-a304-2fe6523ac407\" (UID: \"dcff242a-1c64-4578-a304-2fe6523ac407\") "
Jul 30 15:19:33.837607 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.837544    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5812725-edaf-4a44-9ae6-83ac784294bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vdcjn\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:33.837607 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.837574    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbcwq\" (UniqueName: \"kubernetes.io/projected/e5812725-edaf-4a44-9ae6-83ac784294bb-kube-api-access-zbcwq\") pod \"kuadrant-operator-controller-manager-86878c769f-vdcjn\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:33.837840 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.837808    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcff242a-1c64-4578-a304-2fe6523ac407-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "dcff242a-1c64-4578-a304-2fe6523ac407" (UID: "dcff242a-1c64-4578-a304-2fe6523ac407"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:19:33.839781 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.839754    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcff242a-1c64-4578-a304-2fe6523ac407-kube-api-access-xgqwb" (OuterVolumeSpecName: "kube-api-access-xgqwb") pod "dcff242a-1c64-4578-a304-2fe6523ac407" (UID: "dcff242a-1c64-4578-a304-2fe6523ac407"). InnerVolumeSpecName "kube-api-access-xgqwb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:19:33.938015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.937983    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5812725-edaf-4a44-9ae6-83ac784294bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vdcjn\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:33.938154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.938022    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbcwq\" (UniqueName: \"kubernetes.io/projected/e5812725-edaf-4a44-9ae6-83ac784294bb-kube-api-access-zbcwq\") pod \"kuadrant-operator-controller-manager-86878c769f-vdcjn\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:33.938154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.938057    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgqwb\" (UniqueName: \"kubernetes.io/projected/dcff242a-1c64-4578-a304-2fe6523ac407-kube-api-access-xgqwb\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:33.938154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.938073    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/dcff242a-1c64-4578-a304-2fe6523ac407-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:33.938392 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.938369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5812725-edaf-4a44-9ae6-83ac784294bb-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vdcjn\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:33.947901 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:33.947856    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbcwq\" (UniqueName: \"kubernetes.io/projected/e5812725-edaf-4a44-9ae6-83ac784294bb-kube-api-access-zbcwq\") pod \"kuadrant-operator-controller-manager-86878c769f-vdcjn\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:34.077989 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.077950    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:34.226679 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.226649    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"]
Jul 30 15:19:34.229192 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:19:34.229163    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5812725_edaf_4a44_9ae6_83ac784294bb.slice/crio-bea5d520bf5d7604ac16dce2b32ca4656f09d32562b29b14f8507f5dff6f0891 WatchSource:0}: Error finding container bea5d520bf5d7604ac16dce2b32ca4656f09d32562b29b14f8507f5dff6f0891: Status 404 returned error can't find the container with id bea5d520bf5d7604ac16dce2b32ca4656f09d32562b29b14f8507f5dff6f0891
Jul 30 15:19:34.473516 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.473476    2553 generic.go:356] "Generic (PLEG): container finished" podID="dcff242a-1c64-4578-a304-2fe6523ac407" containerID="7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a" exitCode=0
Jul 30 15:19:34.474025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.473533    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"
Jul 30 15:19:34.474025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.473552    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm" event={"ID":"dcff242a-1c64-4578-a304-2fe6523ac407","Type":"ContainerDied","Data":"7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a"}
Jul 30 15:19:34.474025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.473617    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm" event={"ID":"dcff242a-1c64-4578-a304-2fe6523ac407","Type":"ContainerDied","Data":"84fb8bcff66765b2a3bf369bcfa16b27560e3950632a81b965827ee002a7df68"}
Jul 30 15:19:34.474025 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.473652    2553 scope.go:117] "RemoveContainer" containerID="7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a"
Jul 30 15:19:34.475583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.475558    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn" event={"ID":"e5812725-edaf-4a44-9ae6-83ac784294bb","Type":"ContainerStarted","Data":"105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a"}
Jul 30 15:19:34.475706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.475608    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn" event={"ID":"e5812725-edaf-4a44-9ae6-83ac784294bb","Type":"ContainerStarted","Data":"bea5d520bf5d7604ac16dce2b32ca4656f09d32562b29b14f8507f5dff6f0891"}
Jul 30 15:19:34.475785 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.475727    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:34.483995 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.483970    2553 scope.go:117] "RemoveContainer" containerID="7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a"
Jul 30 15:19:34.484294 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:34.484272    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a\": container with ID starting with 7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a not found: ID does not exist" containerID="7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a"
Jul 30 15:19:34.484362 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.484305    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a"} err="failed to get container status \"7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a\": rpc error: code = NotFound desc = could not find container \"7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a\": container with ID starting with 7c6a7a5041d2f42920b7314f33eba4799014461f51eeeae235a168f90f8d143a not found: ID does not exist"
Jul 30 15:19:34.495835 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.495799    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"]
Jul 30 15:19:34.499539 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.499505    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bsnfm"]
Jul 30 15:19:34.516374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:34.516316    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn" podStartSLOduration=1.5162935389999999 podStartE2EDuration="1.516293539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:19:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:19:34.515969104 +0000 UTC m=+573.121817231" watchObservedRunningTime="2026-07-30 15:19:34.516293539 +0000 UTC m=+573.122141644"
Jul 30 15:19:35.924564 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:35.924532    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcff242a-1c64-4578-a304-2fe6523ac407" path="/var/lib/kubelet/pods/dcff242a-1c64-4578-a304-2fe6523ac407/volumes"
Jul 30 15:19:45.484704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:45.484667    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:19:45.540109 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:45.540067    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"]
Jul 30 15:19:45.540753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:45.540462    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx" podUID="2c6c2bfb-2b7a-49eb-8483-d381f6891145" containerName="manager" containerID="cri-o://ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611" gracePeriod=10
Jul 30 15:19:46.431145 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.431104    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:46.554236 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.554153    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bv6k\" (UniqueName: \"kubernetes.io/projected/2c6c2bfb-2b7a-49eb-8483-d381f6891145-kube-api-access-4bv6k\") pod \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") "
Jul 30 15:19:46.554236 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.554189    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c6c2bfb-2b7a-49eb-8483-d381f6891145-extensions-socket-volume\") pod \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\" (UID: \"2c6c2bfb-2b7a-49eb-8483-d381f6891145\") "
Jul 30 15:19:46.554774 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.554636    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c6c2bfb-2b7a-49eb-8483-d381f6891145-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2c6c2bfb-2b7a-49eb-8483-d381f6891145" (UID: "2c6c2bfb-2b7a-49eb-8483-d381f6891145"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:19:46.556193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.556162    2553 generic.go:356] "Generic (PLEG): container finished" podID="2c6c2bfb-2b7a-49eb-8483-d381f6891145" containerID="ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611" exitCode=0
Jul 30 15:19:46.556348 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.556263    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"
Jul 30 15:19:46.556348 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.556304    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx" event={"ID":"2c6c2bfb-2b7a-49eb-8483-d381f6891145","Type":"ContainerDied","Data":"ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611"}
Jul 30 15:19:46.556851 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.556371    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx" event={"ID":"2c6c2bfb-2b7a-49eb-8483-d381f6891145","Type":"ContainerDied","Data":"53a27b822f20d49e4644d073b71679c6fe4edb8f647041bc65c141d5bef8cd56"}
Jul 30 15:19:46.556851 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.556409    2553 scope.go:117] "RemoveContainer" containerID="ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611"
Jul 30 15:19:46.556981 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.556872    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c6c2bfb-2b7a-49eb-8483-d381f6891145-kube-api-access-4bv6k" (OuterVolumeSpecName: "kube-api-access-4bv6k") pod "2c6c2bfb-2b7a-49eb-8483-d381f6891145" (UID: "2c6c2bfb-2b7a-49eb-8483-d381f6891145"). InnerVolumeSpecName "kube-api-access-4bv6k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:19:46.568531 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.568503    2553 scope.go:117] "RemoveContainer" containerID="ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611"
Jul 30 15:19:46.568874 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:19:46.568849    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611\": container with ID starting with ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611 not found: ID does not exist" containerID="ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611"
Jul 30 15:19:46.568961 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.568884    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611"} err="failed to get container status \"ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611\": rpc error: code = NotFound desc = could not find container \"ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611\": container with ID starting with ce30873dcba3289a653bc9bc3c6b4099adf0cf3545d1fed7280c0201f1363611 not found: ID does not exist"
Jul 30 15:19:46.655470 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.655407    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bv6k\" (UniqueName: \"kubernetes.io/projected/2c6c2bfb-2b7a-49eb-8483-d381f6891145-kube-api-access-4bv6k\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:46.655470 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.655464    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2c6c2bfb-2b7a-49eb-8483-d381f6891145-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:19:46.887277 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.887240    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"]
Jul 30 15:19:46.892256 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:46.892223    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-8mtgx"]
Jul 30 15:19:47.924879 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:19:47.924845    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c6c2bfb-2b7a-49eb-8483-d381f6891145" path="/var/lib/kubelet/pods/2c6c2bfb-2b7a-49eb-8483-d381f6891145/volumes"
Jul 30 15:20:01.784519 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:01.784484    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:20:01.786802 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:01.786779    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:20:02.441672 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.441631    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:02.442028 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.442015    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c6c2bfb-2b7a-49eb-8483-d381f6891145" containerName="manager"
Jul 30 15:20:02.442028 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.442029    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c6c2bfb-2b7a-49eb-8483-d381f6891145" containerName="manager"
Jul 30 15:20:02.442105 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.442096    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c6c2bfb-2b7a-49eb-8483-d381f6891145" containerName="manager"
Jul 30 15:20:02.446701 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.446677    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.449278 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.449248    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 30 15:20:02.453510 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.453476    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:02.540798 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.540761    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:02.599809 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.599769    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l59z4\" (UniqueName: \"kubernetes.io/projected/0205328f-b548-4bab-a286-a8740f66669a-kube-api-access-l59z4\") pod \"limitador-limitador-64c94fd64f-hfgkn\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.600021 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.599850    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0205328f-b548-4bab-a286-a8740f66669a-config-file\") pod \"limitador-limitador-64c94fd64f-hfgkn\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.700878 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.700774    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0205328f-b548-4bab-a286-a8740f66669a-config-file\") pod \"limitador-limitador-64c94fd64f-hfgkn\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.700878 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.700874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l59z4\" (UniqueName: \"kubernetes.io/projected/0205328f-b548-4bab-a286-a8740f66669a-kube-api-access-l59z4\") pod \"limitador-limitador-64c94fd64f-hfgkn\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.701575 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.701553    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0205328f-b548-4bab-a286-a8740f66669a-config-file\") pod \"limitador-limitador-64c94fd64f-hfgkn\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.709055 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.709014    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l59z4\" (UniqueName: \"kubernetes.io/projected/0205328f-b548-4bab-a286-a8740f66669a-kube-api-access-l59z4\") pod \"limitador-limitador-64c94fd64f-hfgkn\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.759044 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.758998    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:02.912615 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:02.912573    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:02.914190 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:02.914160    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0205328f_b548_4bab_a286_a8740f66669a.slice/crio-64ad3ac1befa7dd7dad22f4b630ea665504dd43931ba42e1bfaf978e6efde99c WatchSource:0}: Error finding container 64ad3ac1befa7dd7dad22f4b630ea665504dd43931ba42e1bfaf978e6efde99c: Status 404 returned error can't find the container with id 64ad3ac1befa7dd7dad22f4b630ea665504dd43931ba42e1bfaf978e6efde99c
Jul 30 15:20:03.242500 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.242463    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-5kfpj"]
Jul 30 15:20:03.247046 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.247017    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:03.249707 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.249676    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-v8778\""
Jul 30 15:20:03.254807 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.254773    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5kfpj"]
Jul 30 15:20:03.406506 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.406470    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvwp6\" (UniqueName: \"kubernetes.io/projected/0c9991ff-b3c7-40ca-b318-cbbc8da5a586-kube-api-access-tvwp6\") pod \"authorino-58cd955675-5kfpj\" (UID: \"0c9991ff-b3c7-40ca-b318-cbbc8da5a586\") " pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:03.507878 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.507773    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tvwp6\" (UniqueName: \"kubernetes.io/projected/0c9991ff-b3c7-40ca-b318-cbbc8da5a586-kube-api-access-tvwp6\") pod \"authorino-58cd955675-5kfpj\" (UID: \"0c9991ff-b3c7-40ca-b318-cbbc8da5a586\") " pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:03.516840 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.516808    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvwp6\" (UniqueName: \"kubernetes.io/projected/0c9991ff-b3c7-40ca-b318-cbbc8da5a586-kube-api-access-tvwp6\") pod \"authorino-58cd955675-5kfpj\" (UID: \"0c9991ff-b3c7-40ca-b318-cbbc8da5a586\") " pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:03.558743 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.558702    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:03.584269 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.584227    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-rswb2"]
Jul 30 15:20:03.587894 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.587869    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:03.594646 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.594612    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rswb2"]
Jul 30 15:20:03.651052 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.651014    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn" event={"ID":"0205328f-b548-4bab-a286-a8740f66669a","Type":"ContainerStarted","Data":"64ad3ac1befa7dd7dad22f4b630ea665504dd43931ba42e1bfaf978e6efde99c"}
Jul 30 15:20:03.708984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.708948    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-5kfpj"]
Jul 30 15:20:03.709199 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.709174    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vshs\" (UniqueName: \"kubernetes.io/projected/94660841-d4b8-4860-86f7-ca51c0a8a6e4-kube-api-access-7vshs\") pod \"authorino-75d556bd77-rswb2\" (UID: \"94660841-d4b8-4860-86f7-ca51c0a8a6e4\") " pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:03.710415 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:03.710390    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0c9991ff_b3c7_40ca_b318_cbbc8da5a586.slice/crio-76b99f245e1164f219086c1a174174df3662eddea545f42ba15be56ab0fbcd5c WatchSource:0}: Error finding container 76b99f245e1164f219086c1a174174df3662eddea545f42ba15be56ab0fbcd5c: Status 404 returned error can't find the container with id 76b99f245e1164f219086c1a174174df3662eddea545f42ba15be56ab0fbcd5c
Jul 30 15:20:03.810210 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.810113    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vshs\" (UniqueName: \"kubernetes.io/projected/94660841-d4b8-4860-86f7-ca51c0a8a6e4-kube-api-access-7vshs\") pod \"authorino-75d556bd77-rswb2\" (UID: \"94660841-d4b8-4860-86f7-ca51c0a8a6e4\") " pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:03.819102 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.819061    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vshs\" (UniqueName: \"kubernetes.io/projected/94660841-d4b8-4860-86f7-ca51c0a8a6e4-kube-api-access-7vshs\") pod \"authorino-75d556bd77-rswb2\" (UID: \"94660841-d4b8-4860-86f7-ca51c0a8a6e4\") " pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:03.899499 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:03.899455    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:04.043431 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:04.043389    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rswb2"]
Jul 30 15:20:04.046007 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:04.045962    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94660841_d4b8_4860_86f7_ca51c0a8a6e4.slice/crio-9b53dd8a7a8772bd6b4d65a8a45a30eb8b71eed164ef108a8baa92a5c1ebedc7 WatchSource:0}: Error finding container 9b53dd8a7a8772bd6b4d65a8a45a30eb8b71eed164ef108a8baa92a5c1ebedc7: Status 404 returned error can't find the container with id 9b53dd8a7a8772bd6b4d65a8a45a30eb8b71eed164ef108a8baa92a5c1ebedc7
Jul 30 15:20:04.658440 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:04.658381    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5kfpj" event={"ID":"0c9991ff-b3c7-40ca-b318-cbbc8da5a586","Type":"ContainerStarted","Data":"76b99f245e1164f219086c1a174174df3662eddea545f42ba15be56ab0fbcd5c"}
Jul 30 15:20:04.659702 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:04.659671    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rswb2" event={"ID":"94660841-d4b8-4860-86f7-ca51c0a8a6e4","Type":"ContainerStarted","Data":"9b53dd8a7a8772bd6b4d65a8a45a30eb8b71eed164ef108a8baa92a5c1ebedc7"}
Jul 30 15:20:09.701225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.701181    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5kfpj" event={"ID":"0c9991ff-b3c7-40ca-b318-cbbc8da5a586","Type":"ContainerStarted","Data":"82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8"}
Jul 30 15:20:09.702830 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.702803    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn" event={"ID":"0205328f-b548-4bab-a286-a8740f66669a","Type":"ContainerStarted","Data":"5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c"}
Jul 30 15:20:09.702980 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.702861    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:09.704277 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.704248    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rswb2" event={"ID":"94660841-d4b8-4860-86f7-ca51c0a8a6e4","Type":"ContainerStarted","Data":"378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff"}
Jul 30 15:20:09.718743 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.718686    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-5kfpj" podStartSLOduration=1.219585059 podStartE2EDuration="6.718668841s" totalImagesPullingTime="5.499083782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:09.716775318 +0000 UTC m=+608.322623420" watchObservedRunningTime="2026-07-30 15:20:09.718668841 +0000 UTC m=+608.324516944"
Jul 30 15:20:09.740647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.740570    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn" podStartSLOduration=1.403021672 podStartE2EDuration="7.740547069s" totalImagesPullingTime="6.337525397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:09.737839883 +0000 UTC m=+608.343687996" watchObservedRunningTime="2026-07-30 15:20:09.740547069 +0000 UTC m=+608.346395174"
Jul 30 15:20:09.756331 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.756248    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-rswb2" podStartSLOduration=1.560909203 podStartE2EDuration="6.756221609s" totalImagesPullingTime="5.195312406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:09.753016268 +0000 UTC m=+608.358864371" watchObservedRunningTime="2026-07-30 15:20:09.756221609 +0000 UTC m=+608.362069714"
Jul 30 15:20:09.786073 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:09.779848    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5kfpj"]
Jul 30 15:20:11.715904 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:11.715862    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-5kfpj" podUID="0c9991ff-b3c7-40ca-b318-cbbc8da5a586" containerName="authorino" containerID="cri-o://82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8" gracePeriod=30
Jul 30 15:20:11.975821 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:11.975737    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:11.999157 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:11.999125    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tvwp6\" (UniqueName: \"kubernetes.io/projected/0c9991ff-b3c7-40ca-b318-cbbc8da5a586-kube-api-access-tvwp6\") pod \"0c9991ff-b3c7-40ca-b318-cbbc8da5a586\" (UID: \"0c9991ff-b3c7-40ca-b318-cbbc8da5a586\") "
Jul 30 15:20:12.001529 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.001498    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c9991ff-b3c7-40ca-b318-cbbc8da5a586-kube-api-access-tvwp6" (OuterVolumeSpecName: "kube-api-access-tvwp6") pod "0c9991ff-b3c7-40ca-b318-cbbc8da5a586" (UID: "0c9991ff-b3c7-40ca-b318-cbbc8da5a586"). InnerVolumeSpecName "kube-api-access-tvwp6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:20:12.100215 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.100171    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tvwp6\" (UniqueName: \"kubernetes.io/projected/0c9991ff-b3c7-40ca-b318-cbbc8da5a586-kube-api-access-tvwp6\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:20:12.722671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.722639    2553 generic.go:356] "Generic (PLEG): container finished" podID="0c9991ff-b3c7-40ca-b318-cbbc8da5a586" containerID="82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8" exitCode=0
Jul 30 15:20:12.723164 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.722683    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-5kfpj"
Jul 30 15:20:12.723164 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.722722    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5kfpj" event={"ID":"0c9991ff-b3c7-40ca-b318-cbbc8da5a586","Type":"ContainerDied","Data":"82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8"}
Jul 30 15:20:12.723164 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.722770    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-5kfpj" event={"ID":"0c9991ff-b3c7-40ca-b318-cbbc8da5a586","Type":"ContainerDied","Data":"76b99f245e1164f219086c1a174174df3662eddea545f42ba15be56ab0fbcd5c"}
Jul 30 15:20:12.723164 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.722797    2553 scope.go:117] "RemoveContainer" containerID="82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8"
Jul 30 15:20:12.732709 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.732693    2553 scope.go:117] "RemoveContainer" containerID="82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8"
Jul 30 15:20:12.733038 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:20:12.733019    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8\": container with ID starting with 82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8 not found: ID does not exist" containerID="82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8"
Jul 30 15:20:12.733096 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.733048    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8"} err="failed to get container status \"82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8\": rpc error: code = NotFound desc = could not find container \"82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8\": container with ID starting with 82433b1673bfd5624a059a6e9916192c140fb2aa15dcc1f81aa9ee6ca05107c8 not found: ID does not exist"
Jul 30 15:20:12.744380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.744338    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-5kfpj"]
Jul 30 15:20:12.748060 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:12.748028    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-5kfpj"]
Jul 30 15:20:13.924137 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:13.924103    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c9991ff-b3c7-40ca-b318-cbbc8da5a586" path="/var/lib/kubelet/pods/0c9991ff-b3c7-40ca-b318-cbbc8da5a586/volumes"
Jul 30 15:20:17.835319 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:17.835259    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:17.835879 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:17.835562    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn" podUID="0205328f-b548-4bab-a286-a8740f66669a" containerName="limitador" containerID="cri-o://5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c" gracePeriod=30
Jul 30 15:20:17.838018 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:17.837991    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:18.395094 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.395015    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:18.455268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.455223    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0205328f-b548-4bab-a286-a8740f66669a-config-file\") pod \"0205328f-b548-4bab-a286-a8740f66669a\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") "
Jul 30 15:20:18.455473 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.455284    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l59z4\" (UniqueName: \"kubernetes.io/projected/0205328f-b548-4bab-a286-a8740f66669a-kube-api-access-l59z4\") pod \"0205328f-b548-4bab-a286-a8740f66669a\" (UID: \"0205328f-b548-4bab-a286-a8740f66669a\") "
Jul 30 15:20:18.455620 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.455595    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0205328f-b548-4bab-a286-a8740f66669a-config-file" (OuterVolumeSpecName: "config-file") pod "0205328f-b548-4bab-a286-a8740f66669a" (UID: "0205328f-b548-4bab-a286-a8740f66669a"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:20:18.457374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.457350    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0205328f-b548-4bab-a286-a8740f66669a-kube-api-access-l59z4" (OuterVolumeSpecName: "kube-api-access-l59z4") pod "0205328f-b548-4bab-a286-a8740f66669a" (UID: "0205328f-b548-4bab-a286-a8740f66669a"). InnerVolumeSpecName "kube-api-access-l59z4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:20:18.556615 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.556557    2553 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0205328f-b548-4bab-a286-a8740f66669a-config-file\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:20:18.556615 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.556610    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l59z4\" (UniqueName: \"kubernetes.io/projected/0205328f-b548-4bab-a286-a8740f66669a-kube-api-access-l59z4\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:20:18.757877 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.757837    2553 generic.go:356] "Generic (PLEG): container finished" podID="0205328f-b548-4bab-a286-a8740f66669a" containerID="5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c" exitCode=0
Jul 30 15:20:18.758103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.757887    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn" event={"ID":"0205328f-b548-4bab-a286-a8740f66669a","Type":"ContainerDied","Data":"5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c"}
Jul 30 15:20:18.758103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.757953    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn" event={"ID":"0205328f-b548-4bab-a286-a8740f66669a","Type":"ContainerDied","Data":"64ad3ac1befa7dd7dad22f4b630ea665504dd43931ba42e1bfaf978e6efde99c"}
Jul 30 15:20:18.758103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.757896    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"
Jul 30 15:20:18.758103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.757978    2553 scope.go:117] "RemoveContainer" containerID="5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c"
Jul 30 15:20:18.767784 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.767764    2553 scope.go:117] "RemoveContainer" containerID="5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c"
Jul 30 15:20:18.768122 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:20:18.768103    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c\": container with ID starting with 5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c not found: ID does not exist" containerID="5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c"
Jul 30 15:20:18.768172 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.768135    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c"} err="failed to get container status \"5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c\": rpc error: code = NotFound desc = could not find container \"5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c\": container with ID starting with 5e93fff8662c69788e953818f340e52ed0586ff7b642ef0e97f9ab3c721c965c not found: ID does not exist"
Jul 30 15:20:18.781079 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.781043    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:18.787223 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:18.787193    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-hfgkn"]
Jul 30 15:20:19.924408 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:19.924366    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0205328f-b548-4bab-a286-a8740f66669a" path="/var/lib/kubelet/pods/0205328f-b548-4bab-a286-a8740f66669a/volumes"
Jul 30 15:20:23.739737 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.739698    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"]
Jul 30 15:20:23.740146 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.740061    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0205328f-b548-4bab-a286-a8740f66669a" containerName="limitador"
Jul 30 15:20:23.740146 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.740073    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0205328f-b548-4bab-a286-a8740f66669a" containerName="limitador"
Jul 30 15:20:23.740146 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.740086    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c9991ff-b3c7-40ca-b318-cbbc8da5a586" containerName="authorino"
Jul 30 15:20:23.740146 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.740092    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c9991ff-b3c7-40ca-b318-cbbc8da5a586" containerName="authorino"
Jul 30 15:20:23.740276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.740156    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0205328f-b548-4bab-a286-a8740f66669a" containerName="limitador"
Jul 30 15:20:23.740276 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.740164    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c9991ff-b3c7-40ca-b318-cbbc8da5a586" containerName="authorino"
Jul 30 15:20:23.744525 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.744499    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:23.747589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.747518    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 30 15:20:23.747754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.747634    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 30 15:20:23.747754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.747721    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 30 15:20:23.748951 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.748929    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-nh5md\""
Jul 30 15:20:23.751741 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.751716    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"]
Jul 30 15:20:23.806116 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.806081    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lj2rn\" (UniqueName: \"kubernetes.io/projected/513ef1c0-946d-42d8-aadc-fb06372c6db0-kube-api-access-lj2rn\") pod \"postgres-69fb4594cf-qp4km\" (UID: \"513ef1c0-946d-42d8-aadc-fb06372c6db0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:23.806305 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.806140    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/513ef1c0-946d-42d8-aadc-fb06372c6db0-data\") pod \"postgres-69fb4594cf-qp4km\" (UID: \"513ef1c0-946d-42d8-aadc-fb06372c6db0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:23.907449 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.907380    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/513ef1c0-946d-42d8-aadc-fb06372c6db0-data\") pod \"postgres-69fb4594cf-qp4km\" (UID: \"513ef1c0-946d-42d8-aadc-fb06372c6db0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:23.907653 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.907509    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lj2rn\" (UniqueName: \"kubernetes.io/projected/513ef1c0-946d-42d8-aadc-fb06372c6db0-kube-api-access-lj2rn\") pod \"postgres-69fb4594cf-qp4km\" (UID: \"513ef1c0-946d-42d8-aadc-fb06372c6db0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:23.907833 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.907810    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/513ef1c0-946d-42d8-aadc-fb06372c6db0-data\") pod \"postgres-69fb4594cf-qp4km\" (UID: \"513ef1c0-946d-42d8-aadc-fb06372c6db0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:23.919092 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:23.919019    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lj2rn\" (UniqueName: \"kubernetes.io/projected/513ef1c0-946d-42d8-aadc-fb06372c6db0-kube-api-access-lj2rn\") pod \"postgres-69fb4594cf-qp4km\" (UID: \"513ef1c0-946d-42d8-aadc-fb06372c6db0\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:24.056946 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:24.056841    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:24.198311 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:24.198280    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"]
Jul 30 15:20:24.199945 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:24.199915    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513ef1c0_946d_42d8_aadc_fb06372c6db0.slice/crio-6cecf6687b644ab8a67145cceeb48fca860e11bf5b8dd50ee310f53580a78f63 WatchSource:0}: Error finding container 6cecf6687b644ab8a67145cceeb48fca860e11bf5b8dd50ee310f53580a78f63: Status 404 returned error can't find the container with id 6cecf6687b644ab8a67145cceeb48fca860e11bf5b8dd50ee310f53580a78f63
Jul 30 15:20:24.791436 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:24.791384    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km" event={"ID":"513ef1c0-946d-42d8-aadc-fb06372c6db0","Type":"ContainerStarted","Data":"6cecf6687b644ab8a67145cceeb48fca860e11bf5b8dd50ee310f53580a78f63"}
Jul 30 15:20:29.829920 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:29.829879    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km" event={"ID":"513ef1c0-946d-42d8-aadc-fb06372c6db0","Type":"ContainerStarted","Data":"32fa6b91026fc78c96e15b3f3c704ef6439acd9950e352d911fcb610115c4055"}
Jul 30 15:20:29.830349 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:29.830049    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:29.850770 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:29.850710    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km" podStartSLOduration=1.317859131 podStartE2EDuration="6.850694018s" totalImagesPullingTime="5.532834887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:29.847841265 +0000 UTC m=+628.453689368" watchObservedRunningTime="2026-07-30 15:20:29.850694018 +0000 UTC m=+628.456542186"
Jul 30 15:20:35.865841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:35.865807    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-qp4km"
Jul 30 15:20:36.440325 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.440287    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5pz7"]
Jul 30 15:20:36.447215 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.447185    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:36.449408 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.449376    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5pz7"]
Jul 30 15:20:36.527706 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.527661    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqhg8\" (UniqueName: \"kubernetes.io/projected/d226ed06-2e79-4c5c-9b37-536125ff447f-kube-api-access-bqhg8\") pod \"authorino-5d4b67c446-p5pz7\" (UID: \"d226ed06-2e79-4c5c-9b37-536125ff447f\") " pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:36.628601 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.628559    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bqhg8\" (UniqueName: \"kubernetes.io/projected/d226ed06-2e79-4c5c-9b37-536125ff447f-kube-api-access-bqhg8\") pod \"authorino-5d4b67c446-p5pz7\" (UID: \"d226ed06-2e79-4c5c-9b37-536125ff447f\") " pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:36.638148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.638115    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqhg8\" (UniqueName: \"kubernetes.io/projected/d226ed06-2e79-4c5c-9b37-536125ff447f-kube-api-access-bqhg8\") pod \"authorino-5d4b67c446-p5pz7\" (UID: \"d226ed06-2e79-4c5c-9b37-536125ff447f\") " pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:36.699528 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.699429    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5pz7"]
Jul 30 15:20:36.699725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.699710    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:36.729747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.729708    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5845dbc8d8-xbjbn"]
Jul 30 15:20:36.735629 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.735602    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:36.740318 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.740287    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5845dbc8d8-xbjbn"]
Jul 30 15:20:36.829898 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.829864    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85b8p\" (UniqueName: \"kubernetes.io/projected/08069617-7264-4810-aee5-b66b268b130f-kube-api-access-85b8p\") pod \"authorino-5845dbc8d8-xbjbn\" (UID: \"08069617-7264-4810-aee5-b66b268b130f\") " pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:36.848571 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.848535    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5pz7"]
Jul 30 15:20:36.850888 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:36.850851    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd226ed06_2e79_4c5c_9b37_536125ff447f.slice/crio-9d86a553b137f72170005e7c7081540319b9b1b2674c35b0d7487047139db1d7 WatchSource:0}: Error finding container 9d86a553b137f72170005e7c7081540319b9b1b2674c35b0d7487047139db1d7: Status 404 returned error can't find the container with id 9d86a553b137f72170005e7c7081540319b9b1b2674c35b0d7487047139db1d7
Jul 30 15:20:36.866745 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.866707    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5pz7" event={"ID":"d226ed06-2e79-4c5c-9b37-536125ff447f","Type":"ContainerStarted","Data":"9d86a553b137f72170005e7c7081540319b9b1b2674c35b0d7487047139db1d7"}
Jul 30 15:20:36.898063 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.898022    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5845dbc8d8-xbjbn"]
Jul 30 15:20:36.898312 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:20:36.898293    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-85b8p], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5845dbc8d8-xbjbn" podUID="08069617-7264-4810-aee5-b66b268b130f"
Jul 30 15:20:36.928101 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.928066    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-674f946d56-8tmdt"]
Jul 30 15:20:36.931097 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.931070    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85b8p\" (UniqueName: \"kubernetes.io/projected/08069617-7264-4810-aee5-b66b268b130f-kube-api-access-85b8p\") pod \"authorino-5845dbc8d8-xbjbn\" (UID: \"08069617-7264-4810-aee5-b66b268b130f\") " pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:36.932076 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.932058    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:36.938463 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.938411    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 30 15:20:36.948722 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.948693    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674f946d56-8tmdt"]
Jul 30 15:20:36.950250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:36.950184    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85b8p\" (UniqueName: \"kubernetes.io/projected/08069617-7264-4810-aee5-b66b268b130f-kube-api-access-85b8p\") pod \"authorino-5845dbc8d8-xbjbn\" (UID: \"08069617-7264-4810-aee5-b66b268b130f\") " pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:37.031863 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.031821    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43999d69-dccd-428e-9941-1e9809faeabe-tls-cert\") pod \"authorino-674f946d56-8tmdt\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") " pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.032054 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.031907    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf8vp\" (UniqueName: \"kubernetes.io/projected/43999d69-dccd-428e-9941-1e9809faeabe-kube-api-access-kf8vp\") pod \"authorino-674f946d56-8tmdt\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") " pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.133166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.133113    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43999d69-dccd-428e-9941-1e9809faeabe-tls-cert\") pod \"authorino-674f946d56-8tmdt\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") " pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.133166 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.133159    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf8vp\" (UniqueName: \"kubernetes.io/projected/43999d69-dccd-428e-9941-1e9809faeabe-kube-api-access-kf8vp\") pod \"authorino-674f946d56-8tmdt\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") " pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.135660 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.135636    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43999d69-dccd-428e-9941-1e9809faeabe-tls-cert\") pod \"authorino-674f946d56-8tmdt\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") " pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.142206 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.142182    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf8vp\" (UniqueName: \"kubernetes.io/projected/43999d69-dccd-428e-9941-1e9809faeabe-kube-api-access-kf8vp\") pod \"authorino-674f946d56-8tmdt\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") " pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.241944 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.241845    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:20:37.386179 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.386152    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-674f946d56-8tmdt"]
Jul 30 15:20:37.388157 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:37.388114    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod43999d69_dccd_428e_9941_1e9809faeabe.slice/crio-248885baef664b0f14e6a4c9b8d5c6075478ec044482e6909d8254c2a63d88b6 WatchSource:0}: Error finding container 248885baef664b0f14e6a4c9b8d5c6075478ec044482e6909d8254c2a63d88b6: Status 404 returned error can't find the container with id 248885baef664b0f14e6a4c9b8d5c6075478ec044482e6909d8254c2a63d88b6
Jul 30 15:20:37.874097 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.873974    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5pz7" event={"ID":"d226ed06-2e79-4c5c-9b37-536125ff447f","Type":"ContainerStarted","Data":"2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a"}
Jul 30 15:20:37.874097 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.874023    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-p5pz7" podUID="d226ed06-2e79-4c5c-9b37-536125ff447f" containerName="authorino" containerID="cri-o://2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a" gracePeriod=30
Jul 30 15:20:37.875468 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.875442    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674f946d56-8tmdt" event={"ID":"43999d69-dccd-428e-9941-1e9809faeabe","Type":"ContainerStarted","Data":"248885baef664b0f14e6a4c9b8d5c6075478ec044482e6909d8254c2a63d88b6"}
Jul 30 15:20:37.875580 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.875518    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:37.883821 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.883791    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:37.890901 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:37.890848    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-p5pz7" podStartSLOduration=1.2325313900000001 podStartE2EDuration="1.890828912s" totalImagesPullingTime="658.297522ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:37.889605744 +0000 UTC m=+636.495453849" watchObservedRunningTime="2026-07-30 15:20:37.890828912 +0000 UTC m=+636.496677016"
Jul 30 15:20:38.042902 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.042864    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85b8p\" (UniqueName: \"kubernetes.io/projected/08069617-7264-4810-aee5-b66b268b130f-kube-api-access-85b8p\") pod \"08069617-7264-4810-aee5-b66b268b130f\" (UID: \"08069617-7264-4810-aee5-b66b268b130f\") "
Jul 30 15:20:38.045055 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.045020    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08069617-7264-4810-aee5-b66b268b130f-kube-api-access-85b8p" (OuterVolumeSpecName: "kube-api-access-85b8p") pod "08069617-7264-4810-aee5-b66b268b130f" (UID: "08069617-7264-4810-aee5-b66b268b130f"). InnerVolumeSpecName "kube-api-access-85b8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:20:38.135358 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.135334    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:38.143814 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.143780    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85b8p\" (UniqueName: \"kubernetes.io/projected/08069617-7264-4810-aee5-b66b268b130f-kube-api-access-85b8p\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:20:38.245173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.245118    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bqhg8\" (UniqueName: \"kubernetes.io/projected/d226ed06-2e79-4c5c-9b37-536125ff447f-kube-api-access-bqhg8\") pod \"d226ed06-2e79-4c5c-9b37-536125ff447f\" (UID: \"d226ed06-2e79-4c5c-9b37-536125ff447f\") "
Jul 30 15:20:38.247266 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.247241    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d226ed06-2e79-4c5c-9b37-536125ff447f-kube-api-access-bqhg8" (OuterVolumeSpecName: "kube-api-access-bqhg8") pod "d226ed06-2e79-4c5c-9b37-536125ff447f" (UID: "d226ed06-2e79-4c5c-9b37-536125ff447f"). InnerVolumeSpecName "kube-api-access-bqhg8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:20:38.346160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.346119    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bqhg8\" (UniqueName: \"kubernetes.io/projected/d226ed06-2e79-4c5c-9b37-536125ff447f-kube-api-access-bqhg8\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:20:38.882428 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.882374    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674f946d56-8tmdt" event={"ID":"43999d69-dccd-428e-9941-1e9809faeabe","Type":"ContainerStarted","Data":"7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72"}
Jul 30 15:20:38.884011 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.883981    2553 generic.go:356] "Generic (PLEG): container finished" podID="d226ed06-2e79-4c5c-9b37-536125ff447f" containerID="2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a" exitCode=0
Jul 30 15:20:38.884150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.884026    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-p5pz7"
Jul 30 15:20:38.884150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.884063    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5pz7" event={"ID":"d226ed06-2e79-4c5c-9b37-536125ff447f","Type":"ContainerDied","Data":"2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a"}
Jul 30 15:20:38.884150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.884110    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-p5pz7" event={"ID":"d226ed06-2e79-4c5c-9b37-536125ff447f","Type":"ContainerDied","Data":"9d86a553b137f72170005e7c7081540319b9b1b2674c35b0d7487047139db1d7"}
Jul 30 15:20:38.884150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.884136    2553 scope.go:117] "RemoveContainer" containerID="2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a"
Jul 30 15:20:38.884311 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.884247    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5845dbc8d8-xbjbn"
Jul 30 15:20:38.894742 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.894720    2553 scope.go:117] "RemoveContainer" containerID="2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a"
Jul 30 15:20:38.895067 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:20:38.895043    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a\": container with ID starting with 2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a not found: ID does not exist" containerID="2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a"
Jul 30 15:20:38.895111 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.895079    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a"} err="failed to get container status \"2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a\": rpc error: code = NotFound desc = could not find container \"2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a\": container with ID starting with 2d1ad7727a7edebd24fd06958d58823894f5ae7a942bc3639de711e8286be86a not found: ID does not exist"
Jul 30 15:20:38.904532 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.904475    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-674f946d56-8tmdt" podStartSLOduration=1.4980520720000001 podStartE2EDuration="2.904409532s" totalImagesPullingTime="1.40635746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:38.900909177 +0000 UTC m=+637.506757280" watchObservedRunningTime="2026-07-30 15:20:38.904409532 +0000 UTC m=+637.510257638"
Jul 30 15:20:38.925122 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.925082    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5pz7"]
Jul 30 15:20:38.929957 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.929925    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-p5pz7"]
Jul 30 15:20:38.935395 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.935329    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rswb2"]
Jul 30 15:20:38.935640 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.935584    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-rswb2" podUID="94660841-d4b8-4860-86f7-ca51c0a8a6e4" containerName="authorino" containerID="cri-o://378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff" gracePeriod=30
Jul 30 15:20:38.964942 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.964816    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5845dbc8d8-xbjbn"]
Jul 30 15:20:38.968433 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:38.968380    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5845dbc8d8-xbjbn"]
Jul 30 15:20:39.185748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.185714    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:39.355157 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.355116    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vshs\" (UniqueName: \"kubernetes.io/projected/94660841-d4b8-4860-86f7-ca51c0a8a6e4-kube-api-access-7vshs\") pod \"94660841-d4b8-4860-86f7-ca51c0a8a6e4\" (UID: \"94660841-d4b8-4860-86f7-ca51c0a8a6e4\") "
Jul 30 15:20:39.357292 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.357267    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94660841-d4b8-4860-86f7-ca51c0a8a6e4-kube-api-access-7vshs" (OuterVolumeSpecName: "kube-api-access-7vshs") pod "94660841-d4b8-4860-86f7-ca51c0a8a6e4" (UID: "94660841-d4b8-4860-86f7-ca51c0a8a6e4"). InnerVolumeSpecName "kube-api-access-7vshs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:20:39.456848 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.456760    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vshs\" (UniqueName: \"kubernetes.io/projected/94660841-d4b8-4860-86f7-ca51c0a8a6e4-kube-api-access-7vshs\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:20:39.891965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.891868    2553 generic.go:356] "Generic (PLEG): container finished" podID="94660841-d4b8-4860-86f7-ca51c0a8a6e4" containerID="378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff" exitCode=0
Jul 30 15:20:39.891965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.891913    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-rswb2"
Jul 30 15:20:39.891965 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.891943    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rswb2" event={"ID":"94660841-d4b8-4860-86f7-ca51c0a8a6e4","Type":"ContainerDied","Data":"378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff"}
Jul 30 15:20:39.892583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.891984    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-rswb2" event={"ID":"94660841-d4b8-4860-86f7-ca51c0a8a6e4","Type":"ContainerDied","Data":"9b53dd8a7a8772bd6b4d65a8a45a30eb8b71eed164ef108a8baa92a5c1ebedc7"}
Jul 30 15:20:39.892583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.892008    2553 scope.go:117] "RemoveContainer" containerID="378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff"
Jul 30 15:20:39.901121 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.901098    2553 scope.go:117] "RemoveContainer" containerID="378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff"
Jul 30 15:20:39.901444 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:20:39.901405    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff\": container with ID starting with 378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff not found: ID does not exist" containerID="378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff"
Jul 30 15:20:39.901530 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.901454    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff"} err="failed to get container status \"378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff\": rpc error: code = NotFound desc = could not find container \"378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff\": container with ID starting with 378b4eaffa768446f32ff422158025e4620f6e2b320bf038ea25efc8eca257ff not found: ID does not exist"
Jul 30 15:20:39.914952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.914919    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rswb2"]
Jul 30 15:20:39.925316 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.925286    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08069617-7264-4810-aee5-b66b268b130f" path="/var/lib/kubelet/pods/08069617-7264-4810-aee5-b66b268b130f/volumes"
Jul 30 15:20:39.925548 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.925535    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d226ed06-2e79-4c5c-9b37-536125ff447f" path="/var/lib/kubelet/pods/d226ed06-2e79-4c5c-9b37-536125ff447f/volumes"
Jul 30 15:20:39.925803 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:39.925791    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-rswb2"]
Jul 30 15:20:41.924754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:41.924718    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94660841-d4b8-4860-86f7-ca51c0a8a6e4" path="/var/lib/kubelet/pods/94660841-d4b8-4860-86f7-ca51c0a8a6e4/volumes"
Jul 30 15:20:44.002848 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.002807    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8687dd7545-lgzsm"]
Jul 30 15:20:44.003374 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.003354    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d226ed06-2e79-4c5c-9b37-536125ff447f" containerName="authorino"
Jul 30 15:20:44.003496 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.003377    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d226ed06-2e79-4c5c-9b37-536125ff447f" containerName="authorino"
Jul 30 15:20:44.003496 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.003392    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94660841-d4b8-4860-86f7-ca51c0a8a6e4" containerName="authorino"
Jul 30 15:20:44.003496 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.003400    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="94660841-d4b8-4860-86f7-ca51c0a8a6e4" containerName="authorino"
Jul 30 15:20:44.003631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.003506    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d226ed06-2e79-4c5c-9b37-536125ff447f" containerName="authorino"
Jul 30 15:20:44.003631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.003516    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="94660841-d4b8-4860-86f7-ca51c0a8a6e4" containerName="authorino"
Jul 30 15:20:44.009329 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.009305    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.012641 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.012613    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wv2zx\""
Jul 30 15:20:44.012641 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.012633    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 15:20:44.012849 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.012613    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 15:20:44.020577 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.020540    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8687dd7545-lgzsm"]
Jul 30 15:20:44.198666 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.198619    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwtqg\" (UniqueName: \"kubernetes.io/projected/27ee8a08-812b-496d-b66e-8ec04f37c501-kube-api-access-zwtqg\") pod \"maas-controller-8687dd7545-lgzsm\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") " pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.198896 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.198678    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27ee8a08-812b-496d-b66e-8ec04f37c501-webhook-cert\") pod \"maas-controller-8687dd7545-lgzsm\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") " pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.211372 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.211332    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64966fd4f8-g98vn"]
Jul 30 15:20:44.214120 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.214096    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.224960 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.224923    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-g98vn"]
Jul 30 15:20:44.299898 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.299785    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27ee8a08-812b-496d-b66e-8ec04f37c501-webhook-cert\") pod \"maas-controller-8687dd7545-lgzsm\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") " pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.299898 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.299887    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwtqg\" (UniqueName: \"kubernetes.io/projected/27ee8a08-812b-496d-b66e-8ec04f37c501-kube-api-access-zwtqg\") pod \"maas-controller-8687dd7545-lgzsm\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") " pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.302440 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.302401    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27ee8a08-812b-496d-b66e-8ec04f37c501-webhook-cert\") pod \"maas-controller-8687dd7545-lgzsm\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") " pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.308853 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.308829    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwtqg\" (UniqueName: \"kubernetes.io/projected/27ee8a08-812b-496d-b66e-8ec04f37c501-kube-api-access-zwtqg\") pod \"maas-controller-8687dd7545-lgzsm\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") " pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.321583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.321548    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:44.400637 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.400600    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbhrw\" (UniqueName: \"kubernetes.io/projected/0ac114bb-d65c-4adb-9116-8595dcd8ce99-kube-api-access-vbhrw\") pod \"maas-controller-64966fd4f8-g98vn\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") " pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.400834 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.400681    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ac114bb-d65c-4adb-9116-8595dcd8ce99-webhook-cert\") pod \"maas-controller-64966fd4f8-g98vn\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") " pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.466366 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.466336    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8687dd7545-lgzsm"]
Jul 30 15:20:44.468087 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:44.468064    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27ee8a08_812b_496d_b66e_8ec04f37c501.slice/crio-c8b73fbb67859e6d79f6696e4b77e5abdf5ab5d577793d2d6542c4eefad8d55a WatchSource:0}: Error finding container c8b73fbb67859e6d79f6696e4b77e5abdf5ab5d577793d2d6542c4eefad8d55a: Status 404 returned error can't find the container with id c8b73fbb67859e6d79f6696e4b77e5abdf5ab5d577793d2d6542c4eefad8d55a
Jul 30 15:20:44.469666 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.469643    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:20:44.501665 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.501632    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ac114bb-d65c-4adb-9116-8595dcd8ce99-webhook-cert\") pod \"maas-controller-64966fd4f8-g98vn\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") " pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.501858 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.501709    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vbhrw\" (UniqueName: \"kubernetes.io/projected/0ac114bb-d65c-4adb-9116-8595dcd8ce99-kube-api-access-vbhrw\") pod \"maas-controller-64966fd4f8-g98vn\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") " pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.504268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.504246    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ac114bb-d65c-4adb-9116-8595dcd8ce99-webhook-cert\") pod \"maas-controller-64966fd4f8-g98vn\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") " pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.511490 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.511463    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbhrw\" (UniqueName: \"kubernetes.io/projected/0ac114bb-d65c-4adb-9116-8595dcd8ce99-kube-api-access-vbhrw\") pod \"maas-controller-64966fd4f8-g98vn\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") " pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.526337 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.526304    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:44.670737 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.670704    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-g98vn"]
Jul 30 15:20:44.672371 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:20:44.672343    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ac114bb_d65c_4adb_9116_8595dcd8ce99.slice/crio-4568870c0a76c3b6e3c2c01470dab96241798de41a97d6c4b35e75b4f0200b93 WatchSource:0}: Error finding container 4568870c0a76c3b6e3c2c01470dab96241798de41a97d6c4b35e75b4f0200b93: Status 404 returned error can't find the container with id 4568870c0a76c3b6e3c2c01470dab96241798de41a97d6c4b35e75b4f0200b93
Jul 30 15:20:44.929332 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.929287    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-g98vn" event={"ID":"0ac114bb-d65c-4adb-9116-8595dcd8ce99","Type":"ContainerStarted","Data":"4568870c0a76c3b6e3c2c01470dab96241798de41a97d6c4b35e75b4f0200b93"}
Jul 30 15:20:44.930567 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:44.930536    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8687dd7545-lgzsm" event={"ID":"27ee8a08-812b-496d-b66e-8ec04f37c501","Type":"ContainerStarted","Data":"c8b73fbb67859e6d79f6696e4b77e5abdf5ab5d577793d2d6542c4eefad8d55a"}
Jul 30 15:20:48.956724 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:48.956677    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-g98vn" event={"ID":"0ac114bb-d65c-4adb-9116-8595dcd8ce99","Type":"ContainerStarted","Data":"32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea"}
Jul 30 15:20:48.957222 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:48.956752    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:48.958312 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:48.958283    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8687dd7545-lgzsm" event={"ID":"27ee8a08-812b-496d-b66e-8ec04f37c501","Type":"ContainerStarted","Data":"a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f"}
Jul 30 15:20:48.958485 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:48.958336    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:20:48.981481 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:48.981401    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64966fd4f8-g98vn" podStartSLOduration=1.455319087 podStartE2EDuration="4.98138301s" totalImagesPullingTime="3.526063923s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:48.979828535 +0000 UTC m=+647.585676620" watchObservedRunningTime="2026-07-30 15:20:48.98138301 +0000 UTC m=+647.587231127"
Jul 30 15:20:49.002010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:49.001945    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8687dd7545-lgzsm" podStartSLOduration=2.279980664 podStartE2EDuration="6.001929097s" totalImagesPullingTime="3.721948433s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:20:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:20:49.000111602 +0000 UTC m=+647.605959738" watchObservedRunningTime="2026-07-30 15:20:49.001929097 +0000 UTC m=+647.607777200"
Jul 30 15:20:59.966278 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:59.966244    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:20:59.966697 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:20:59.966320    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:21:00.035943 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.035902    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8687dd7545-lgzsm"]
Jul 30 15:21:00.036222 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.036177    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-8687dd7545-lgzsm" podUID="27ee8a08-812b-496d-b66e-8ec04f37c501" containerName="manager" containerID="cri-o://a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f" gracePeriod=30
Jul 30 15:21:00.317340 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.317302    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:21:00.348935 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.348903    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27ee8a08-812b-496d-b66e-8ec04f37c501-webhook-cert\") pod \"27ee8a08-812b-496d-b66e-8ec04f37c501\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") "
Jul 30 15:21:00.349108 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.348955    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwtqg\" (UniqueName: \"kubernetes.io/projected/27ee8a08-812b-496d-b66e-8ec04f37c501-kube-api-access-zwtqg\") pod \"27ee8a08-812b-496d-b66e-8ec04f37c501\" (UID: \"27ee8a08-812b-496d-b66e-8ec04f37c501\") "
Jul 30 15:21:00.351305 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.351263    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/27ee8a08-812b-496d-b66e-8ec04f37c501-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "27ee8a08-812b-496d-b66e-8ec04f37c501" (UID: "27ee8a08-812b-496d-b66e-8ec04f37c501"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:21:00.351456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.351259    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27ee8a08-812b-496d-b66e-8ec04f37c501-kube-api-access-zwtqg" (OuterVolumeSpecName: "kube-api-access-zwtqg") pod "27ee8a08-812b-496d-b66e-8ec04f37c501" (UID: "27ee8a08-812b-496d-b66e-8ec04f37c501"). InnerVolumeSpecName "kube-api-access-zwtqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:21:00.449656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.449614    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwtqg\" (UniqueName: \"kubernetes.io/projected/27ee8a08-812b-496d-b66e-8ec04f37c501-kube-api-access-zwtqg\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:21:00.449656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:00.449649    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/27ee8a08-812b-496d-b66e-8ec04f37c501-webhook-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:21:01.032733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.032691    2553 generic.go:356] "Generic (PLEG): container finished" podID="27ee8a08-812b-496d-b66e-8ec04f37c501" containerID="a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f" exitCode=0
Jul 30 15:21:01.033250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.032739    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8687dd7545-lgzsm"
Jul 30 15:21:01.033250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.032773    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8687dd7545-lgzsm" event={"ID":"27ee8a08-812b-496d-b66e-8ec04f37c501","Type":"ContainerDied","Data":"a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f"}
Jul 30 15:21:01.033250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.032829    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8687dd7545-lgzsm" event={"ID":"27ee8a08-812b-496d-b66e-8ec04f37c501","Type":"ContainerDied","Data":"c8b73fbb67859e6d79f6696e4b77e5abdf5ab5d577793d2d6542c4eefad8d55a"}
Jul 30 15:21:01.033250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.032854    2553 scope.go:117] "RemoveContainer" containerID="a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f"
Jul 30 15:21:01.043549 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.043354    2553 scope.go:117] "RemoveContainer" containerID="a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f"
Jul 30 15:21:01.043750 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:21:01.043732    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f\": container with ID starting with a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f not found: ID does not exist" containerID="a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f"
Jul 30 15:21:01.043806 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.043758    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f"} err="failed to get container status \"a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f\": rpc error: code = NotFound desc = could not find container \"a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f\": container with ID starting with a7631fa5cf6ddd0c1fcfff8f13f8efbd41c8fa6968ccf658ccd37e19e93eb43f not found: ID does not exist"
Jul 30 15:21:01.058457 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.058409    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8687dd7545-lgzsm"]
Jul 30 15:21:01.062378 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.062340    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8687dd7545-lgzsm"]
Jul 30 15:21:01.924876 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:01.924840    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27ee8a08-812b-496d-b66e-8ec04f37c501" path="/var/lib/kubelet/pods/27ee8a08-812b-496d-b66e-8ec04f37c501/volumes"
Jul 30 15:21:22.930433 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.930378    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"]
Jul 30 15:21:22.930956 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.930774    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27ee8a08-812b-496d-b66e-8ec04f37c501" containerName="manager"
Jul 30 15:21:22.930956 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.930786    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="27ee8a08-812b-496d-b66e-8ec04f37c501" containerName="manager"
Jul 30 15:21:22.930956 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.930855    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="27ee8a08-812b-496d-b66e-8ec04f37c501" containerName="manager"
Jul 30 15:21:22.944119 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.944079    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:22.945382 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.945338    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"]
Jul 30 15:21:22.947093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.947066    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 30 15:21:22.947239 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:22.947205    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-725n9\""
Jul 30 15:21:23.056230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.056169    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c9daf37-60d1-4a99-9db0-9d2510917ca8-maas-api-tls\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.056230 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.056234    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c9daf37-60d1-4a99-9db0-9d2510917ca8-openshift-service-ca\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.056508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.056266    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxtrs\" (UniqueName: \"kubernetes.io/projected/5c9daf37-60d1-4a99-9db0-9d2510917ca8-kube-api-access-rxtrs\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.161173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.161130    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c9daf37-60d1-4a99-9db0-9d2510917ca8-maas-api-tls\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.161173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.161171    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c9daf37-60d1-4a99-9db0-9d2510917ca8-openshift-service-ca\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.161446 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.161202    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxtrs\" (UniqueName: \"kubernetes.io/projected/5c9daf37-60d1-4a99-9db0-9d2510917ca8-kube-api-access-rxtrs\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.162059 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.162028    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c9daf37-60d1-4a99-9db0-9d2510917ca8-openshift-service-ca\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.163736 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.163712    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5c9daf37-60d1-4a99-9db0-9d2510917ca8-maas-api-tls\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.171603 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.171566    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxtrs\" (UniqueName: \"kubernetes.io/projected/5c9daf37-60d1-4a99-9db0-9d2510917ca8-kube-api-access-rxtrs\") pod \"maas-api-794cfb675b-vfljz\" (UID: \"5c9daf37-60d1-4a99-9db0-9d2510917ca8\") " pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.256357 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.256267    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:23.426665 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.426631    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"]
Jul 30 15:21:23.427242 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:21:23.427217    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c9daf37_60d1_4a99_9db0_9d2510917ca8.slice/crio-e1d99f53937971d30ad6c98bca6013b6e39083007ea4e279e8b06b2132f86b29 WatchSource:0}: Error finding container e1d99f53937971d30ad6c98bca6013b6e39083007ea4e279e8b06b2132f86b29: Status 404 returned error can't find the container with id e1d99f53937971d30ad6c98bca6013b6e39083007ea4e279e8b06b2132f86b29
Jul 30 15:21:23.682135 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.682095    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"]
Jul 30 15:21:23.687207 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.687181    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.690765 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.690735    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 30 15:21:23.709330 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.709296    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"]
Jul 30 15:21:23.768343 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.768300    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k88qm\" (UniqueName: \"kubernetes.io/projected/e02b63dc-c288-4188-8152-0b6568fc477b-kube-api-access-k88qm\") pod \"payload-pre-processing-687dbb6cf6-p255w\" (UID: \"e02b63dc-c288-4188-8152-0b6568fc477b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.768581 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.768362    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e02b63dc-c288-4188-8152-0b6568fc477b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p255w\" (UID: \"e02b63dc-c288-4188-8152-0b6568fc477b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.775585 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.775551    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-qdbwx"]
Jul 30 15:21:23.779277 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.779249    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.782173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.782154    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-7gzx2\""
Jul 30 15:21:23.801050 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.801011    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-qdbwx"]
Jul 30 15:21:23.869598 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.869561    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea16af77-73d0-4d5c-8e33-db205867a5c5-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-qdbwx\" (UID: \"ea16af77-73d0-4d5c-8e33-db205867a5c5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.869816 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.869608    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k88qm\" (UniqueName: \"kubernetes.io/projected/e02b63dc-c288-4188-8152-0b6568fc477b-kube-api-access-k88qm\") pod \"payload-pre-processing-687dbb6cf6-p255w\" (UID: \"e02b63dc-c288-4188-8152-0b6568fc477b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.869816 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.869701    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bw79j\" (UniqueName: \"kubernetes.io/projected/ea16af77-73d0-4d5c-8e33-db205867a5c5-kube-api-access-bw79j\") pod \"payload-processing-5cc6cd444b-qdbwx\" (UID: \"ea16af77-73d0-4d5c-8e33-db205867a5c5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.869816 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.869749    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e02b63dc-c288-4188-8152-0b6568fc477b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p255w\" (UID: \"e02b63dc-c288-4188-8152-0b6568fc477b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.870434 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.870399    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e02b63dc-c288-4188-8152-0b6568fc477b-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-p255w\" (UID: \"e02b63dc-c288-4188-8152-0b6568fc477b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.880560 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.880531    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k88qm\" (UniqueName: \"kubernetes.io/projected/e02b63dc-c288-4188-8152-0b6568fc477b-kube-api-access-k88qm\") pod \"payload-pre-processing-687dbb6cf6-p255w\" (UID: \"e02b63dc-c288-4188-8152-0b6568fc477b\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:23.971079 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.970986    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea16af77-73d0-4d5c-8e33-db205867a5c5-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-qdbwx\" (UID: \"ea16af77-73d0-4d5c-8e33-db205867a5c5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.971079 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.971050    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bw79j\" (UniqueName: \"kubernetes.io/projected/ea16af77-73d0-4d5c-8e33-db205867a5c5-kube-api-access-bw79j\") pod \"payload-processing-5cc6cd444b-qdbwx\" (UID: \"ea16af77-73d0-4d5c-8e33-db205867a5c5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.971824 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.971801    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ea16af77-73d0-4d5c-8e33-db205867a5c5-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-qdbwx\" (UID: \"ea16af77-73d0-4d5c-8e33-db205867a5c5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.982368 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.982331    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bw79j\" (UniqueName: \"kubernetes.io/projected/ea16af77-73d0-4d5c-8e33-db205867a5c5-kube-api-access-bw79j\") pod \"payload-processing-5cc6cd444b-qdbwx\" (UID: \"ea16af77-73d0-4d5c-8e33-db205867a5c5\") " pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:23.998302 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:23.998261    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:24.090478 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:24.090432    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:24.157183 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:24.157144    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"]
Jul 30 15:21:24.167252 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:24.167215    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz" event={"ID":"5c9daf37-60d1-4a99-9db0-9d2510917ca8","Type":"ContainerStarted","Data":"e1d99f53937971d30ad6c98bca6013b6e39083007ea4e279e8b06b2132f86b29"}
Jul 30 15:21:24.250765 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:24.250727    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-qdbwx"]
Jul 30 15:21:24.253593 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:21:24.253562    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea16af77_73d0_4d5c_8e33_db205867a5c5.slice/crio-84fe0d8266353c8bc49b1b677c1b6af749e0cbd37b4a9e7e5acf5d9aba7d6f31 WatchSource:0}: Error finding container 84fe0d8266353c8bc49b1b677c1b6af749e0cbd37b4a9e7e5acf5d9aba7d6f31: Status 404 returned error can't find the container with id 84fe0d8266353c8bc49b1b677c1b6af749e0cbd37b4a9e7e5acf5d9aba7d6f31
Jul 30 15:21:25.175675 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:25.175638    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w" event={"ID":"e02b63dc-c288-4188-8152-0b6568fc477b","Type":"ContainerStarted","Data":"781c50885754f8f2f1083aeac190ae56e36dd1f747fb58e207c42f5236b51189"}
Jul 30 15:21:25.177592 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:25.177558    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx" event={"ID":"ea16af77-73d0-4d5c-8e33-db205867a5c5","Type":"ContainerStarted","Data":"84fe0d8266353c8bc49b1b677c1b6af749e0cbd37b4a9e7e5acf5d9aba7d6f31"}
Jul 30 15:21:26.189697 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:26.189641    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz" event={"ID":"5c9daf37-60d1-4a99-9db0-9d2510917ca8","Type":"ContainerStarted","Data":"8b983f61b64ad581aaf0ac85b64311f55bc6a8c4b0cd4a0f01d01df7013d424c"}
Jul 30 15:21:26.190184 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:26.189976    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:26.210042 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:26.209976    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz" podStartSLOduration=2.017887001 podStartE2EDuration="4.209951141s" totalImagesPullingTime="2.19206414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:21:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:21:26.209004027 +0000 UTC m=+684.814852162" watchObservedRunningTime="2026-07-30 15:21:26.209951141 +0000 UTC m=+684.815799247"
Jul 30 15:21:27.197428 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:27.197373    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx" event={"ID":"ea16af77-73d0-4d5c-8e33-db205867a5c5","Type":"ContainerStarted","Data":"bff03090c7655b8b93381f46c97db1963d9044ff85ec957cce9381cf2b64c4b3"}
Jul 30 15:21:27.197920 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:27.197587    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:27.199073 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:27.199042    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w" event={"ID":"e02b63dc-c288-4188-8152-0b6568fc477b","Type":"ContainerStarted","Data":"62bda27320e77d60a99171e49a3c94654d69c205c1a37c34fe632fa021036ced"}
Jul 30 15:21:27.199222 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:27.199190    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:27.216564 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:27.216500    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx" podStartSLOduration=1.8895406110000001 podStartE2EDuration="4.216484073s" totalImagesPullingTime="2.326943462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:21:27.214152897 +0000 UTC m=+685.820001025" watchObservedRunningTime="2026-07-30 15:21:27.216484073 +0000 UTC m=+685.822332176"
Jul 30 15:21:27.230712 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:27.230653    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w" podStartSLOduration=1.817330246 podStartE2EDuration="4.230634752s" totalImagesPullingTime="2.413304506s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:21:27.228943477 +0000 UTC m=+685.834791593" watchObservedRunningTime="2026-07-30 15:21:27.230634752 +0000 UTC m=+685.836482855"
Jul 30 15:21:32.205537 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:32.205507    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-794cfb675b-vfljz"
Jul 30 15:21:38.206650 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:38.206614    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-qdbwx"
Jul 30 15:21:38.207067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:38.206916    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-p255w"
Jul 30 15:21:49.536004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.535958    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"]
Jul 30 15:21:49.542691 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.542657    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.547693 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.547659    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 30 15:21:49.547917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.547710    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 30 15:21:49.547917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.547664    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 30 15:21:49.547917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.547798    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-tp2xj\""
Jul 30 15:21:49.560095 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.560066    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"]
Jul 30 15:21:49.616930 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.616889    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.617136 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.616959    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.617136 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.616988    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7gk5\" (UniqueName: \"kubernetes.io/projected/88654918-03de-414b-8eb1-c330983002cc-kube-api-access-x7gk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.617136 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.617083    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.617136 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.617110    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88654918-03de-414b-8eb1-c330983002cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.617275 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.617149    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718037    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718096    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88654918-03de-414b-8eb1-c330983002cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718139    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718188    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718248    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718274    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7gk5\" (UniqueName: \"kubernetes.io/projected/88654918-03de-414b-8eb1-c330983002cc-kube-api-access-x7gk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718677 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718651    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718681    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.718733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.718690    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.720647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.720618    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/88654918-03de-414b-8eb1-c330983002cc-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.721036 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.721014    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/88654918-03de-414b-8eb1-c330983002cc-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.731609 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.731577    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7gk5\" (UniqueName: \"kubernetes.io/projected/88654918-03de-414b-8eb1-c330983002cc-kube-api-access-x7gk5\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr\" (UID: \"88654918-03de-414b-8eb1-c330983002cc\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:49.856868 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:49.856757    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:50.013733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:50.013696    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"]
Jul 30 15:21:50.016787 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:21:50.016735    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88654918_03de_414b_8eb1_c330983002cc.slice/crio-e0320fd162490cbd75fb44d3150412413e0f0bf1cac0c17ac96f63b2e927cb83 WatchSource:0}: Error finding container e0320fd162490cbd75fb44d3150412413e0f0bf1cac0c17ac96f63b2e927cb83: Status 404 returned error can't find the container with id e0320fd162490cbd75fb44d3150412413e0f0bf1cac0c17ac96f63b2e927cb83
Jul 30 15:21:50.333067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:50.333024    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr" event={"ID":"88654918-03de-414b-8eb1-c330983002cc","Type":"ContainerStarted","Data":"e0320fd162490cbd75fb44d3150412413e0f0bf1cac0c17ac96f63b2e927cb83"}
Jul 30 15:21:51.341677 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:51.341641    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr" event={"ID":"88654918-03de-414b-8eb1-c330983002cc","Type":"ContainerStarted","Data":"ee44d6d518ce7df0b7dd953379893535e110d0813eb933d8d644eb1a8e8b87b5"}
Jul 30 15:21:51.362971 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:51.362913    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr" podStartSLOduration=1.187880381 podStartE2EDuration="2.362895294s" totalImagesPullingTime="1.175014913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:21:51.362771633 +0000 UTC m=+709.968619736" watchObservedRunningTime="2026-07-30 15:21:51.362895294 +0000 UTC m=+709.968743396"
Jul 30 15:21:59.857157 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:59.857116    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:59.857729 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:59.857211    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:21:59.870294 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:21:59.870262    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:22:00.405137 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:00.405099    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr"
Jul 30 15:22:06.339478 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.339443    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"]
Jul 30 15:22:06.345641 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.345611    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.348386 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.348364    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 30 15:22:06.354469 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.354412    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"]
Jul 30 15:22:06.482893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.482854    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.482893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.482898    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.483113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.482935    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhlrx\" (UniqueName: \"kubernetes.io/projected/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-kube-api-access-fhlrx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.483113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.482992    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.483113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.483028    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.483113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.483092    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.583654 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.583612    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.583883 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.583684    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.583883 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.583718    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.583883 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.583750    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.584069 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.583899    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.584069 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.583948    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhlrx\" (UniqueName: \"kubernetes.io/projected/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-kube-api-access-fhlrx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.584226 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.584197    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.584226 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.584210    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.584226 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.584224    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.586198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.586175    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.586476 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.586456    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.596111 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.596046    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhlrx\" (UniqueName: \"kubernetes.io/projected/a042b3c4-7ffe-4fe0-a288-bbbf070f3827-kube-api-access-fhlrx\") pod \"e2e-trlp-test-simulated-kserve-598466548d-72nrl\" (UID: \"a042b3c4-7ffe-4fe0-a288-bbbf070f3827\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.657161 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.657121    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:06.808645 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:06.808610    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"]
Jul 30 15:22:06.810390 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:22:06.810350    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda042b3c4_7ffe_4fe0_a288_bbbf070f3827.slice/crio-a09429f4328b0ba81e904e00df0fb9405b797ffc243eb5bced04fd38a81ce61d WatchSource:0}: Error finding container a09429f4328b0ba81e904e00df0fb9405b797ffc243eb5bced04fd38a81ce61d: Status 404 returned error can't find the container with id a09429f4328b0ba81e904e00df0fb9405b797ffc243eb5bced04fd38a81ce61d
Jul 30 15:22:07.438960 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:07.438923    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl" event={"ID":"a042b3c4-7ffe-4fe0-a288-bbbf070f3827","Type":"ContainerStarted","Data":"159fde81d64a9ca856a79c5fa7a254648d9ce7ac7bbf4e6cb1f84207e9ca90e7"}
Jul 30 15:22:07.439399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:07.438987    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl" event={"ID":"a042b3c4-7ffe-4fe0-a288-bbbf070f3827","Type":"ContainerStarted","Data":"a09429f4328b0ba81e904e00df0fb9405b797ffc243eb5bced04fd38a81ce61d"}
Jul 30 15:22:07.465162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:07.465092    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl" podStartSLOduration=1.24943472 podStartE2EDuration="1.465070407s" totalImagesPullingTime="215.635687ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:22:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:22:07.463953199 +0000 UTC m=+726.069801301" watchObservedRunningTime="2026-07-30 15:22:07.465070407 +0000 UTC m=+726.070918510"
Jul 30 15:22:16.657952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:16.657913    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:16.658413 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:16.657987    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:16.671864 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:16.671834    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:17.505630 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:17.505592    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-72nrl"
Jul 30 15:22:29.206267 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.206224    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"]
Jul 30 15:22:29.209875 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.209856    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.214646 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.214619    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 30 15:22:29.244312 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.244277    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"]
Jul 30 15:22:29.287715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.287676    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxff6\" (UniqueName: \"kubernetes.io/projected/06938ef9-a019-4f10-85db-0bed21a71e4f-kube-api-access-nxff6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.287952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.287731    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.287952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.287828    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06938ef9-a019-4f10-85db-0bed21a71e4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.287952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.287894    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.287952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.287929    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.288147 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.287964    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389350    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06938ef9-a019-4f10-85db-0bed21a71e4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389400    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389436    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389461    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389602    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxff6\" (UniqueName: \"kubernetes.io/projected/06938ef9-a019-4f10-85db-0bed21a71e4f-kube-api-access-nxff6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389865 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389705    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.389948 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389925    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.390007 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.389980    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.390264 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.390232    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.395458 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.392722    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/06938ef9-a019-4f10-85db-0bed21a71e4f-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.399897 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.399854    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/06938ef9-a019-4f10-85db-0bed21a71e4f-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.401649 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.401613    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxff6\" (UniqueName: \"kubernetes.io/projected/06938ef9-a019-4f10-85db-0bed21a71e4f-kube-api-access-nxff6\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-k4v2t\" (UID: \"06938ef9-a019-4f10-85db-0bed21a71e4f\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.521681 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.521571    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:29.686403 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:29.686374    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"]
Jul 30 15:22:29.688311 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:22:29.688287    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06938ef9_a019_4f10_85db_0bed21a71e4f.slice/crio-590e71a9469958a959735fa0ca47dfd4cb089eff3e75a56a247194fb58a655de WatchSource:0}: Error finding container 590e71a9469958a959735fa0ca47dfd4cb089eff3e75a56a247194fb58a655de: Status 404 returned error can't find the container with id 590e71a9469958a959735fa0ca47dfd4cb089eff3e75a56a247194fb58a655de
Jul 30 15:22:30.568986 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:30.568951    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t" event={"ID":"06938ef9-a019-4f10-85db-0bed21a71e4f","Type":"ContainerStarted","Data":"dc452094287fb767253639f050d8f48cac442806d994a3dff52004274a7d96bb"}
Jul 30 15:22:30.569465 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:30.569007    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t" event={"ID":"06938ef9-a019-4f10-85db-0bed21a71e4f","Type":"ContainerStarted","Data":"590e71a9469958a959735fa0ca47dfd4cb089eff3e75a56a247194fb58a655de"}
Jul 30 15:22:30.588900 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:30.588843    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t" podStartSLOduration=1.293142057 podStartE2EDuration="1.588824512s" totalImagesPullingTime="295.682455ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:22:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:22:30.586685828 +0000 UTC m=+749.192533930" watchObservedRunningTime="2026-07-30 15:22:30.588824512 +0000 UTC m=+749.194672613"
Jul 30 15:22:39.522327 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:39.522269    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:39.522918 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:39.522356    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:39.535124 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:39.535092    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:39.635670 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:39.635636    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-k4v2t"
Jul 30 15:22:41.816924 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.816875    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"]
Jul 30 15:22:41.821086 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.821053    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:41.824182 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.824152    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 30 15:22:41.833227 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.833193    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"]
Jul 30 15:22:41.914988 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.914944    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:41.915213 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.915018    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:41.915213 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.915078    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:41.915213 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.915119    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:41.915213 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.915147    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qkxt\" (UniqueName: \"kubernetes.io/projected/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-kube-api-access-6qkxt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:41.915402 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:41.915221    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.015943 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.015905    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016143 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.015999    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016143 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016039    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016143 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016067    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016143 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016097    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qkxt\" (UniqueName: \"kubernetes.io/projected/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-kube-api-access-6qkxt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016368 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016156    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016516 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016488    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016590 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016568    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.016909 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.016887    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.019186 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.019163    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.019645 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.019618    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.025968 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.025935    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qkxt\" (UniqueName: \"kubernetes.io/projected/ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d-kube-api-access-6qkxt\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-h5x54\" (UID: \"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.131674 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.131576    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:42.299605 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.299567    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"]
Jul 30 15:22:42.306540 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:22:42.306511    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce6bce8b_d32c_4c1c_8fd3_bce65ac4393d.slice/crio-705441f696c85970a20063424f12cfa9d8641a0997fe006cda71ddc480e9af04 WatchSource:0}: Error finding container 705441f696c85970a20063424f12cfa9d8641a0997fe006cda71ddc480e9af04: Status 404 returned error can't find the container with id 705441f696c85970a20063424f12cfa9d8641a0997fe006cda71ddc480e9af04
Jul 30 15:22:42.642926 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.642889    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54" event={"ID":"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d","Type":"ContainerStarted","Data":"48dbdd795bf45dd8c749871b7494bcfdc447cb78f424d6bc12e3b9575496bbc9"}
Jul 30 15:22:42.643108 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.642938    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54" event={"ID":"ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d","Type":"ContainerStarted","Data":"705441f696c85970a20063424f12cfa9d8641a0997fe006cda71ddc480e9af04"}
Jul 30 15:22:42.664300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:42.664243    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54" podStartSLOduration=1.419165285 podStartE2EDuration="1.664225262s" totalImagesPullingTime="245.059977ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:22:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:22:42.663745445 +0000 UTC m=+761.269593562" watchObservedRunningTime="2026-07-30 15:22:42.664225262 +0000 UTC m=+761.270073405"
Jul 30 15:22:52.132651 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:52.132602    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:52.133104 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:52.132695    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:52.146126 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:52.146093    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:22:52.714937 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:22:52.714897    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-h5x54"
Jul 30 15:23:52.465443 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.465339    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5797fbc4d5-h6284"]
Jul 30 15:23:52.469187 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.469152    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.481509 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.481467    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5797fbc4d5-h6284"]
Jul 30 15:23:52.599157 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.599114    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1c7754a-3519-494f-b9ae-4b1d07d1c3f6-tls-cert\") pod \"authorino-5797fbc4d5-h6284\" (UID: \"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6\") " pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.599360 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.599188    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9527l\" (UniqueName: \"kubernetes.io/projected/d1c7754a-3519-494f-b9ae-4b1d07d1c3f6-kube-api-access-9527l\") pod \"authorino-5797fbc4d5-h6284\" (UID: \"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6\") " pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.700630 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.700588    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9527l\" (UniqueName: \"kubernetes.io/projected/d1c7754a-3519-494f-b9ae-4b1d07d1c3f6-kube-api-access-9527l\") pod \"authorino-5797fbc4d5-h6284\" (UID: \"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6\") " pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.700812 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.700688    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1c7754a-3519-494f-b9ae-4b1d07d1c3f6-tls-cert\") pod \"authorino-5797fbc4d5-h6284\" (UID: \"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6\") " pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.703335 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.703303    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/d1c7754a-3519-494f-b9ae-4b1d07d1c3f6-tls-cert\") pod \"authorino-5797fbc4d5-h6284\" (UID: \"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6\") " pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.709932 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.709893    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9527l\" (UniqueName: \"kubernetes.io/projected/d1c7754a-3519-494f-b9ae-4b1d07d1c3f6-kube-api-access-9527l\") pod \"authorino-5797fbc4d5-h6284\" (UID: \"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6\") " pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.780586 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.780468    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5797fbc4d5-h6284"
Jul 30 15:23:52.941040 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:52.941009    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5797fbc4d5-h6284"]
Jul 30 15:23:52.944785 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:23:52.944749    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd1c7754a_3519_494f_b9ae_4b1d07d1c3f6.slice/crio-cc9e7f4688afa6be3e1c3cd0648d291cb28512b38d7060d5b1b0e4e1934c249f WatchSource:0}: Error finding container cc9e7f4688afa6be3e1c3cd0648d291cb28512b38d7060d5b1b0e4e1934c249f: Status 404 returned error can't find the container with id cc9e7f4688afa6be3e1c3cd0648d291cb28512b38d7060d5b1b0e4e1934c249f
Jul 30 15:23:53.055669 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:53.055571    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5797fbc4d5-h6284" event={"ID":"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6","Type":"ContainerStarted","Data":"cc9e7f4688afa6be3e1c3cd0648d291cb28512b38d7060d5b1b0e4e1934c249f"}
Jul 30 15:23:54.066380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.066335    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5797fbc4d5-h6284" event={"ID":"d1c7754a-3519-494f-b9ae-4b1d07d1c3f6","Type":"ContainerStarted","Data":"3f338ed89dfd180d7d9825dfd4c0451396205fa9f273c8b8af9dcbf1f4e00838"}
Jul 30 15:23:54.088458 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.088367    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5797fbc4d5-h6284" podStartSLOduration=1.6459117650000001 podStartE2EDuration="2.088340503s" totalImagesPullingTime="442.428738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:23:54.086265135 +0000 UTC m=+832.692113238" watchObservedRunningTime="2026-07-30 15:23:54.088340503 +0000 UTC m=+832.694188607"
Jul 30 15:23:54.125657 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.125616    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674f946d56-8tmdt"]
Jul 30 15:23:54.126135 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.126091    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-674f946d56-8tmdt" podUID="43999d69-dccd-428e-9941-1e9809faeabe" containerName="authorino" containerID="cri-o://7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72" gracePeriod=30
Jul 30 15:23:54.408972 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.408933    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:23:54.518290 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.518254    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43999d69-dccd-428e-9941-1e9809faeabe-tls-cert\") pod \"43999d69-dccd-428e-9941-1e9809faeabe\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") "
Jul 30 15:23:54.518514 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.518320    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kf8vp\" (UniqueName: \"kubernetes.io/projected/43999d69-dccd-428e-9941-1e9809faeabe-kube-api-access-kf8vp\") pod \"43999d69-dccd-428e-9941-1e9809faeabe\" (UID: \"43999d69-dccd-428e-9941-1e9809faeabe\") "
Jul 30 15:23:54.520579 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.520539    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43999d69-dccd-428e-9941-1e9809faeabe-kube-api-access-kf8vp" (OuterVolumeSpecName: "kube-api-access-kf8vp") pod "43999d69-dccd-428e-9941-1e9809faeabe" (UID: "43999d69-dccd-428e-9941-1e9809faeabe"). InnerVolumeSpecName "kube-api-access-kf8vp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:23:54.531314 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.531279    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/43999d69-dccd-428e-9941-1e9809faeabe-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "43999d69-dccd-428e-9941-1e9809faeabe" (UID: "43999d69-dccd-428e-9941-1e9809faeabe"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:23:54.619526 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.619486    2553 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/43999d69-dccd-428e-9941-1e9809faeabe-tls-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:23:54.619526 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:54.619526    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kf8vp\" (UniqueName: \"kubernetes.io/projected/43999d69-dccd-428e-9941-1e9809faeabe-kube-api-access-kf8vp\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:23:55.073520 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.073409    2553 generic.go:356] "Generic (PLEG): container finished" podID="43999d69-dccd-428e-9941-1e9809faeabe" containerID="7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72" exitCode=0
Jul 30 15:23:55.073520 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.073450    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674f946d56-8tmdt" event={"ID":"43999d69-dccd-428e-9941-1e9809faeabe","Type":"ContainerDied","Data":"7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72"}
Jul 30 15:23:55.073520 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.073492    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-674f946d56-8tmdt"
Jul 30 15:23:55.073520 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.073510    2553 scope.go:117] "RemoveContainer" containerID="7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72"
Jul 30 15:23:55.074087 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.073499    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-674f946d56-8tmdt" event={"ID":"43999d69-dccd-428e-9941-1e9809faeabe","Type":"ContainerDied","Data":"248885baef664b0f14e6a4c9b8d5c6075478ec044482e6909d8254c2a63d88b6"}
Jul 30 15:23:55.083610 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.083589    2553 scope.go:117] "RemoveContainer" containerID="7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72"
Jul 30 15:23:55.084044 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:23:55.084011    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72\": container with ID starting with 7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72 not found: ID does not exist" containerID="7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72"
Jul 30 15:23:55.084195 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.084063    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72"} err="failed to get container status \"7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72\": rpc error: code = NotFound desc = could not find container \"7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72\": container with ID starting with 7211278ac50154a4dbf420babc813f6493809dc7cc5c2dd9c445baaf3d84cc72 not found: ID does not exist"
Jul 30 15:23:55.099988 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.099937    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-674f946d56-8tmdt"]
Jul 30 15:23:55.102749 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.102715    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-674f946d56-8tmdt"]
Jul 30 15:23:55.925409 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:23:55.925377    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43999d69-dccd-428e-9941-1e9809faeabe" path="/var/lib/kubelet/pods/43999d69-dccd-428e-9941-1e9809faeabe/volumes"
Jul 30 15:24:40.996008 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:40.995968    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-g98vn"]
Jul 30 15:24:40.996634 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:40.996215    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-64966fd4f8-g98vn" podUID="0ac114bb-d65c-4adb-9116-8595dcd8ce99" containerName="manager" containerID="cri-o://32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea" gracePeriod=30
Jul 30 15:24:41.260805 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.260728    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:24:41.341802 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.341765    2553 generic.go:356] "Generic (PLEG): container finished" podID="0ac114bb-d65c-4adb-9116-8595dcd8ce99" containerID="32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea" exitCode=0
Jul 30 15:24:41.342010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.341810    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-g98vn"
Jul 30 15:24:41.342010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.341842    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-g98vn" event={"ID":"0ac114bb-d65c-4adb-9116-8595dcd8ce99","Type":"ContainerDied","Data":"32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea"}
Jul 30 15:24:41.342010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.341898    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-g98vn" event={"ID":"0ac114bb-d65c-4adb-9116-8595dcd8ce99","Type":"ContainerDied","Data":"4568870c0a76c3b6e3c2c01470dab96241798de41a97d6c4b35e75b4f0200b93"}
Jul 30 15:24:41.342010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.341923    2553 scope.go:117] "RemoveContainer" containerID="32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea"
Jul 30 15:24:41.351542 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.351522    2553 scope.go:117] "RemoveContainer" containerID="32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea"
Jul 30 15:24:41.351896 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:24:41.351877    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea\": container with ID starting with 32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea not found: ID does not exist" containerID="32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea"
Jul 30 15:24:41.351950 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.351908    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea"} err="failed to get container status \"32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea\": rpc error: code = NotFound desc = could not find container \"32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea\": container with ID starting with 32e03bce91c39951309f67cf32affd74d9a6454d2b8217015b96e3f979cf21ea not found: ID does not exist"
Jul 30 15:24:41.369278 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.369240    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vbhrw\" (UniqueName: \"kubernetes.io/projected/0ac114bb-d65c-4adb-9116-8595dcd8ce99-kube-api-access-vbhrw\") pod \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") "
Jul 30 15:24:41.369451 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.369354    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ac114bb-d65c-4adb-9116-8595dcd8ce99-webhook-cert\") pod \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\" (UID: \"0ac114bb-d65c-4adb-9116-8595dcd8ce99\") "
Jul 30 15:24:41.371446 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.371387    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0ac114bb-d65c-4adb-9116-8595dcd8ce99-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0ac114bb-d65c-4adb-9116-8595dcd8ce99" (UID: "0ac114bb-d65c-4adb-9116-8595dcd8ce99"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:24:41.371446 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.371392    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0ac114bb-d65c-4adb-9116-8595dcd8ce99-kube-api-access-vbhrw" (OuterVolumeSpecName: "kube-api-access-vbhrw") pod "0ac114bb-d65c-4adb-9116-8595dcd8ce99" (UID: "0ac114bb-d65c-4adb-9116-8595dcd8ce99"). InnerVolumeSpecName "kube-api-access-vbhrw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:24:41.470533 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.470495    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ac114bb-d65c-4adb-9116-8595dcd8ce99-webhook-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:24:41.470533 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.470530    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vbhrw\" (UniqueName: \"kubernetes.io/projected/0ac114bb-d65c-4adb-9116-8595dcd8ce99-kube-api-access-vbhrw\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:24:41.664724 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.664687    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-g98vn"]
Jul 30 15:24:41.670563 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.670530    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-g98vn"]
Jul 30 15:24:41.925715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:24:41.925682    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0ac114bb-d65c-4adb-9116-8595dcd8ce99" path="/var/lib/kubelet/pods/0ac114bb-d65c-4adb-9116-8595dcd8ce99/volumes"
Jul 30 15:25:01.823404 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:01.823369    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:25:01.824013 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:01.823966    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:25:42.520587 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.520543    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64966fd4f8-phq2g"]
Jul 30 15:25:42.521082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.520970    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0ac114bb-d65c-4adb-9116-8595dcd8ce99" containerName="manager"
Jul 30 15:25:42.521082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.520984    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0ac114bb-d65c-4adb-9116-8595dcd8ce99" containerName="manager"
Jul 30 15:25:42.521082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.521014    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43999d69-dccd-428e-9941-1e9809faeabe" containerName="authorino"
Jul 30 15:25:42.521082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.521020    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="43999d69-dccd-428e-9941-1e9809faeabe" containerName="authorino"
Jul 30 15:25:42.521234 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.521094    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0ac114bb-d65c-4adb-9116-8595dcd8ce99" containerName="manager"
Jul 30 15:25:42.521234 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.521106    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="43999d69-dccd-428e-9941-1e9809faeabe" containerName="authorino"
Jul 30 15:25:42.524082 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.524063    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.527913 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.527878    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 15:25:42.528113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.527889    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 15:25:42.528113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.527889    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wv2zx\""
Jul 30 15:25:42.534214 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.534182    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-phq2g"]
Jul 30 15:25:42.657162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.657123    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505a6aba-39e3-46b7-b37e-aa3a8fa92609-webhook-cert\") pod \"maas-controller-64966fd4f8-phq2g\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") " pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.657162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.657171    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsv55\" (UniqueName: \"kubernetes.io/projected/505a6aba-39e3-46b7-b37e-aa3a8fa92609-kube-api-access-bsv55\") pod \"maas-controller-64966fd4f8-phq2g\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") " pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.757867 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.757767    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505a6aba-39e3-46b7-b37e-aa3a8fa92609-webhook-cert\") pod \"maas-controller-64966fd4f8-phq2g\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") " pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.757867 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.757811    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsv55\" (UniqueName: \"kubernetes.io/projected/505a6aba-39e3-46b7-b37e-aa3a8fa92609-kube-api-access-bsv55\") pod \"maas-controller-64966fd4f8-phq2g\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") " pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.760507 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.760475    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505a6aba-39e3-46b7-b37e-aa3a8fa92609-webhook-cert\") pod \"maas-controller-64966fd4f8-phq2g\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") " pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.766031 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.766001    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsv55\" (UniqueName: \"kubernetes.io/projected/505a6aba-39e3-46b7-b37e-aa3a8fa92609-kube-api-access-bsv55\") pod \"maas-controller-64966fd4f8-phq2g\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") " pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.836343 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.836299    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:42.982556 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:42.982512    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-phq2g"]
Jul 30 15:25:42.985931 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:25:42.985896    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod505a6aba_39e3_46b7_b37e_aa3a8fa92609.slice/crio-298e640e83c12d20f956d9ffe638b9356b7ea9fd01239d4086e89f79a95db156 WatchSource:0}: Error finding container 298e640e83c12d20f956d9ffe638b9356b7ea9fd01239d4086e89f79a95db156: Status 404 returned error can't find the container with id 298e640e83c12d20f956d9ffe638b9356b7ea9fd01239d4086e89f79a95db156
Jul 30 15:25:43.712268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:43.712229    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-phq2g" event={"ID":"505a6aba-39e3-46b7-b37e-aa3a8fa92609","Type":"ContainerStarted","Data":"4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489"}
Jul 30 15:25:43.712782 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:43.712294    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-phq2g" event={"ID":"505a6aba-39e3-46b7-b37e-aa3a8fa92609","Type":"ContainerStarted","Data":"298e640e83c12d20f956d9ffe638b9356b7ea9fd01239d4086e89f79a95db156"}
Jul 30 15:25:43.712782 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:43.712448    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:43.731898 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:43.731840    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64966fd4f8-phq2g" podStartSLOduration=1.336759831 podStartE2EDuration="1.731811989s" totalImagesPullingTime="395.052158ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:25:43.730137921 +0000 UTC m=+942.335986058" watchObservedRunningTime="2026-07-30 15:25:43.731811989 +0000 UTC m=+942.337660092"
Jul 30 15:25:54.720837 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:54.720805    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:59.399432 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.399366    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-phq2g"]
Jul 30 15:25:59.399962 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.399661    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-64966fd4f8-phq2g" podUID="505a6aba-39e3-46b7-b37e-aa3a8fa92609" containerName="manager" containerID="cri-o://4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489" gracePeriod=30
Jul 30 15:25:59.754920 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.754885    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:59.809106 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.809061    2553 generic.go:356] "Generic (PLEG): container finished" podID="505a6aba-39e3-46b7-b37e-aa3a8fa92609" containerID="4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489" exitCode=0
Jul 30 15:25:59.809106 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.809111    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-phq2g"
Jul 30 15:25:59.809384 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.809137    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-phq2g" event={"ID":"505a6aba-39e3-46b7-b37e-aa3a8fa92609","Type":"ContainerDied","Data":"4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489"}
Jul 30 15:25:59.809384 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.809211    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-phq2g" event={"ID":"505a6aba-39e3-46b7-b37e-aa3a8fa92609","Type":"ContainerDied","Data":"298e640e83c12d20f956d9ffe638b9356b7ea9fd01239d4086e89f79a95db156"}
Jul 30 15:25:59.809384 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.809245    2553 scope.go:117] "RemoveContainer" containerID="4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489"
Jul 30 15:25:59.818709 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.818688    2553 scope.go:117] "RemoveContainer" containerID="4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489"
Jul 30 15:25:59.819057 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:25:59.819035    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489\": container with ID starting with 4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489 not found: ID does not exist" containerID="4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489"
Jul 30 15:25:59.819120 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.819070    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489"} err="failed to get container status \"4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489\": rpc error: code = NotFound desc = could not find container \"4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489\": container with ID starting with 4259072145a44c4babbb97557590791687dbf809a46a0a44d59d2b7bdc201489 not found: ID does not exist"
Jul 30 15:25:59.828482 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.828455    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsv55\" (UniqueName: \"kubernetes.io/projected/505a6aba-39e3-46b7-b37e-aa3a8fa92609-kube-api-access-bsv55\") pod \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") "
Jul 30 15:25:59.828600 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.828500    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505a6aba-39e3-46b7-b37e-aa3a8fa92609-webhook-cert\") pod \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\" (UID: \"505a6aba-39e3-46b7-b37e-aa3a8fa92609\") "
Jul 30 15:25:59.830652 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.830613    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/505a6aba-39e3-46b7-b37e-aa3a8fa92609-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "505a6aba-39e3-46b7-b37e-aa3a8fa92609" (UID: "505a6aba-39e3-46b7-b37e-aa3a8fa92609"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:25:59.830652 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.830634    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/505a6aba-39e3-46b7-b37e-aa3a8fa92609-kube-api-access-bsv55" (OuterVolumeSpecName: "kube-api-access-bsv55") pod "505a6aba-39e3-46b7-b37e-aa3a8fa92609" (UID: "505a6aba-39e3-46b7-b37e-aa3a8fa92609"). InnerVolumeSpecName "kube-api-access-bsv55". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:25:59.929841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.929753    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsv55\" (UniqueName: \"kubernetes.io/projected/505a6aba-39e3-46b7-b37e-aa3a8fa92609-kube-api-access-bsv55\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:25:59.929841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:25:59.929781    2553 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/505a6aba-39e3-46b7-b37e-aa3a8fa92609-webhook-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:26:00.127710 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.127675    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-phq2g"]
Jul 30 15:26:00.131552 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.131514    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-phq2g"]
Jul 30 15:26:00.947385 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.947348    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-64966fd4f8-ct9p8"]
Jul 30 15:26:00.947841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.947783    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="505a6aba-39e3-46b7-b37e-aa3a8fa92609" containerName="manager"
Jul 30 15:26:00.947841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.947795    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="505a6aba-39e3-46b7-b37e-aa3a8fa92609" containerName="manager"
Jul 30 15:26:00.947971 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.947874    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="505a6aba-39e3-46b7-b37e-aa3a8fa92609" containerName="manager"
Jul 30 15:26:00.952486 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.952465    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:00.956181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.956156    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-wv2zx\""
Jul 30 15:26:00.956342 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.956156    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 30 15:26:00.956342 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.956195    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 15:26:00.960852 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:00.960825    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-ct9p8"]
Jul 30 15:26:01.041309 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.041261    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d8aac14-71eb-49ee-a3bc-78661c6e1155-webhook-cert\") pod \"maas-controller-64966fd4f8-ct9p8\" (UID: \"0d8aac14-71eb-49ee-a3bc-78661c6e1155\") " pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.041309 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.041312    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8dqx\" (UniqueName: \"kubernetes.io/projected/0d8aac14-71eb-49ee-a3bc-78661c6e1155-kube-api-access-j8dqx\") pod \"maas-controller-64966fd4f8-ct9p8\" (UID: \"0d8aac14-71eb-49ee-a3bc-78661c6e1155\") " pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.142619 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.142574    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d8aac14-71eb-49ee-a3bc-78661c6e1155-webhook-cert\") pod \"maas-controller-64966fd4f8-ct9p8\" (UID: \"0d8aac14-71eb-49ee-a3bc-78661c6e1155\") " pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.142619 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.142624    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8dqx\" (UniqueName: \"kubernetes.io/projected/0d8aac14-71eb-49ee-a3bc-78661c6e1155-kube-api-access-j8dqx\") pod \"maas-controller-64966fd4f8-ct9p8\" (UID: \"0d8aac14-71eb-49ee-a3bc-78661c6e1155\") " pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.145210 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.145189    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d8aac14-71eb-49ee-a3bc-78661c6e1155-webhook-cert\") pod \"maas-controller-64966fd4f8-ct9p8\" (UID: \"0d8aac14-71eb-49ee-a3bc-78661c6e1155\") " pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.151913 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.151883    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8dqx\" (UniqueName: \"kubernetes.io/projected/0d8aac14-71eb-49ee-a3bc-78661c6e1155-kube-api-access-j8dqx\") pod \"maas-controller-64966fd4f8-ct9p8\" (UID: \"0d8aac14-71eb-49ee-a3bc-78661c6e1155\") " pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.264443 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.264312    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:01.411740 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.411704    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-64966fd4f8-ct9p8"]
Jul 30 15:26:01.413651 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:26:01.413624    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d8aac14_71eb_49ee_a3bc_78661c6e1155.slice/crio-d90fefb493ba024297e51f648ddcc529a44c12a115ca69993df85d7f381ddf00 WatchSource:0}: Error finding container d90fefb493ba024297e51f648ddcc529a44c12a115ca69993df85d7f381ddf00: Status 404 returned error can't find the container with id d90fefb493ba024297e51f648ddcc529a44c12a115ca69993df85d7f381ddf00
Jul 30 15:26:01.415482 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.415462    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:26:01.822762 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.822719    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-ct9p8" event={"ID":"0d8aac14-71eb-49ee-a3bc-78661c6e1155","Type":"ContainerStarted","Data":"d90fefb493ba024297e51f648ddcc529a44c12a115ca69993df85d7f381ddf00"}
Jul 30 15:26:01.909604 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.909358    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 30 15:26:01.925572 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:01.925541    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="505a6aba-39e3-46b7-b37e-aa3a8fa92609" path="/var/lib/kubelet/pods/505a6aba-39e3-46b7-b37e-aa3a8fa92609/volumes"
Jul 30 15:26:02.830521 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:02.830473    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-64966fd4f8-ct9p8" event={"ID":"0d8aac14-71eb-49ee-a3bc-78661c6e1155","Type":"ContainerStarted","Data":"dabcda74bdda325e6d168c32cd401fc2132371390dacc68c14cebbcaef037532"}
Jul 30 15:26:02.830940 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:02.830679    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:26:02.849818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:02.849758    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-64966fd4f8-ct9p8" podStartSLOduration=2.358907206 podStartE2EDuration="2.849741698s" totalImagesPullingTime="490.834492ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:26:02.846950204 +0000 UTC m=+961.452798307" watchObservedRunningTime="2026-07-30 15:26:02.849741698 +0000 UTC m=+961.455589800"
Jul 30 15:26:13.840101 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:26:13.840063    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-64966fd4f8-ct9p8"
Jul 30 15:30:00.152450 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:00.152398    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"]
Jul 30 15:30:00.155656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:00.155635    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"
Jul 30 15:30:00.158600 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:00.158572    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:30:00.166216 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:00.166193    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"
Jul 30 15:30:00.172508 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:00.172476    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"]
Jul 30 15:30:00.318404 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:00.318369    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"]
Jul 30 15:30:00.320137 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:30:00.320109    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b5539a6_faf7_4ba1_920c_50749334b65d.slice/crio-8e978cf0b0a9d6b5bd7b1cee4b8e749ecc4d7e23b91cfa072733b08d1cee4b07 WatchSource:0}: Error finding container 8e978cf0b0a9d6b5bd7b1cee4b8e749ecc4d7e23b91cfa072733b08d1cee4b07: Status 404 returned error can't find the container with id 8e978cf0b0a9d6b5bd7b1cee4b8e749ecc4d7e23b91cfa072733b08d1cee4b07
Jul 30 15:30:01.219871 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:01.219824    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh" event={"ID":"8b5539a6-faf7-4ba1-920c-50749334b65d","Type":"ContainerStarted","Data":"8e978cf0b0a9d6b5bd7b1cee4b8e749ecc4d7e23b91cfa072733b08d1cee4b07"}
Jul 30 15:30:01.867457 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:01.867402    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:30:01.869591 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:01.869563    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:30:03.234034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:03.233986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh" event={"ID":"8b5539a6-faf7-4ba1-920c-50749334b65d","Type":"ContainerStarted","Data":"467936fd20052d49407ac3b7571f374784bee592322d3ce0bfd5abd1b95098c6"}
Jul 30 15:30:03.251461 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:03.251328    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh" podStartSLOduration=0.914236576 podStartE2EDuration="3.25130799s" totalImagesPullingTime="2.337071414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:30:03.249195848 +0000 UTC m=+1201.855043956" watchObservedRunningTime="2026-07-30 15:30:03.25130799 +0000 UTC m=+1201.857156093"
Jul 30 15:30:04.240865 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:04.240831    2553 generic.go:356] "Generic (PLEG): container finished" podID="8b5539a6-faf7-4ba1-920c-50749334b65d" containerID="467936fd20052d49407ac3b7571f374784bee592322d3ce0bfd5abd1b95098c6" exitCode=0
Jul 30 15:30:04.241291 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:04.240921    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh" event={"ID":"8b5539a6-faf7-4ba1-920c-50749334b65d","Type":"ContainerDied","Data":"467936fd20052d49407ac3b7571f374784bee592322d3ce0bfd5abd1b95098c6"}
Jul 30 15:30:05.395067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:05.395041    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"
Jul 30 15:30:06.253742 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:06.253638    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh" event={"ID":"8b5539a6-faf7-4ba1-920c-50749334b65d","Type":"ContainerDied","Data":"8e978cf0b0a9d6b5bd7b1cee4b8e749ecc4d7e23b91cfa072733b08d1cee4b07"}
Jul 30 15:30:06.253742 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:06.253697    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8e978cf0b0a9d6b5bd7b1cee4b8e749ecc4d7e23b91cfa072733b08d1cee4b07"
Jul 30 15:30:06.253742 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:30:06.253654    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"
Jul 30 15:33:32.662496 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:32.662458    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"]
Jul 30 15:33:32.664925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:32.662671    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn" podUID="e5812725-edaf-4a44-9ae6-83ac784294bb" containerName="manager" containerID="cri-o://105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a" gracePeriod=10
Jul 30 15:33:32.927160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:32.927131    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:33:33.051630 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.051588    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5812725-edaf-4a44-9ae6-83ac784294bb-extensions-socket-volume\") pod \"e5812725-edaf-4a44-9ae6-83ac784294bb\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") "
Jul 30 15:33:33.051835 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.051648    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zbcwq\" (UniqueName: \"kubernetes.io/projected/e5812725-edaf-4a44-9ae6-83ac784294bb-kube-api-access-zbcwq\") pod \"e5812725-edaf-4a44-9ae6-83ac784294bb\" (UID: \"e5812725-edaf-4a44-9ae6-83ac784294bb\") "
Jul 30 15:33:33.052084 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.052056    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e5812725-edaf-4a44-9ae6-83ac784294bb-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e5812725-edaf-4a44-9ae6-83ac784294bb" (UID: "e5812725-edaf-4a44-9ae6-83ac784294bb"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:33:33.053874 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.053853    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5812725-edaf-4a44-9ae6-83ac784294bb-kube-api-access-zbcwq" (OuterVolumeSpecName: "kube-api-access-zbcwq") pod "e5812725-edaf-4a44-9ae6-83ac784294bb" (UID: "e5812725-edaf-4a44-9ae6-83ac784294bb"). InnerVolumeSpecName "kube-api-access-zbcwq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:33:33.152623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.152581    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e5812725-edaf-4a44-9ae6-83ac784294bb-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:33:33.152623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.152614    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zbcwq\" (UniqueName: \"kubernetes.io/projected/e5812725-edaf-4a44-9ae6-83ac784294bb-kube-api-access-zbcwq\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:33:33.481060 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.481025    2553 generic.go:356] "Generic (PLEG): container finished" podID="e5812725-edaf-4a44-9ae6-83ac784294bb" containerID="105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a" exitCode=0
Jul 30 15:33:33.481283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.481074    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"
Jul 30 15:33:33.481283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.481105    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn" event={"ID":"e5812725-edaf-4a44-9ae6-83ac784294bb","Type":"ContainerDied","Data":"105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a"}
Jul 30 15:33:33.481283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.481162    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn" event={"ID":"e5812725-edaf-4a44-9ae6-83ac784294bb","Type":"ContainerDied","Data":"bea5d520bf5d7604ac16dce2b32ca4656f09d32562b29b14f8507f5dff6f0891"}
Jul 30 15:33:33.481283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.481189    2553 scope.go:117] "RemoveContainer" containerID="105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a"
Jul 30 15:33:33.499789 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.499768    2553 scope.go:117] "RemoveContainer" containerID="105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a"
Jul 30 15:33:33.500105 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:33:33.500082    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a\": container with ID starting with 105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a not found: ID does not exist" containerID="105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a"
Jul 30 15:33:33.500160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.500115    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a"} err="failed to get container status \"105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a\": rpc error: code = NotFound desc = could not find container \"105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a\": container with ID starting with 105eb104eea7a67e771e6f730b272b4a2bb282837620c82a1d535409fba7659a not found: ID does not exist"
Jul 30 15:33:33.514616 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.514548    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"]
Jul 30 15:33:33.517695 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.517664    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vdcjn"]
Jul 30 15:33:33.924880 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:33:33.924846    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5812725-edaf-4a44-9ae6-83ac784294bb" path="/var/lib/kubelet/pods/e5812725-edaf-4a44-9ae6-83ac784294bb/volumes"
Jul 30 15:34:33.420556 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.420496    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"]
Jul 30 15:34:33.421232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.421129    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b5539a6-faf7-4ba1-920c-50749334b65d" containerName="cleanup"
Jul 30 15:34:33.421232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.421152    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b5539a6-faf7-4ba1-920c-50749334b65d" containerName="cleanup"
Jul 30 15:34:33.421232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.421205    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5812725-edaf-4a44-9ae6-83ac784294bb" containerName="manager"
Jul 30 15:34:33.421232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.421213    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5812725-edaf-4a44-9ae6-83ac784294bb" containerName="manager"
Jul 30 15:34:33.421498 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.421309    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5812725-edaf-4a44-9ae6-83ac784294bb" containerName="manager"
Jul 30 15:34:33.421498 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.421325    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b5539a6-faf7-4ba1-920c-50749334b65d" containerName="cleanup"
Jul 30 15:34:33.424680 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.424653    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.427819 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.427794    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ctjh9\""
Jul 30 15:34:33.433118 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.433096    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pxxmm\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.433225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.433131    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz8vx\" (UniqueName: \"kubernetes.io/projected/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-kube-api-access-vz8vx\") pod \"kuadrant-operator-controller-manager-86878c769f-pxxmm\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.437548 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.437520    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"]
Jul 30 15:34:33.533997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.533957    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pxxmm\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.533997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.534005    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz8vx\" (UniqueName: \"kubernetes.io/projected/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-kube-api-access-vz8vx\") pod \"kuadrant-operator-controller-manager-86878c769f-pxxmm\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.534460 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.534441    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pxxmm\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.545090 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.545064    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz8vx\" (UniqueName: \"kubernetes.io/projected/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-kube-api-access-vz8vx\") pod \"kuadrant-operator-controller-manager-86878c769f-pxxmm\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.735850 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.735716    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:33.896842 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:33.896802    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"]
Jul 30 15:34:33.898612 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:34:33.898567    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0631976_1912_4cbe_bbc7_ad7100a7ddf9.slice/crio-661bed61210760bdfdb800ddfc778c84b93314d7376485e71ad61048d274f636 WatchSource:0}: Error finding container 661bed61210760bdfdb800ddfc778c84b93314d7376485e71ad61048d274f636: Status 404 returned error can't find the container with id 661bed61210760bdfdb800ddfc778c84b93314d7376485e71ad61048d274f636
Jul 30 15:34:34.835017 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:34.834970    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm" event={"ID":"c0631976-1912-4cbe-bbc7-ad7100a7ddf9","Type":"ContainerStarted","Data":"e6cd95cb5e5c74cae14ff6d14490c46e1b26421e7077eaff0578d1e1a88868d8"}
Jul 30 15:34:34.835486 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:34.835159    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:34:34.835486 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:34.835228    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm" event={"ID":"c0631976-1912-4cbe-bbc7-ad7100a7ddf9","Type":"ContainerStarted","Data":"661bed61210760bdfdb800ddfc778c84b93314d7376485e71ad61048d274f636"}
Jul 30 15:34:34.858748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:34.858690    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm" podStartSLOduration=1.8586733560000002 podStartE2EDuration="1.858673356s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:34:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:34:34.85625573 +0000 UTC m=+1473.462103831" watchObservedRunningTime="2026-07-30 15:34:34.858673356 +0000 UTC m=+1473.464521543"
Jul 30 15:34:45.845012 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:34:45.844970    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:35:01.916777 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:35:01.916743    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:35:01.920674 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:35:01.920641    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:40:01.953623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:40:01.953589    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:40:01.959194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:40:01.959171    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:43:34.989194 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:34.989162    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"]
Jul 30 15:43:34.992705 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:34.992685    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:34.995941 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:34.995923    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-791f7d53-serving-cert\""
Jul 30 15:43:35.009217 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.009198    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"]
Jul 30 15:43:35.107192 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.107167    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8tphm\" (UniqueName: \"kubernetes.io/projected/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-kube-api-access-8tphm\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.107334 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.107244    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.107334 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.107277    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-openshift-service-ca\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.208216 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.208187    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.208337 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.208239    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-openshift-service-ca\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.208337 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.208280    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8tphm\" (UniqueName: \"kubernetes.io/projected/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-kube-api-access-8tphm\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.208412 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:43:35.208328    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-serving-cert: secret "maas-api-e2e-ait-791f7d53-serving-cert" not found
Jul 30 15:43:35.208412 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:43:35.208407    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls podName:ee7afd00-6f1c-4dbd-b5eb-81b386172eed nodeName:}" failed. No retries permitted until 2026-07-30 15:43:35.70838576 +0000 UTC m=+2014.314233855 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls") pod "maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" (UID: "ee7afd00-6f1c-4dbd-b5eb-81b386172eed") : secret "maas-api-e2e-ait-791f7d53-serving-cert" not found
Jul 30 15:43:35.208880 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.208865    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-openshift-service-ca\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.217725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.217703    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8tphm\" (UniqueName: \"kubernetes.io/projected/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-kube-api-access-8tphm\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.693699 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.693669    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"]
Jul 30 15:43:35.697116 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.697100    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:35.702959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.702935    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-791f7d53-dockercfg-ltxt8\""
Jul 30 15:43:35.702959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.702955    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-791f7d53\""
Jul 30 15:43:35.712410 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.712391    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.715235 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.715213    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls\") pod \"maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.716533 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.716512    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"]
Jul 30 15:43:35.814053 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.814022    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720aba2c-dd42-4757-91ca-67e75b7832f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") " pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:35.814203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.814078    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvgkq\" (UniqueName: \"kubernetes.io/projected/720aba2c-dd42-4757-91ca-67e75b7832f8-kube-api-access-qvgkq\") pod \"payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") " pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:35.903595 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.903562    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:35.914639 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.914610    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720aba2c-dd42-4757-91ca-67e75b7832f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") " pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:35.914754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.914666    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvgkq\" (UniqueName: \"kubernetes.io/projected/720aba2c-dd42-4757-91ca-67e75b7832f8-kube-api-access-qvgkq\") pod \"payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") " pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:35.915514 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.915491    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720aba2c-dd42-4757-91ca-67e75b7832f8-plugins-config-volume\") pod \"payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") " pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:35.924807 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:35.924784    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvgkq\" (UniqueName: \"kubernetes.io/projected/720aba2c-dd42-4757-91ca-67e75b7832f8-kube-api-access-qvgkq\") pod \"payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") " pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:36.008097 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.007919    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:36.042815 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:43:36.042787    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee7afd00_6f1c_4dbd_b5eb_81b386172eed.slice/crio-6416cff18ac2a573966d7e5732f67c6078b1dff85030782cb316c366bc376ee1 WatchSource:0}: Error finding container 6416cff18ac2a573966d7e5732f67c6078b1dff85030782cb316c366bc376ee1: Status 404 returned error can't find the container with id 6416cff18ac2a573966d7e5732f67c6078b1dff85030782cb316c366bc376ee1
Jul 30 15:43:36.042949 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.042820    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"]
Jul 30 15:43:36.043920 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.043903    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:43:36.162729 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.162703    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"]
Jul 30 15:43:36.164086 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:43:36.164060    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod720aba2c_dd42_4757_91ca_67e75b7832f8.slice/crio-2e784f1bacc300e6333364d759e8536857e115b7140658f6fedc20bf41f5d340 WatchSource:0}: Error finding container 2e784f1bacc300e6333364d759e8536857e115b7140658f6fedc20bf41f5d340: Status 404 returned error can't find the container with id 2e784f1bacc300e6333364d759e8536857e115b7140658f6fedc20bf41f5d340
Jul 30 15:43:36.928566 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.928533    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb" event={"ID":"720aba2c-dd42-4757-91ca-67e75b7832f8","Type":"ContainerStarted","Data":"f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e"}
Jul 30 15:43:36.928748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.928592    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:43:36.928748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.928616    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb" event={"ID":"720aba2c-dd42-4757-91ca-67e75b7832f8","Type":"ContainerStarted","Data":"2e784f1bacc300e6333364d759e8536857e115b7140658f6fedc20bf41f5d340"}
Jul 30 15:43:36.930004 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.929980    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" event={"ID":"ee7afd00-6f1c-4dbd-b5eb-81b386172eed","Type":"ContainerStarted","Data":"5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7"}
Jul 30 15:43:36.930137 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.930016    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" event={"ID":"ee7afd00-6f1c-4dbd-b5eb-81b386172eed","Type":"ContainerStarted","Data":"6416cff18ac2a573966d7e5732f67c6078b1dff85030782cb316c366bc376ee1"}
Jul 30 15:43:36.930137 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.930070    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:36.950959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.950900    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb" podStartSLOduration=1.9508897840000001 podStartE2EDuration="1.950889784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:43:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:43:36.948337617 +0000 UTC m=+2015.554185721" watchObservedRunningTime="2026-07-30 15:43:36.950889784 +0000 UTC m=+2015.556737886"
Jul 30 15:43:36.973121 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:36.973046    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" podStartSLOduration=2.310432731 podStartE2EDuration="2.973034406s" totalImagesPullingTime="662.601675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:43:36.969493365 +0000 UTC m=+2015.575341468" watchObservedRunningTime="2026-07-30 15:43:36.973034406 +0000 UTC m=+2015.578882509"
Jul 30 15:43:42.942091 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:42.942061    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:43:47.938393 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:43:47.938366    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:44:15.644139 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:15.644097    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"]
Jul 30 15:44:15.646779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:15.644392    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" podUID="ee7afd00-6f1c-4dbd-b5eb-81b386172eed" containerName="maas-api" containerID="cri-o://5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7" gracePeriod=30
Jul 30 15:44:15.708113 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:15.708067    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"]
Jul 30 15:44:15.708367 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:15.708340    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb" podUID="720aba2c-dd42-4757-91ca-67e75b7832f8" containerName="payload-processing" containerID="cri-o://f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e" gracePeriod=30
Jul 30 15:44:15.966804 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:15.966776    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:44:15.996222 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:15.996194    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:44:16.086031 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.085999    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls\") pod \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") "
Jul 30 15:44:16.086199 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.086090    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-openshift-service-ca\") pod \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") "
Jul 30 15:44:16.086199 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.086119    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qvgkq\" (UniqueName: \"kubernetes.io/projected/720aba2c-dd42-4757-91ca-67e75b7832f8-kube-api-access-qvgkq\") pod \"720aba2c-dd42-4757-91ca-67e75b7832f8\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") "
Jul 30 15:44:16.086316 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.086211    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8tphm\" (UniqueName: \"kubernetes.io/projected/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-kube-api-access-8tphm\") pod \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\" (UID: \"ee7afd00-6f1c-4dbd-b5eb-81b386172eed\") "
Jul 30 15:44:16.086316 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.086234    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720aba2c-dd42-4757-91ca-67e75b7832f8-plugins-config-volume\") pod \"720aba2c-dd42-4757-91ca-67e75b7832f8\" (UID: \"720aba2c-dd42-4757-91ca-67e75b7832f8\") "
Jul 30 15:44:16.086628 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.086582    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ee7afd00-6f1c-4dbd-b5eb-81b386172eed" (UID: "ee7afd00-6f1c-4dbd-b5eb-81b386172eed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:44:16.086762 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.086623    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/720aba2c-dd42-4757-91ca-67e75b7832f8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "720aba2c-dd42-4757-91ca-67e75b7832f8" (UID: "720aba2c-dd42-4757-91ca-67e75b7832f8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:44:16.088364 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.088340    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ee7afd00-6f1c-4dbd-b5eb-81b386172eed" (UID: "ee7afd00-6f1c-4dbd-b5eb-81b386172eed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:44:16.088790 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.088770    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/720aba2c-dd42-4757-91ca-67e75b7832f8-kube-api-access-qvgkq" (OuterVolumeSpecName: "kube-api-access-qvgkq") pod "720aba2c-dd42-4757-91ca-67e75b7832f8" (UID: "720aba2c-dd42-4757-91ca-67e75b7832f8"). InnerVolumeSpecName "kube-api-access-qvgkq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:44:16.088851 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.088828    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-kube-api-access-8tphm" (OuterVolumeSpecName: "kube-api-access-8tphm") pod "ee7afd00-6f1c-4dbd-b5eb-81b386172eed" (UID: "ee7afd00-6f1c-4dbd-b5eb-81b386172eed"). InnerVolumeSpecName "kube-api-access-8tphm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:44:16.145511 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.145481    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"
Jul 30 15:44:16.145511 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.145488    2553 generic.go:356] "Generic (PLEG): container finished" podID="720aba2c-dd42-4757-91ca-67e75b7832f8" containerID="f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e" exitCode=0
Jul 30 15:44:16.145748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.145576    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb" event={"ID":"720aba2c-dd42-4757-91ca-67e75b7832f8","Type":"ContainerDied","Data":"f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e"}
Jul 30 15:44:16.145748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.145630    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb" event={"ID":"720aba2c-dd42-4757-91ca-67e75b7832f8","Type":"ContainerDied","Data":"2e784f1bacc300e6333364d759e8536857e115b7140658f6fedc20bf41f5d340"}
Jul 30 15:44:16.145748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.145660    2553 scope.go:117] "RemoveContainer" containerID="f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e"
Jul 30 15:44:16.146997 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.146976    2553 generic.go:356] "Generic (PLEG): container finished" podID="ee7afd00-6f1c-4dbd-b5eb-81b386172eed" containerID="5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7" exitCode=0
Jul 30 15:44:16.147115 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.147025    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"
Jul 30 15:44:16.147115 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.147060    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" event={"ID":"ee7afd00-6f1c-4dbd-b5eb-81b386172eed","Type":"ContainerDied","Data":"5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7"}
Jul 30 15:44:16.147219 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.147118    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg" event={"ID":"ee7afd00-6f1c-4dbd-b5eb-81b386172eed","Type":"ContainerDied","Data":"6416cff18ac2a573966d7e5732f67c6078b1dff85030782cb316c366bc376ee1"}
Jul 30 15:44:16.154830 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.154818    2553 scope.go:117] "RemoveContainer" containerID="f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e"
Jul 30 15:44:16.155134 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:44:16.155112    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e\": container with ID starting with f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e not found: ID does not exist" containerID="f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e"
Jul 30 15:44:16.155189 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.155145    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e"} err="failed to get container status \"f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e\": rpc error: code = NotFound desc = could not find container \"f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e\": container with ID starting with f85e2f34b672baa101a3dcafbdbfb20b2e02af1d1f3626030f5361662a8d486e not found: ID does not exist"
Jul 30 15:44:16.155189 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.155170    2553 scope.go:117] "RemoveContainer" containerID="5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7"
Jul 30 15:44:16.163754 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.163737    2553 scope.go:117] "RemoveContainer" containerID="5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7"
Jul 30 15:44:16.163990 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:44:16.163973    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7\": container with ID starting with 5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7 not found: ID does not exist" containerID="5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7"
Jul 30 15:44:16.164057 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.163999    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7"} err="failed to get container status \"5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7\": rpc error: code = NotFound desc = could not find container \"5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7\": container with ID starting with 5d5c4d77b7843f7de2414cf45aa4cad4c829c88cdb9c927c5a292353dc35c4a7 not found: ID does not exist"
Jul 30 15:44:16.178134 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.178102    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"]
Jul 30 15:44:16.181030 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.181010    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-791f7d53-866cc8b9c5-lgcmg"]
Jul 30 15:44:16.187906 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.187887    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8tphm\" (UniqueName: \"kubernetes.io/projected/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-kube-api-access-8tphm\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:16.187984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.187909    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/720aba2c-dd42-4757-91ca-67e75b7832f8-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:16.187984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.187920    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:16.187984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.187928    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee7afd00-6f1c-4dbd-b5eb-81b386172eed-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:16.187984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.187938    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qvgkq\" (UniqueName: \"kubernetes.io/projected/720aba2c-dd42-4757-91ca-67e75b7832f8-kube-api-access-qvgkq\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:16.193297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.193275    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"]
Jul 30 15:44:16.197898 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:16.197878    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-791f7d53-6fd56f6dbd-pm2jb"]
Jul 30 15:44:17.924696 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:17.924659    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="720aba2c-dd42-4757-91ca-67e75b7832f8" path="/var/lib/kubelet/pods/720aba2c-dd42-4757-91ca-67e75b7832f8/volumes"
Jul 30 15:44:17.925242 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:17.925222    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee7afd00-6f1c-4dbd-b5eb-81b386172eed" path="/var/lib/kubelet/pods/ee7afd00-6f1c-4dbd-b5eb-81b386172eed/volumes"
Jul 30 15:44:20.307686 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.307656    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"]
Jul 30 15:44:20.308053 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.308039    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee7afd00-6f1c-4dbd-b5eb-81b386172eed" containerName="maas-api"
Jul 30 15:44:20.308053 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.308050    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee7afd00-6f1c-4dbd-b5eb-81b386172eed" containerName="maas-api"
Jul 30 15:44:20.308134 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.308064    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="720aba2c-dd42-4757-91ca-67e75b7832f8" containerName="payload-processing"
Jul 30 15:44:20.308134 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.308070    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="720aba2c-dd42-4757-91ca-67e75b7832f8" containerName="payload-processing"
Jul 30 15:44:20.308134 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.308129    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee7afd00-6f1c-4dbd-b5eb-81b386172eed" containerName="maas-api"
Jul 30 15:44:20.308225 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.308139    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="720aba2c-dd42-4757-91ca-67e75b7832f8" containerName="payload-processing"
Jul 30 15:44:20.312678 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.312657    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.316289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.316267    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a0bccac2-serving-cert\""
Jul 30 15:44:20.325669 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.325649    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"]
Jul 30 15:44:20.431779 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.431747    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/4443de13-16f5-49a0-8dd7-71f165db5774-kube-api-access-csshk\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.431908 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.431802    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4443de13-16f5-49a0-8dd7-71f165db5774-maas-api-tls\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.431908 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.431824    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4443de13-16f5-49a0-8dd7-71f165db5774-openshift-service-ca\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.532972 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.532941    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4443de13-16f5-49a0-8dd7-71f165db5774-maas-api-tls\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.533130 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.532974    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4443de13-16f5-49a0-8dd7-71f165db5774-openshift-service-ca\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.533130 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.533065    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/4443de13-16f5-49a0-8dd7-71f165db5774-kube-api-access-csshk\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.533752 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.533730    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4443de13-16f5-49a0-8dd7-71f165db5774-openshift-service-ca\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.535459 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.535410    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4443de13-16f5-49a0-8dd7-71f165db5774-maas-api-tls\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.548602 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.548578    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/4443de13-16f5-49a0-8dd7-71f165db5774-kube-api-access-csshk\") pod \"maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.623352 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.623279    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:20.768006 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:20.767977    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"]
Jul 30 15:44:20.769454 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:44:20.769413    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4443de13_16f5_49a0_8dd7_71f165db5774.slice/crio-c586d0e011b29b5081feeb6ed287162ad44f02542f4a41df08074fadad790ecb WatchSource:0}: Error finding container c586d0e011b29b5081feeb6ed287162ad44f02542f4a41df08074fadad790ecb: Status 404 returned error can't find the container with id c586d0e011b29b5081feeb6ed287162ad44f02542f4a41df08074fadad790ecb
Jul 30 15:44:21.064941 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.064914    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"]
Jul 30 15:44:21.069637 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.069618    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.072629 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.072609    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-a0bccac2\""
Jul 30 15:44:21.072774 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.072757    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-a0bccac2-dockercfg-ct8p8\""
Jul 30 15:44:21.083407 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.083383    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"]
Jul 30 15:44:21.177458 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.177406    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk" event={"ID":"4443de13-16f5-49a0-8dd7-71f165db5774","Type":"ContainerStarted","Data":"c586d0e011b29b5081feeb6ed287162ad44f02542f4a41df08074fadad790ecb"}
Jul 30 15:44:21.239108 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.239073    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac597df7-61f0-4cc4-b122-fd157bad0a36-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.239259 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.239160    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tx2r\" (UniqueName: \"kubernetes.io/projected/ac597df7-61f0-4cc4-b122-fd157bad0a36-kube-api-access-5tx2r\") pod \"payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.340343 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.340247    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac597df7-61f0-4cc4-b122-fd157bad0a36-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.340343 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.340304    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tx2r\" (UniqueName: \"kubernetes.io/projected/ac597df7-61f0-4cc4-b122-fd157bad0a36-kube-api-access-5tx2r\") pod \"payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.341027 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.341008    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac597df7-61f0-4cc4-b122-fd157bad0a36-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.350273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.350244    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tx2r\" (UniqueName: \"kubernetes.io/projected/ac597df7-61f0-4cc4-b122-fd157bad0a36-kube-api-access-5tx2r\") pod \"payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.382068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.382039    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:21.557765 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:21.557739    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"]
Jul 30 15:44:21.559464 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:44:21.559413    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac597df7_61f0_4cc4_b122_fd157bad0a36.slice/crio-fad28fdafc44b539447cbb1049a9d9bf8867f9535f9273e04bfca2ab38c02907 WatchSource:0}: Error finding container fad28fdafc44b539447cbb1049a9d9bf8867f9535f9273e04bfca2ab38c02907: Status 404 returned error can't find the container with id fad28fdafc44b539447cbb1049a9d9bf8867f9535f9273e04bfca2ab38c02907
Jul 30 15:44:22.186240 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.186195    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj" event={"ID":"ac597df7-61f0-4cc4-b122-fd157bad0a36","Type":"ContainerStarted","Data":"dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a"}
Jul 30 15:44:22.186456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.186267    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:22.186456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.186290    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj" event={"ID":"ac597df7-61f0-4cc4-b122-fd157bad0a36","Type":"ContainerStarted","Data":"fad28fdafc44b539447cbb1049a9d9bf8867f9535f9273e04bfca2ab38c02907"}
Jul 30 15:44:22.187735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.187714    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk" event={"ID":"4443de13-16f5-49a0-8dd7-71f165db5774","Type":"ContainerStarted","Data":"eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70"}
Jul 30 15:44:22.187862 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.187850    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:22.209474 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.209401    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj" podStartSLOduration=1.209388753 podStartE2EDuration="1.209388753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:44:22.207918402 +0000 UTC m=+2060.813766527" watchObservedRunningTime="2026-07-30 15:44:22.209388753 +0000 UTC m=+2060.815236855"
Jul 30 15:44:22.241157 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:22.241105    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk" podStartSLOduration=1.8810746950000001 podStartE2EDuration="2.24109065s" totalImagesPullingTime="360.015955ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:44:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:44:22.239249663 +0000 UTC m=+2060.845097767" watchObservedRunningTime="2026-07-30 15:44:22.24109065 +0000 UTC m=+2060.846938753"
Jul 30 15:44:28.199589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:28.199500    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:33.195398 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:33.195369    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:45.284893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.284856    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"]
Jul 30 15:44:45.288515 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.288494    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:45.291567 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.291547    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:44:45.299252 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.299229    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"]
Jul 30 15:44:45.362801 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.362770    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d\" (UID: \"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:45.463651 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.463624    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d\" (UID: \"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:45.464234 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.464217    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d\" (UID: \"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:45.600536 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.600471    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:45.946893 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:45.946866    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"]
Jul 30 15:44:45.947909 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:44:45.947887    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podceaaeaf3_5a8c_46d0_b121_7648fd0ab5b1.slice/crio-eba39837db3c2bb28ba7f911115742edac72eb4d6c68f5b0408a9c6cc46ee203 WatchSource:0}: Error finding container eba39837db3c2bb28ba7f911115742edac72eb4d6c68f5b0408a9c6cc46ee203: Status 404 returned error can't find the container with id eba39837db3c2bb28ba7f911115742edac72eb4d6c68f5b0408a9c6cc46ee203
Jul 30 15:44:46.327390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:46.327354    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d" event={"ID":"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1","Type":"ContainerStarted","Data":"8895c8dfee81c4084c057406109c9f39ad6549ce51539723de839c19445144b3"}
Jul 30 15:44:46.327792 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:46.327458    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d" event={"ID":"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1","Type":"ContainerStarted","Data":"eba39837db3c2bb28ba7f911115742edac72eb4d6c68f5b0408a9c6cc46ee203"}
Jul 30 15:44:46.349233 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:46.349195    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d" podStartSLOduration=1.349181169 podStartE2EDuration="1.349181169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:44:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:44:46.347142995 +0000 UTC m=+2084.952991098" watchObservedRunningTime="2026-07-30 15:44:46.349181169 +0000 UTC m=+2084.955029271"
Jul 30 15:44:47.334067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:47.334035    2553 generic.go:356] "Generic (PLEG): container finished" podID="ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1" containerID="8895c8dfee81c4084c057406109c9f39ad6549ce51539723de839c19445144b3" exitCode=0
Jul 30 15:44:47.334463 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:47.334118    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d" event={"ID":"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1","Type":"ContainerDied","Data":"8895c8dfee81c4084c057406109c9f39ad6549ce51539723de839c19445144b3"}
Jul 30 15:44:48.470480 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:48.470460    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:48.591856 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:48.591778    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1-maas-api-service-ca\") pod \"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1\" (UID: \"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1\") "
Jul 30 15:44:48.592117 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:48.592096    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1" (UID: "ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:44:48.692645 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:48.692623    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:49.345277 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:49.345248    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"
Jul 30 15:44:49.345277 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:49.345247    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d" event={"ID":"ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1","Type":"ContainerDied","Data":"eba39837db3c2bb28ba7f911115742edac72eb4d6c68f5b0408a9c6cc46ee203"}
Jul 30 15:44:49.345505 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:49.345314    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="eba39837db3c2bb28ba7f911115742edac72eb4d6c68f5b0408a9c6cc46ee203"
Jul 30 15:44:51.861874 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:51.861834    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"]
Jul 30 15:44:51.862296 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:51.862088    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk" podUID="4443de13-16f5-49a0-8dd7-71f165db5774" containerName="maas-api" containerID="cri-o://eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70" gracePeriod=30
Jul 30 15:44:51.943640 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:51.943606    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"]
Jul 30 15:44:51.943847 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:51.943789    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj" podUID="ac597df7-61f0-4cc4-b122-fd157bad0a36" containerName="payload-pre-processing" containerID="cri-o://dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a" gracePeriod=30
Jul 30 15:44:52.102715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.102681    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"]
Jul 30 15:44:52.115068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.114984    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a0bccac2-4ws4d"]
Jul 30 15:44:52.194993 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.194972    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:52.224103 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.224079    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:52.322142 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322115    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4443de13-16f5-49a0-8dd7-71f165db5774-maas-api-tls\") pod \"4443de13-16f5-49a0-8dd7-71f165db5774\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") "
Jul 30 15:44:52.322288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322148    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4443de13-16f5-49a0-8dd7-71f165db5774-openshift-service-ca\") pod \"4443de13-16f5-49a0-8dd7-71f165db5774\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") "
Jul 30 15:44:52.322288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322184    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac597df7-61f0-4cc4-b122-fd157bad0a36-plugins-config-volume\") pod \"ac597df7-61f0-4cc4-b122-fd157bad0a36\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") "
Jul 30 15:44:52.322288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322204    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/4443de13-16f5-49a0-8dd7-71f165db5774-kube-api-access-csshk\") pod \"4443de13-16f5-49a0-8dd7-71f165db5774\" (UID: \"4443de13-16f5-49a0-8dd7-71f165db5774\") "
Jul 30 15:44:52.322288 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322226    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5tx2r\" (UniqueName: \"kubernetes.io/projected/ac597df7-61f0-4cc4-b122-fd157bad0a36-kube-api-access-5tx2r\") pod \"ac597df7-61f0-4cc4-b122-fd157bad0a36\" (UID: \"ac597df7-61f0-4cc4-b122-fd157bad0a36\") "
Jul 30 15:44:52.322571 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322509    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4443de13-16f5-49a0-8dd7-71f165db5774-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4443de13-16f5-49a0-8dd7-71f165db5774" (UID: "4443de13-16f5-49a0-8dd7-71f165db5774"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:44:52.322571 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.322539    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac597df7-61f0-4cc4-b122-fd157bad0a36-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac597df7-61f0-4cc4-b122-fd157bad0a36" (UID: "ac597df7-61f0-4cc4-b122-fd157bad0a36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:44:52.324237 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.324209    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4443de13-16f5-49a0-8dd7-71f165db5774-kube-api-access-csshk" (OuterVolumeSpecName: "kube-api-access-csshk") pod "4443de13-16f5-49a0-8dd7-71f165db5774" (UID: "4443de13-16f5-49a0-8dd7-71f165db5774"). InnerVolumeSpecName "kube-api-access-csshk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:44:52.324311 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.324237    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4443de13-16f5-49a0-8dd7-71f165db5774-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4443de13-16f5-49a0-8dd7-71f165db5774" (UID: "4443de13-16f5-49a0-8dd7-71f165db5774"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:44:52.324311 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.324246    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac597df7-61f0-4cc4-b122-fd157bad0a36-kube-api-access-5tx2r" (OuterVolumeSpecName: "kube-api-access-5tx2r") pod "ac597df7-61f0-4cc4-b122-fd157bad0a36" (UID: "ac597df7-61f0-4cc4-b122-fd157bad0a36"). InnerVolumeSpecName "kube-api-access-5tx2r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:44:52.363635 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.363612    2553 generic.go:356] "Generic (PLEG): container finished" podID="ac597df7-61f0-4cc4-b122-fd157bad0a36" containerID="dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a" exitCode=0
Jul 30 15:44:52.363734 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.363656    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"
Jul 30 15:44:52.363734 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.363665    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj" event={"ID":"ac597df7-61f0-4cc4-b122-fd157bad0a36","Type":"ContainerDied","Data":"dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a"}
Jul 30 15:44:52.363734 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.363721    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj" event={"ID":"ac597df7-61f0-4cc4-b122-fd157bad0a36","Type":"ContainerDied","Data":"fad28fdafc44b539447cbb1049a9d9bf8867f9535f9273e04bfca2ab38c02907"}
Jul 30 15:44:52.363863 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.363752    2553 scope.go:117] "RemoveContainer" containerID="dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a"
Jul 30 15:44:52.365297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.365234    2553 generic.go:356] "Generic (PLEG): container finished" podID="4443de13-16f5-49a0-8dd7-71f165db5774" containerID="eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70" exitCode=0
Jul 30 15:44:52.365297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.365267    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"
Jul 30 15:44:52.365449 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.365325    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk" event={"ID":"4443de13-16f5-49a0-8dd7-71f165db5774","Type":"ContainerDied","Data":"eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70"}
Jul 30 15:44:52.365449 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.365379    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk" event={"ID":"4443de13-16f5-49a0-8dd7-71f165db5774","Type":"ContainerDied","Data":"c586d0e011b29b5081feeb6ed287162ad44f02542f4a41df08074fadad790ecb"}
Jul 30 15:44:52.375491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.375470    2553 scope.go:117] "RemoveContainer" containerID="dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a"
Jul 30 15:44:52.376091 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:44:52.376062    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a\": container with ID starting with dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a not found: ID does not exist" containerID="dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a"
Jul 30 15:44:52.376186 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.376120    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a"} err="failed to get container status \"dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a\": rpc error: code = NotFound desc = could not find container \"dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a\": container with ID starting with dc0435794c62a6b7da9612d65c72c4f4472425d7adca038d2dc1510acaeab60a not found: ID does not exist"
Jul 30 15:44:52.376186 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.376144    2553 scope.go:117] "RemoveContainer" containerID="eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70"
Jul 30 15:44:52.385279 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.385264    2553 scope.go:117] "RemoveContainer" containerID="eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70"
Jul 30 15:44:52.385533 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:44:52.385514    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70\": container with ID starting with eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70 not found: ID does not exist" containerID="eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70"
Jul 30 15:44:52.385803 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.385784    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70"} err="failed to get container status \"eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70\": rpc error: code = NotFound desc = could not find container \"eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70\": container with ID starting with eff71e431b68b104af7efaf2fd2f835eadbe22d72e4ae65912863016be2e3b70 not found: ID does not exist"
Jul 30 15:44:52.394543 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.394524    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"]
Jul 30 15:44:52.401318 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.401295    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a0bccac2-6899b88d5-p4dkk"]
Jul 30 15:44:52.416300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.416272    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"]
Jul 30 15:44:52.423370 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.423352    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4443de13-16f5-49a0-8dd7-71f165db5774-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:52.423370 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.423369    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4443de13-16f5-49a0-8dd7-71f165db5774-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:52.423554 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.423379    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac597df7-61f0-4cc4-b122-fd157bad0a36-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:52.423554 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.423389    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-csshk\" (UniqueName: \"kubernetes.io/projected/4443de13-16f5-49a0-8dd7-71f165db5774-kube-api-access-csshk\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:52.423554 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.423399    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5tx2r\" (UniqueName: \"kubernetes.io/projected/ac597df7-61f0-4cc4-b122-fd157bad0a36-kube-api-access-5tx2r\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:44:52.424434 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:52.424401    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-a0bccac2-66d4df55d8-xd6qj"]
Jul 30 15:44:53.924065 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:53.924031    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4443de13-16f5-49a0-8dd7-71f165db5774" path="/var/lib/kubelet/pods/4443de13-16f5-49a0-8dd7-71f165db5774/volumes"
Jul 30 15:44:53.924435 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:53.924386    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac597df7-61f0-4cc4-b122-fd157bad0a36" path="/var/lib/kubelet/pods/ac597df7-61f0-4cc4-b122-fd157bad0a36/volumes"
Jul 30 15:44:53.924704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:53.924690    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1" path="/var/lib/kubelet/pods/ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1/volumes"
Jul 30 15:44:56.365121 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365090    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"]
Jul 30 15:44:56.365611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365474    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4443de13-16f5-49a0-8dd7-71f165db5774" containerName="maas-api"
Jul 30 15:44:56.365611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365485    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4443de13-16f5-49a0-8dd7-71f165db5774" containerName="maas-api"
Jul 30 15:44:56.365611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365499    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac597df7-61f0-4cc4-b122-fd157bad0a36" containerName="payload-pre-processing"
Jul 30 15:44:56.365611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365507    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac597df7-61f0-4cc4-b122-fd157bad0a36" containerName="payload-pre-processing"
Jul 30 15:44:56.365611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365539    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1" containerName="revoke-keys"
Jul 30 15:44:56.365611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365549    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1" containerName="revoke-keys"
Jul 30 15:44:56.365815 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365646    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ceaaeaf3-5a8c-46d0-b121-7648fd0ab5b1" containerName="revoke-keys"
Jul 30 15:44:56.365815 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365658    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4443de13-16f5-49a0-8dd7-71f165db5774" containerName="maas-api"
Jul 30 15:44:56.365815 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.365667    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac597df7-61f0-4cc4-b122-fd157bad0a36" containerName="payload-pre-processing"
Jul 30 15:44:56.370505 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.370487    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.373908 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.373855    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-23057140-serving-cert\""
Jul 30 15:44:56.385857 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.385832    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"]
Jul 30 15:44:56.456559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.456530    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f425688e-f896-441b-9bbd-cdf5ee4129b8-openshift-service-ca\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.456711 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.456564    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5w2x\" (UniqueName: \"kubernetes.io/projected/f425688e-f896-441b-9bbd-cdf5ee4129b8-kube-api-access-w5w2x\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.456711 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.456605    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.557453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.557404    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f425688e-f896-441b-9bbd-cdf5ee4129b8-openshift-service-ca\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.557597 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.557460    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5w2x\" (UniqueName: \"kubernetes.io/projected/f425688e-f896-441b-9bbd-cdf5ee4129b8-kube-api-access-w5w2x\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.557597 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.557503    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.557670 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:44:56.557635    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-23057140-serving-cert: secret "maas-api-e2e-ait-23057140-serving-cert" not found
Jul 30 15:44:56.557702 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:44:56.557694    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls podName:f425688e-f896-441b-9bbd-cdf5ee4129b8 nodeName:}" failed. No retries permitted until 2026-07-30 15:44:57.057678898 +0000 UTC m=+2095.663526979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls") pod "maas-api-e2e-ait-23057140-7c747868dc-ts7xs" (UID: "f425688e-f896-441b-9bbd-cdf5ee4129b8") : secret "maas-api-e2e-ait-23057140-serving-cert" not found
Jul 30 15:44:56.558106 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.558087    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f425688e-f896-441b-9bbd-cdf5ee4129b8-openshift-service-ca\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:56.570071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:56.570039    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5w2x\" (UniqueName: \"kubernetes.io/projected/f425688e-f896-441b-9bbd-cdf5ee4129b8-kube-api-access-w5w2x\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:57.061518 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:57.061481    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:57.063936 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:57.063909    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls\") pod \"maas-api-e2e-ait-23057140-7c747868dc-ts7xs\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:57.281221 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:57.281191    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:57.471365 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:57.471337    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"]
Jul 30 15:44:57.471818 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:44:57.471796    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf425688e_f896_441b_9bbd_cdf5ee4129b8.slice/crio-d1d4eb08bc6c865f39dfd84bec74523e889d36015bbcb29c16f944446c35dc34 WatchSource:0}: Error finding container d1d4eb08bc6c865f39dfd84bec74523e889d36015bbcb29c16f944446c35dc34: Status 404 returned error can't find the container with id d1d4eb08bc6c865f39dfd84bec74523e889d36015bbcb29c16f944446c35dc34
Jul 30 15:44:58.414051 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:58.413967    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs" event={"ID":"f425688e-f896-441b-9bbd-cdf5ee4129b8","Type":"ContainerStarted","Data":"59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0"}
Jul 30 15:44:58.414051 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:58.414033    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:44:58.414236 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:58.414058    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs" event={"ID":"f425688e-f896-441b-9bbd-cdf5ee4129b8","Type":"ContainerStarted","Data":"d1d4eb08bc6c865f39dfd84bec74523e889d36015bbcb29c16f944446c35dc34"}
Jul 30 15:44:58.439701 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:44:58.439645    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs" podStartSLOduration=1.958850253 podStartE2EDuration="2.439629671s" totalImagesPullingTime="480.779418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:44:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:44:58.436900326 +0000 UTC m=+2097.042748431" watchObservedRunningTime="2026-07-30 15:44:58.439629671 +0000 UTC m=+2097.045477775"
Jul 30 15:45:00.134938 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.134891    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"]
Jul 30 15:45:00.138959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.138932    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"
Jul 30 15:45:00.139373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.139346    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"]
Jul 30 15:45:00.141732 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.141708    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:45:00.142764 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.142742    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"
Jul 30 15:45:00.150060 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.149996    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"]
Jul 30 15:45:00.152065 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.152038    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"
Jul 30 15:45:00.154078 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.154048    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"]
Jul 30 15:45:00.162584 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.162563    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"
Jul 30 15:45:00.328488 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.328446    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"]
Jul 30 15:45:00.329431 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:45:00.329390    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a43c7e5_5c9c_4c2d_a5b1_dfd6714cd750.slice/crio-19f183cf70a606fb32f210b0d3673d505ddf2fd4a83393a9f3170c13758baff9 WatchSource:0}: Error finding container 19f183cf70a606fb32f210b0d3673d505ddf2fd4a83393a9f3170c13758baff9: Status 404 returned error can't find the container with id 19f183cf70a606fb32f210b0d3673d505ddf2fd4a83393a9f3170c13758baff9
Jul 30 15:45:00.352704 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.352672    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"]
Jul 30 15:45:00.352818 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:45:00.352787    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb45ca13_ed9d_445c_8aa4_03a91b734bdd.slice/crio-42592e6d66367e36d331953a1d104629532e71093eb08ab7680445fca28ed587 WatchSource:0}: Error finding container 42592e6d66367e36d331953a1d104629532e71093eb08ab7680445fca28ed587: Status 404 returned error can't find the container with id 42592e6d66367e36d331953a1d104629532e71093eb08ab7680445fca28ed587
Jul 30 15:45:00.427290 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.427253    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" event={"ID":"cb45ca13-ed9d-445c-8aa4-03a91b734bdd","Type":"ContainerStarted","Data":"42592e6d66367e36d331953a1d104629532e71093eb08ab7680445fca28ed587"}
Jul 30 15:45:00.428592 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:00.428564    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz" event={"ID":"2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750","Type":"ContainerStarted","Data":"19f183cf70a606fb32f210b0d3673d505ddf2fd4a83393a9f3170c13758baff9"}
Jul 30 15:45:01.435731 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.435694    2553 generic.go:356] "Generic (PLEG): container finished" podID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerID="3dc47f0645e6617f190f36d8b579058fd542041577eb38d9ff6a141318227464" exitCode=7
Jul 30 15:45:01.436203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.435783    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" event={"ID":"cb45ca13-ed9d-445c-8aa4-03a91b734bdd","Type":"ContainerDied","Data":"3dc47f0645e6617f190f36d8b579058fd542041577eb38d9ff6a141318227464"}
Jul 30 15:45:01.436203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.435899    2553 scope.go:117] "RemoveContainer" containerID="3dc47f0645e6617f190f36d8b579058fd542041577eb38d9ff6a141318227464"
Jul 30 15:45:01.437566 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.437544    2553 generic.go:356] "Generic (PLEG): container finished" podID="2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750" containerID="6147f63fc73d8a49e4a7e898cd61d27ea013b30be0081c05d4e3da157d96abbd" exitCode=0
Jul 30 15:45:01.437660 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.437617    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz" event={"ID":"2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750","Type":"ContainerDied","Data":"6147f63fc73d8a49e4a7e898cd61d27ea013b30be0081c05d4e3da157d96abbd"}
Jul 30 15:45:01.990170 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.990146    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:45:01.999088 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:01.999069    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:45:02.445924 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:02.445889    2553 generic.go:356] "Generic (PLEG): container finished" podID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerID="1142300be69fb34fb8124f73a4178ac3a15feaa02f237d5aaf3a6daa08caae54" exitCode=7
Jul 30 15:45:02.446438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:02.445927    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" event={"ID":"cb45ca13-ed9d-445c-8aa4-03a91b734bdd","Type":"ContainerDied","Data":"1142300be69fb34fb8124f73a4178ac3a15feaa02f237d5aaf3a6daa08caae54"}
Jul 30 15:45:02.446438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:02.445995    2553 scope.go:117] "RemoveContainer" containerID="3dc47f0645e6617f190f36d8b579058fd542041577eb38d9ff6a141318227464"
Jul 30 15:45:02.446438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:02.446141    2553 scope.go:117] "RemoveContainer" containerID="1142300be69fb34fb8124f73a4178ac3a15feaa02f237d5aaf3a6daa08caae54"
Jul 30 15:45:02.446438 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:45:02.446371    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght_odh-ai-gateway-infra(cb45ca13-ed9d-445c-8aa4-03a91b734bdd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd"
Jul 30 15:45:02.589841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:02.589815    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"
Jul 30 15:45:03.453400 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:03.453376    2553 scope.go:117] "RemoveContainer" containerID="1142300be69fb34fb8124f73a4178ac3a15feaa02f237d5aaf3a6daa08caae54"
Jul 30 15:45:03.453846 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:45:03.453593    2553 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght_odh-ai-gateway-infra(cb45ca13-ed9d-445c-8aa4-03a91b734bdd)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd"
Jul 30 15:45:03.454475 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:03.454456    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz"
Jul 30 15:45:03.454586 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:03.454456    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757105-9kswz" event={"ID":"2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750","Type":"ContainerDied","Data":"19f183cf70a606fb32f210b0d3673d505ddf2fd4a83393a9f3170c13758baff9"}
Jul 30 15:45:03.454586 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:03.454568    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="19f183cf70a606fb32f210b0d3673d505ddf2fd4a83393a9f3170c13758baff9"
Jul 30 15:45:04.425173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:04.425143    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:45:14.918295 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:14.918268    2553 scope.go:117] "RemoveContainer" containerID="1142300be69fb34fb8124f73a4178ac3a15feaa02f237d5aaf3a6daa08caae54"
Jul 30 15:45:15.526599 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:15.526520    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" event={"ID":"cb45ca13-ed9d-445c-8aa4-03a91b734bdd","Type":"ContainerStarted","Data":"5f12ded4957505e03284dc7b5f1985fa351ebf821fe1c7011384d7fd25703fda"}
Jul 30 15:45:15.544895 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:15.544841    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" podStartSLOduration=15.544826826 podStartE2EDuration="15.544826826s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:45:15.54363762 +0000 UTC m=+2114.149485724" watchObservedRunningTime="2026-07-30 15:45:15.544826826 +0000 UTC m=+2114.150674945"
Jul 30 15:45:16.534479 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:16.534440    2553 generic.go:356] "Generic (PLEG): container finished" podID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerID="5f12ded4957505e03284dc7b5f1985fa351ebf821fe1c7011384d7fd25703fda" exitCode=0
Jul 30 15:45:16.534946 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:16.534451    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" event={"ID":"cb45ca13-ed9d-445c-8aa4-03a91b734bdd","Type":"ContainerDied","Data":"5f12ded4957505e03284dc7b5f1985fa351ebf821fe1c7011384d7fd25703fda"}
Jul 30 15:45:16.534946 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:16.534592    2553 scope.go:117] "RemoveContainer" containerID="1142300be69fb34fb8124f73a4178ac3a15feaa02f237d5aaf3a6daa08caae54"
Jul 30 15:45:16.554335 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:16.554311    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"]
Jul 30 15:45:17.675924 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:17.675898    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"
Jul 30 15:45:18.548015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:18.547984    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"
Jul 30 15:45:18.548181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:18.548012    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght" event={"ID":"cb45ca13-ed9d-445c-8aa4-03a91b734bdd","Type":"ContainerDied","Data":"42592e6d66367e36d331953a1d104629532e71093eb08ab7680445fca28ed587"}
Jul 30 15:45:18.548181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:18.548060    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42592e6d66367e36d331953a1d104629532e71093eb08ab7680445fca28ed587"
Jul 30 15:45:18.592119 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:18.592092    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"]
Jul 30 15:45:18.595274 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:18.595254    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-23057140-29757105-6vght"]
Jul 30 15:45:19.924954 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:19.924926    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" path="/var/lib/kubelet/pods/cb45ca13-ed9d-445c-8aa4-03a91b734bdd/volumes"
Jul 30 15:45:21.304131 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304098    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"]
Jul 30 15:45:21.304532 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304518    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.304532 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304534    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.304610 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304548    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750" containerName="cleanup"
Jul 30 15:45:21.304610 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304554    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750" containerName="cleanup"
Jul 30 15:45:21.304610 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304573    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.304610 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304578    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.304733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304645    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750" containerName="cleanup"
Jul 30 15:45:21.304733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304652    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.304733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304659    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.304733 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.304667    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:21.307887 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.307872    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:21.311941 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.311924    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:45:21.319478 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.319455    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"]
Jul 30 15:45:21.492439 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.489031    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4706c748-2122-4989-bbd4-f48cec845ba1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-23057140-ddxbz\" (UID: \"4706c748-2122-4989-bbd4-f48cec845ba1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:21.595715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.595644    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4706c748-2122-4989-bbd4-f48cec845ba1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-23057140-ddxbz\" (UID: \"4706c748-2122-4989-bbd4-f48cec845ba1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:21.596226 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.596208    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4706c748-2122-4989-bbd4-f48cec845ba1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-23057140-ddxbz\" (UID: \"4706c748-2122-4989-bbd4-f48cec845ba1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:21.619519 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.619495    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:21.759074 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:21.759045    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"]
Jul 30 15:45:21.759342 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:45:21.759323    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4706c748_2122_4989_bbd4_f48cec845ba1.slice/crio-c2dce632e5aa31e6064613d17acf887899a36d56e5b2bd80d7f519ef7e432fcc WatchSource:0}: Error finding container c2dce632e5aa31e6064613d17acf887899a36d56e5b2bd80d7f519ef7e432fcc: Status 404 returned error can't find the container with id c2dce632e5aa31e6064613d17acf887899a36d56e5b2bd80d7f519ef7e432fcc
Jul 30 15:45:22.571366 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:22.571334    2553 generic.go:356] "Generic (PLEG): container finished" podID="4706c748-2122-4989-bbd4-f48cec845ba1" containerID="77af7a5c348c303c274bc064478d9b5823622e255b050fe2963573bae00b08e4" exitCode=0
Jul 30 15:45:22.571725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:22.571414    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz" event={"ID":"4706c748-2122-4989-bbd4-f48cec845ba1","Type":"ContainerDied","Data":"77af7a5c348c303c274bc064478d9b5823622e255b050fe2963573bae00b08e4"}
Jul 30 15:45:22.571725 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:22.571474    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz" event={"ID":"4706c748-2122-4989-bbd4-f48cec845ba1","Type":"ContainerStarted","Data":"c2dce632e5aa31e6064613d17acf887899a36d56e5b2bd80d7f519ef7e432fcc"}
Jul 30 15:45:23.715451 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:23.715406    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:23.810347 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:23.810313    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4706c748-2122-4989-bbd4-f48cec845ba1-maas-api-service-ca\") pod \"4706c748-2122-4989-bbd4-f48cec845ba1\" (UID: \"4706c748-2122-4989-bbd4-f48cec845ba1\") "
Jul 30 15:45:23.810737 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:23.810713    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4706c748-2122-4989-bbd4-f48cec845ba1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4706c748-2122-4989-bbd4-f48cec845ba1" (UID: "4706c748-2122-4989-bbd4-f48cec845ba1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:45:23.911483 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:23.911392    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4706c748-2122-4989-bbd4-f48cec845ba1-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:45:24.583591 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:24.583564    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"
Jul 30 15:45:24.583739 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:24.583564    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz" event={"ID":"4706c748-2122-4989-bbd4-f48cec845ba1","Type":"ContainerDied","Data":"c2dce632e5aa31e6064613d17acf887899a36d56e5b2bd80d7f519ef7e432fcc"}
Jul 30 15:45:24.583739 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:24.583689    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2dce632e5aa31e6064613d17acf887899a36d56e5b2bd80d7f519ef7e432fcc"
Jul 30 15:45:27.005069 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.005032    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"]
Jul 30 15:45:27.005595 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.005267    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs" podUID="f425688e-f896-441b-9bbd-cdf5ee4129b8" containerName="maas-api" containerID="cri-o://59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0" gracePeriod=30
Jul 30 15:45:27.249459 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.249277    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"]
Jul 30 15:45:27.253251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.253228    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-23057140-ddxbz"]
Jul 30 15:45:27.265569 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.265516    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:45:27.344115 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.344089    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w5w2x\" (UniqueName: \"kubernetes.io/projected/f425688e-f896-441b-9bbd-cdf5ee4129b8-kube-api-access-w5w2x\") pod \"f425688e-f896-441b-9bbd-cdf5ee4129b8\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") "
Jul 30 15:45:27.344248 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.344188    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f425688e-f896-441b-9bbd-cdf5ee4129b8-openshift-service-ca\") pod \"f425688e-f896-441b-9bbd-cdf5ee4129b8\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") "
Jul 30 15:45:27.344248 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.344242    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls\") pod \"f425688e-f896-441b-9bbd-cdf5ee4129b8\" (UID: \"f425688e-f896-441b-9bbd-cdf5ee4129b8\") "
Jul 30 15:45:27.344535 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.344509    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f425688e-f896-441b-9bbd-cdf5ee4129b8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f425688e-f896-441b-9bbd-cdf5ee4129b8" (UID: "f425688e-f896-441b-9bbd-cdf5ee4129b8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:45:27.346150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.346128    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f425688e-f896-441b-9bbd-cdf5ee4129b8" (UID: "f425688e-f896-441b-9bbd-cdf5ee4129b8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:45:27.346251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.346201    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f425688e-f896-441b-9bbd-cdf5ee4129b8-kube-api-access-w5w2x" (OuterVolumeSpecName: "kube-api-access-w5w2x") pod "f425688e-f896-441b-9bbd-cdf5ee4129b8" (UID: "f425688e-f896-441b-9bbd-cdf5ee4129b8"). InnerVolumeSpecName "kube-api-access-w5w2x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:45:27.445053 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.445027    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w5w2x\" (UniqueName: \"kubernetes.io/projected/f425688e-f896-441b-9bbd-cdf5ee4129b8-kube-api-access-w5w2x\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:45:27.445053 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.445049    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f425688e-f896-441b-9bbd-cdf5ee4129b8-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:45:27.445200 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.445060    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f425688e-f896-441b-9bbd-cdf5ee4129b8-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:45:27.601475 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.601384    2553 generic.go:356] "Generic (PLEG): container finished" podID="f425688e-f896-441b-9bbd-cdf5ee4129b8" containerID="59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0" exitCode=0
Jul 30 15:45:27.601475 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.601461    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"
Jul 30 15:45:27.601475 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.601463    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs" event={"ID":"f425688e-f896-441b-9bbd-cdf5ee4129b8","Type":"ContainerDied","Data":"59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0"}
Jul 30 15:45:27.601681 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.601519    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs" event={"ID":"f425688e-f896-441b-9bbd-cdf5ee4129b8","Type":"ContainerDied","Data":"d1d4eb08bc6c865f39dfd84bec74523e889d36015bbcb29c16f944446c35dc34"}
Jul 30 15:45:27.601681 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.601541    2553 scope.go:117] "RemoveContainer" containerID="59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0"
Jul 30 15:45:27.611232 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.611215    2553 scope.go:117] "RemoveContainer" containerID="59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0"
Jul 30 15:45:27.611562 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:45:27.611531    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0\": container with ID starting with 59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0 not found: ID does not exist" containerID="59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0"
Jul 30 15:45:27.611686 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.611573    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0"} err="failed to get container status \"59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0\": rpc error: code = NotFound desc = could not find container \"59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0\": container with ID starting with 59655dd508d0ce950a6a737360d23bf27aea98543548a70dcf283a6452bf9fc0 not found: ID does not exist"
Jul 30 15:45:27.627265 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.627244    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"]
Jul 30 15:45:27.631583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.631559    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-23057140-7c747868dc-ts7xs"]
Jul 30 15:45:27.924027 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.923996    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4706c748-2122-4989-bbd4-f48cec845ba1" path="/var/lib/kubelet/pods/4706c748-2122-4989-bbd4-f48cec845ba1/volumes"
Jul 30 15:45:27.924445 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:27.924411    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f425688e-f896-441b-9bbd-cdf5ee4129b8" path="/var/lib/kubelet/pods/f425688e-f896-441b-9bbd-cdf5ee4129b8/volumes"
Jul 30 15:45:32.576821 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.576781    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"]
Jul 30 15:45:32.577413 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577391    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:32.577491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577434    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb45ca13-ed9d-445c-8aa4-03a91b734bdd" containerName="cleanup"
Jul 30 15:45:32.577491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577457    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4706c748-2122-4989-bbd4-f48cec845ba1" containerName="revoke-keys"
Jul 30 15:45:32.577491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577465    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4706c748-2122-4989-bbd4-f48cec845ba1" containerName="revoke-keys"
Jul 30 15:45:32.577491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577486    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f425688e-f896-441b-9bbd-cdf5ee4129b8" containerName="maas-api"
Jul 30 15:45:32.577685 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577496    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f425688e-f896-441b-9bbd-cdf5ee4129b8" containerName="maas-api"
Jul 30 15:45:32.577685 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577616    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4706c748-2122-4989-bbd4-f48cec845ba1" containerName="revoke-keys"
Jul 30 15:45:32.577685 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.577640    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f425688e-f896-441b-9bbd-cdf5ee4129b8" containerName="maas-api"
Jul 30 15:45:32.580857 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.580834    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.584566 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.584534    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-d21ea6ee-serving-cert\""
Jul 30 15:45:32.604085 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.604059    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"]
Jul 30 15:45:32.695638 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.695604    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn4df\" (UniqueName: \"kubernetes.io/projected/b1b29835-615b-4ec3-9790-88557911f6a4-kube-api-access-dn4df\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.695813 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.695656    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b29835-615b-4ec3-9790-88557911f6a4-maas-api-tls\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.695813 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.695728    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b29835-615b-4ec3-9790-88557911f6a4-openshift-service-ca\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.796599 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.796567    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b29835-615b-4ec3-9790-88557911f6a4-openshift-service-ca\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.796780 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.796659    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn4df\" (UniqueName: \"kubernetes.io/projected/b1b29835-615b-4ec3-9790-88557911f6a4-kube-api-access-dn4df\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.796780 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.796696    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b29835-615b-4ec3-9790-88557911f6a4-maas-api-tls\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.797636 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.797607    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b29835-615b-4ec3-9790-88557911f6a4-openshift-service-ca\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.799469 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.799447    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b29835-615b-4ec3-9790-88557911f6a4-maas-api-tls\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.806886 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.806859    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn4df\" (UniqueName: \"kubernetes.io/projected/b1b29835-615b-4ec3-9790-88557911f6a4-kube-api-access-dn4df\") pod \"maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:32.891047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:32.890947    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:33.042993 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.042969    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"]
Jul 30 15:45:33.044467 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:45:33.044433    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1b29835_615b_4ec3_9790_88557911f6a4.slice/crio-8c7846507996e500e59398321c1686ede7b550e850c9f14993d113291888479f WatchSource:0}: Error finding container 8c7846507996e500e59398321c1686ede7b550e850c9f14993d113291888479f: Status 404 returned error can't find the container with id 8c7846507996e500e59398321c1686ede7b550e850c9f14993d113291888479f
Jul 30 15:45:33.443289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.443257    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"]
Jul 30 15:45:33.446812 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.446788    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.449887 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.449864    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-d21ea6ee\""
Jul 30 15:45:33.450344 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.450327    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-d21ea6ee-dockercfg-dn7q2\""
Jul 30 15:45:33.461399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.461379    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"]
Jul 30 15:45:33.504403 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.504369    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fcb1478-a996-4aa9-995d-997d79b477ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.504586 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.504448    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq2ws\" (UniqueName: \"kubernetes.io/projected/0fcb1478-a996-4aa9-995d-997d79b477ec-kube-api-access-fq2ws\") pod \"payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.605739 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.605701    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fcb1478-a996-4aa9-995d-997d79b477ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.605739 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.605744    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq2ws\" (UniqueName: \"kubernetes.io/projected/0fcb1478-a996-4aa9-995d-997d79b477ec-kube-api-access-fq2ws\") pod \"payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.606402 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.606382    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fcb1478-a996-4aa9-995d-997d79b477ec-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.615578 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.615557    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq2ws\" (UniqueName: \"kubernetes.io/projected/0fcb1478-a996-4aa9-995d-997d79b477ec-kube-api-access-fq2ws\") pod \"payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.637591 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.637562    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p" event={"ID":"b1b29835-615b-4ec3-9790-88557911f6a4","Type":"ContainerStarted","Data":"8c7846507996e500e59398321c1686ede7b550e850c9f14993d113291888479f"}
Jul 30 15:45:33.757165 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.757143    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:33.908952 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:33.908904    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"]
Jul 30 15:45:33.909697 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:45:33.909673    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fcb1478_a996_4aa9_995d_997d79b477ec.slice/crio-6be224e9e54d0d24e527cda7549dd4cde83f268156321c83a4264235c3f03916 WatchSource:0}: Error finding container 6be224e9e54d0d24e527cda7549dd4cde83f268156321c83a4264235c3f03916: Status 404 returned error can't find the container with id 6be224e9e54d0d24e527cda7549dd4cde83f268156321c83a4264235c3f03916
Jul 30 15:45:34.644977 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.644943    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p" event={"ID":"b1b29835-615b-4ec3-9790-88557911f6a4","Type":"ContainerStarted","Data":"152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd"}
Jul 30 15:45:34.645700 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.645110    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:34.646488 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.646468    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp" event={"ID":"0fcb1478-a996-4aa9-995d-997d79b477ec","Type":"ContainerStarted","Data":"5f84c735efcfd0cc05862f8d5eb63f1357808af0e0c1f99d508708320e0b0ff7"}
Jul 30 15:45:34.646587 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.646506    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp" event={"ID":"0fcb1478-a996-4aa9-995d-997d79b477ec","Type":"ContainerStarted","Data":"6be224e9e54d0d24e527cda7549dd4cde83f268156321c83a4264235c3f03916"}
Jul 30 15:45:34.646633 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.646595    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:34.674468 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.674408    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p" podStartSLOduration=2.035157254 podStartE2EDuration="2.674396107s" totalImagesPullingTime="639.238853ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:45:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:45:34.671911194 +0000 UTC m=+2133.277759297" watchObservedRunningTime="2026-07-30 15:45:34.674396107 +0000 UTC m=+2133.280244210"
Jul 30 15:45:34.698639 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:34.698602    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp" podStartSLOduration=1.698591073 podStartE2EDuration="1.698591073s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:45:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:45:34.697719238 +0000 UTC m=+2133.303567354" watchObservedRunningTime="2026-07-30 15:45:34.698591073 +0000 UTC m=+2133.304439175"
Jul 30 15:45:40.658828 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:40.658798    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:45:45.655571 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:45.655543    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:45:56.521551 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.521519    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"]
Jul 30 15:45:56.525370 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.525352    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:56.528173 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.528151    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:45:56.534199 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.534164    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"]
Jul 30 15:45:56.626219 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.626187    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d742f24-1aff-4917-98d0-c27d4e68a02e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds\" (UID: \"8d742f24-1aff-4917-98d0-c27d4e68a02e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:56.727631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.727605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d742f24-1aff-4917-98d0-c27d4e68a02e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds\" (UID: \"8d742f24-1aff-4917-98d0-c27d4e68a02e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:56.728186 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.728168    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d742f24-1aff-4917-98d0-c27d4e68a02e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds\" (UID: \"8d742f24-1aff-4917-98d0-c27d4e68a02e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:56.837228 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.837160    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:56.977873 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:56.977844    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"]
Jul 30 15:45:56.978611 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:45:56.978576    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d742f24_1aff_4917_98d0_c27d4e68a02e.slice/crio-1af2c54168225d5c71390b83bd660242e2c68698b78a7c340e871345f7b564f9 WatchSource:0}: Error finding container 1af2c54168225d5c71390b83bd660242e2c68698b78a7c340e871345f7b564f9: Status 404 returned error can't find the container with id 1af2c54168225d5c71390b83bd660242e2c68698b78a7c340e871345f7b564f9
Jul 30 15:45:57.781476 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:57.781442    2553 generic.go:356] "Generic (PLEG): container finished" podID="8d742f24-1aff-4917-98d0-c27d4e68a02e" containerID="cfd89a76de4edf07f299ac6a8087ede856d0c7018a70fb0bab60b5ca58f7ceb4" exitCode=0
Jul 30 15:45:57.781818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:57.781495    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds" event={"ID":"8d742f24-1aff-4917-98d0-c27d4e68a02e","Type":"ContainerDied","Data":"cfd89a76de4edf07f299ac6a8087ede856d0c7018a70fb0bab60b5ca58f7ceb4"}
Jul 30 15:45:57.781818 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:57.781547    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds" event={"ID":"8d742f24-1aff-4917-98d0-c27d4e68a02e","Type":"ContainerStarted","Data":"1af2c54168225d5c71390b83bd660242e2c68698b78a7c340e871345f7b564f9"}
Jul 30 15:45:58.937181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:58.937159    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:59.047297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:59.047206    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d742f24-1aff-4917-98d0-c27d4e68a02e-maas-api-service-ca\") pod \"8d742f24-1aff-4917-98d0-c27d4e68a02e\" (UID: \"8d742f24-1aff-4917-98d0-c27d4e68a02e\") "
Jul 30 15:45:59.047676 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:59.047645    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8d742f24-1aff-4917-98d0-c27d4e68a02e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8d742f24-1aff-4917-98d0-c27d4e68a02e" (UID: "8d742f24-1aff-4917-98d0-c27d4e68a02e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:45:59.149146 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:59.149112    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8d742f24-1aff-4917-98d0-c27d4e68a02e-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:45:59.794393 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:59.794363    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"
Jul 30 15:45:59.794393 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:59.794371    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds" event={"ID":"8d742f24-1aff-4917-98d0-c27d4e68a02e","Type":"ContainerDied","Data":"1af2c54168225d5c71390b83bd660242e2c68698b78a7c340e871345f7b564f9"}
Jul 30 15:45:59.794613 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:45:59.794412    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1af2c54168225d5c71390b83bd660242e2c68698b78a7c340e871345f7b564f9"
Jul 30 15:46:03.433148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.433113    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"]
Jul 30 15:46:03.433575 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.433328    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p" podUID="b1b29835-615b-4ec3-9790-88557911f6a4" containerName="maas-api" containerID="cri-o://152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd" gracePeriod=30
Jul 30 15:46:03.568804 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.568774    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"]
Jul 30 15:46:03.569019 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.568994    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp" podUID="0fcb1478-a996-4aa9-995d-997d79b477ec" containerName="payload-pre-processing" containerID="cri-o://5f84c735efcfd0cc05862f8d5eb63f1357808af0e0c1f99d508708320e0b0ff7" gracePeriod=30
Jul 30 15:46:03.701663 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.701634    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:46:03.789632 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.789607    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b29835-615b-4ec3-9790-88557911f6a4-maas-api-tls\") pod \"b1b29835-615b-4ec3-9790-88557911f6a4\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") "
Jul 30 15:46:03.789782 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.789695    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b29835-615b-4ec3-9790-88557911f6a4-openshift-service-ca\") pod \"b1b29835-615b-4ec3-9790-88557911f6a4\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") "
Jul 30 15:46:03.789782 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.789745    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dn4df\" (UniqueName: \"kubernetes.io/projected/b1b29835-615b-4ec3-9790-88557911f6a4-kube-api-access-dn4df\") pod \"b1b29835-615b-4ec3-9790-88557911f6a4\" (UID: \"b1b29835-615b-4ec3-9790-88557911f6a4\") "
Jul 30 15:46:03.790093 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.790067    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1b29835-615b-4ec3-9790-88557911f6a4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1b29835-615b-4ec3-9790-88557911f6a4" (UID: "b1b29835-615b-4ec3-9790-88557911f6a4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:46:03.791926 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.791895    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1b29835-615b-4ec3-9790-88557911f6a4-kube-api-access-dn4df" (OuterVolumeSpecName: "kube-api-access-dn4df") pod "b1b29835-615b-4ec3-9790-88557911f6a4" (UID: "b1b29835-615b-4ec3-9790-88557911f6a4"). InnerVolumeSpecName "kube-api-access-dn4df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:46:03.792175 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.792155    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1b29835-615b-4ec3-9790-88557911f6a4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1b29835-615b-4ec3-9790-88557911f6a4" (UID: "b1b29835-615b-4ec3-9790-88557911f6a4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:46:03.820278 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.820252    2553 generic.go:356] "Generic (PLEG): container finished" podID="b1b29835-615b-4ec3-9790-88557911f6a4" containerID="152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd" exitCode=0
Jul 30 15:46:03.820488 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.820301    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"
Jul 30 15:46:03.820488 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.820330    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p" event={"ID":"b1b29835-615b-4ec3-9790-88557911f6a4","Type":"ContainerDied","Data":"152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd"}
Jul 30 15:46:03.820488 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.820388    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p" event={"ID":"b1b29835-615b-4ec3-9790-88557911f6a4","Type":"ContainerDied","Data":"8c7846507996e500e59398321c1686ede7b550e850c9f14993d113291888479f"}
Jul 30 15:46:03.820488 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.820433    2553 scope.go:117] "RemoveContainer" containerID="152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd"
Jul 30 15:46:03.822344 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.822322    2553 generic.go:356] "Generic (PLEG): container finished" podID="0fcb1478-a996-4aa9-995d-997d79b477ec" containerID="5f84c735efcfd0cc05862f8d5eb63f1357808af0e0c1f99d508708320e0b0ff7" exitCode=0
Jul 30 15:46:03.822452 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.822363    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp" event={"ID":"0fcb1478-a996-4aa9-995d-997d79b477ec","Type":"ContainerDied","Data":"5f84c735efcfd0cc05862f8d5eb63f1357808af0e0c1f99d508708320e0b0ff7"}
Jul 30 15:46:03.830339 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.830322    2553 scope.go:117] "RemoveContainer" containerID="152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd"
Jul 30 15:46:03.830668 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:46:03.830623    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd\": container with ID starting with 152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd not found: ID does not exist" containerID="152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd"
Jul 30 15:46:03.830668 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.830649    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd"} err="failed to get container status \"152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd\": rpc error: code = NotFound desc = could not find container \"152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd\": container with ID starting with 152c5c4beae6c2f9e2bc0132d8c745dc39b702758b3c3a9847737a0cc873dbfd not found: ID does not exist"
Jul 30 15:46:03.839623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.839602    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:46:03.851441 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.851408    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"]
Jul 30 15:46:03.856460 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.856413    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-d21ea6ee-mkcds"]
Jul 30 15:46:03.866145 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.866127    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"]
Jul 30 15:46:03.871181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.871161    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-d21ea6ee-dddccfb8f-qlh8p"]
Jul 30 15:46:03.891175 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.891142    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fcb1478-a996-4aa9-995d-997d79b477ec-plugins-config-volume\") pod \"0fcb1478-a996-4aa9-995d-997d79b477ec\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") "
Jul 30 15:46:03.891289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.891200    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fq2ws\" (UniqueName: \"kubernetes.io/projected/0fcb1478-a996-4aa9-995d-997d79b477ec-kube-api-access-fq2ws\") pod \"0fcb1478-a996-4aa9-995d-997d79b477ec\" (UID: \"0fcb1478-a996-4aa9-995d-997d79b477ec\") "
Jul 30 15:46:03.891753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.891727    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dn4df\" (UniqueName: \"kubernetes.io/projected/b1b29835-615b-4ec3-9790-88557911f6a4-kube-api-access-dn4df\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:46:03.891834 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.891779    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1b29835-615b-4ec3-9790-88557911f6a4-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:46:03.891834 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.891808    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1b29835-615b-4ec3-9790-88557911f6a4-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:46:03.891834 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.891722    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fcb1478-a996-4aa9-995d-997d79b477ec-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0fcb1478-a996-4aa9-995d-997d79b477ec" (UID: "0fcb1478-a996-4aa9-995d-997d79b477ec"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:46:03.893996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.893968    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fcb1478-a996-4aa9-995d-997d79b477ec-kube-api-access-fq2ws" (OuterVolumeSpecName: "kube-api-access-fq2ws") pod "0fcb1478-a996-4aa9-995d-997d79b477ec" (UID: "0fcb1478-a996-4aa9-995d-997d79b477ec"). InnerVolumeSpecName "kube-api-access-fq2ws". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:46:03.925187 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.925157    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8d742f24-1aff-4917-98d0-c27d4e68a02e" path="/var/lib/kubelet/pods/8d742f24-1aff-4917-98d0-c27d4e68a02e/volumes"
Jul 30 15:46:03.925563 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.925550    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1b29835-615b-4ec3-9790-88557911f6a4" path="/var/lib/kubelet/pods/b1b29835-615b-4ec3-9790-88557911f6a4/volumes"
Jul 30 15:46:03.992273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.992200    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0fcb1478-a996-4aa9-995d-997d79b477ec-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:46:03.992273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:03.992227    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fq2ws\" (UniqueName: \"kubernetes.io/projected/0fcb1478-a996-4aa9-995d-997d79b477ec-kube-api-access-fq2ws\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:46:04.834154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:04.834067    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"
Jul 30 15:46:04.834154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:04.834073    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp" event={"ID":"0fcb1478-a996-4aa9-995d-997d79b477ec","Type":"ContainerDied","Data":"6be224e9e54d0d24e527cda7549dd4cde83f268156321c83a4264235c3f03916"}
Jul 30 15:46:04.834154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:04.834144    2553 scope.go:117] "RemoveContainer" containerID="5f84c735efcfd0cc05862f8d5eb63f1357808af0e0c1f99d508708320e0b0ff7"
Jul 30 15:46:04.873929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:04.873899    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"]
Jul 30 15:46:04.890711 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:04.890677    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-d21ea6ee-59466d9b64-bjtvp"]
Jul 30 15:46:05.926092 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:46:05.926050    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fcb1478-a996-4aa9-995d-997d79b477ec" path="/var/lib/kubelet/pods/0fcb1478-a996-4aa9-995d-997d79b477ec/volumes"
Jul 30 15:48:29.051657 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.051621    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"]
Jul 30 15:48:29.052223 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052202    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d742f24-1aff-4917-98d0-c27d4e68a02e" containerName="revoke-keys"
Jul 30 15:48:29.052273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052228    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d742f24-1aff-4917-98d0-c27d4e68a02e" containerName="revoke-keys"
Jul 30 15:48:29.052273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052256    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fcb1478-a996-4aa9-995d-997d79b477ec" containerName="payload-pre-processing"
Jul 30 15:48:29.052273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052263    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fcb1478-a996-4aa9-995d-997d79b477ec" containerName="payload-pre-processing"
Jul 30 15:48:29.052273 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052273    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1b29835-615b-4ec3-9790-88557911f6a4" containerName="maas-api"
Jul 30 15:48:29.052396 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052280    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1b29835-615b-4ec3-9790-88557911f6a4" containerName="maas-api"
Jul 30 15:48:29.052396 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052361    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1b29835-615b-4ec3-9790-88557911f6a4" containerName="maas-api"
Jul 30 15:48:29.052396 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052368    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d742f24-1aff-4917-98d0-c27d4e68a02e" containerName="revoke-keys"
Jul 30 15:48:29.052396 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.052378    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fcb1478-a996-4aa9-995d-997d79b477ec" containerName="payload-pre-processing"
Jul 30 15:48:29.055876 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.055858    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.058686 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.058665    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-44cb5ac4-serving-cert\""
Jul 30 15:48:29.071142 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.071121    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"]
Jul 30 15:48:29.105663 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.105630    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.105816 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.105701    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vtkdl\" (UniqueName: \"kubernetes.io/projected/0a1d8989-d0e2-49da-b56c-0699db7c26e9-kube-api-access-vtkdl\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.105816 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.105730    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1d8989-d0e2-49da-b56c-0699db7c26e9-openshift-service-ca\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.206340 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.206302    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.206543 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.206357    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vtkdl\" (UniqueName: \"kubernetes.io/projected/0a1d8989-d0e2-49da-b56c-0699db7c26e9-kube-api-access-vtkdl\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.206543 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.206378    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1d8989-d0e2-49da-b56c-0699db7c26e9-openshift-service-ca\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.206543 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:48:29.206473    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-serving-cert: secret "maas-api-e2e-mt-44cb5ac4-serving-cert" not found
Jul 30 15:48:29.206543 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:48:29.206532    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls podName:0a1d8989-d0e2-49da-b56c-0699db7c26e9 nodeName:}" failed. No retries permitted until 2026-07-30 15:48:29.706514718 +0000 UTC m=+2308.312362799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls") pod "maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" (UID: "0a1d8989-d0e2-49da-b56c-0699db7c26e9") : secret "maas-api-e2e-mt-44cb5ac4-serving-cert" not found
Jul 30 15:48:29.207015 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.206998    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1d8989-d0e2-49da-b56c-0699db7c26e9-openshift-service-ca\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.219783 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.219757    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vtkdl\" (UniqueName: \"kubernetes.io/projected/0a1d8989-d0e2-49da-b56c-0699db7c26e9-kube-api-access-vtkdl\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.712509 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.712467    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.715099 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.715074    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls\") pod \"maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:29.966583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:29.966490    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:30.319753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:30.319723    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"]
Jul 30 15:48:30.321757 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:48:30.321732    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1d8989_d0e2_49da_b56c_0699db7c26e9.slice/crio-dd29ab5ab9bf14f8fa81ee245af987d9aa0de4d4bcf1dd02872c62bb3fd93d41 WatchSource:0}: Error finding container dd29ab5ab9bf14f8fa81ee245af987d9aa0de4d4bcf1dd02872c62bb3fd93d41: Status 404 returned error can't find the container with id dd29ab5ab9bf14f8fa81ee245af987d9aa0de4d4bcf1dd02872c62bb3fd93d41
Jul 30 15:48:30.687694 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:30.687657    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" event={"ID":"0a1d8989-d0e2-49da-b56c-0699db7c26e9","Type":"ContainerStarted","Data":"dd29ab5ab9bf14f8fa81ee245af987d9aa0de4d4bcf1dd02872c62bb3fd93d41"}
Jul 30 15:48:31.694343 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:31.694306    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" event={"ID":"0a1d8989-d0e2-49da-b56c-0699db7c26e9","Type":"ContainerStarted","Data":"d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384"}
Jul 30 15:48:31.694789 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:31.694546    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:48:31.716522 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:31.716474    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" podStartSLOduration=2.228415872 podStartE2EDuration="2.716459606s" totalImagesPullingTime="488.043734ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:48:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:48:31.713499934 +0000 UTC m=+2310.319348037" watchObservedRunningTime="2026-07-30 15:48:31.716459606 +0000 UTC m=+2310.322307708"
Jul 30 15:48:37.704822 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:48:37.704792    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:49:00.968583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:00.968547    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"]
Jul 30 15:49:00.972234 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:00.972217    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:00.976012 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:00.975987    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:49:00.984576 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:00.984555    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"]
Jul 30 15:49:01.104854 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.104824    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a372ad-ab53-49d7-90cb-eae2bf4b8121-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74\" (UID: \"02a372ad-ab53-49d7-90cb-eae2bf4b8121\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:01.206057 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.206017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a372ad-ab53-49d7-90cb-eae2bf4b8121-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74\" (UID: \"02a372ad-ab53-49d7-90cb-eae2bf4b8121\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:01.206673 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.206652    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a372ad-ab53-49d7-90cb-eae2bf4b8121-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74\" (UID: \"02a372ad-ab53-49d7-90cb-eae2bf4b8121\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:01.283121 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.283041    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:01.433289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.432212    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"]
Jul 30 15:49:01.869515 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.869482    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74" event={"ID":"02a372ad-ab53-49d7-90cb-eae2bf4b8121","Type":"ContainerStarted","Data":"46247df3151f394911c3f738c38bd7d7fde0bf11b9332ced418bea67aecadbfa"}
Jul 30 15:49:01.869709 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.869537    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74" event={"ID":"02a372ad-ab53-49d7-90cb-eae2bf4b8121","Type":"ContainerStarted","Data":"94b7cd12f483e651bcdd028a9bd68712f3eaf27c800779155587ec6f3ffa14b7"}
Jul 30 15:49:01.886392 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:01.886348    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74" podStartSLOduration=1.8863328830000001 podStartE2EDuration="1.886332883s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:49:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:49:01.885875789 +0000 UTC m=+2340.491723891" watchObservedRunningTime="2026-07-30 15:49:01.886332883 +0000 UTC m=+2340.492180986"
Jul 30 15:49:02.877178 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:02.877140    2553 generic.go:356] "Generic (PLEG): container finished" podID="02a372ad-ab53-49d7-90cb-eae2bf4b8121" containerID="46247df3151f394911c3f738c38bd7d7fde0bf11b9332ced418bea67aecadbfa" exitCode=0
Jul 30 15:49:02.877671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:02.877234    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74" event={"ID":"02a372ad-ab53-49d7-90cb-eae2bf4b8121","Type":"ContainerDied","Data":"46247df3151f394911c3f738c38bd7d7fde0bf11b9332ced418bea67aecadbfa"}
Jul 30 15:49:04.020936 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.020913    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:04.131515 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.131479    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a372ad-ab53-49d7-90cb-eae2bf4b8121-maas-api-service-ca\") pod \"02a372ad-ab53-49d7-90cb-eae2bf4b8121\" (UID: \"02a372ad-ab53-49d7-90cb-eae2bf4b8121\") "
Jul 30 15:49:04.131794 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.131773    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02a372ad-ab53-49d7-90cb-eae2bf4b8121-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "02a372ad-ab53-49d7-90cb-eae2bf4b8121" (UID: "02a372ad-ab53-49d7-90cb-eae2bf4b8121"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:49:04.232894 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.232867    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/02a372ad-ab53-49d7-90cb-eae2bf4b8121-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:49:04.893800 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.893773    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"
Jul 30 15:49:04.893800 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.893782    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74" event={"ID":"02a372ad-ab53-49d7-90cb-eae2bf4b8121","Type":"ContainerDied","Data":"94b7cd12f483e651bcdd028a9bd68712f3eaf27c800779155587ec6f3ffa14b7"}
Jul 30 15:49:04.894028 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:04.893835    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="94b7cd12f483e651bcdd028a9bd68712f3eaf27c800779155587ec6f3ffa14b7"
Jul 30 15:49:11.438966 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.438929    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"]
Jul 30 15:49:11.439494 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.439163    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" podUID="0a1d8989-d0e2-49da-b56c-0699db7c26e9" containerName="maas-api" containerID="cri-o://d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384" gracePeriod=30
Jul 30 15:49:11.673623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.673592    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"]
Jul 30 15:49:11.677341 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.677312    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-44cb5ac4-hwr74"]
Jul 30 15:49:11.690844 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.690784    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:49:11.699099 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.699080    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1d8989-d0e2-49da-b56c-0699db7c26e9-openshift-service-ca\") pod \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") "
Jul 30 15:49:11.699203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.699149    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls\") pod \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") "
Jul 30 15:49:11.699203 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.699174    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vtkdl\" (UniqueName: \"kubernetes.io/projected/0a1d8989-d0e2-49da-b56c-0699db7c26e9-kube-api-access-vtkdl\") pod \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\" (UID: \"0a1d8989-d0e2-49da-b56c-0699db7c26e9\") "
Jul 30 15:49:11.699433 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.699395    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0a1d8989-d0e2-49da-b56c-0699db7c26e9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0a1d8989-d0e2-49da-b56c-0699db7c26e9" (UID: "0a1d8989-d0e2-49da-b56c-0699db7c26e9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:49:11.701168 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.701143    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0a1d8989-d0e2-49da-b56c-0699db7c26e9" (UID: "0a1d8989-d0e2-49da-b56c-0699db7c26e9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:49:11.701264 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.701203    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a1d8989-d0e2-49da-b56c-0699db7c26e9-kube-api-access-vtkdl" (OuterVolumeSpecName: "kube-api-access-vtkdl") pod "0a1d8989-d0e2-49da-b56c-0699db7c26e9" (UID: "0a1d8989-d0e2-49da-b56c-0699db7c26e9"). InnerVolumeSpecName "kube-api-access-vtkdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:49:11.800387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.800347    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0a1d8989-d0e2-49da-b56c-0699db7c26e9-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:49:11.800387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.800379    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vtkdl\" (UniqueName: \"kubernetes.io/projected/0a1d8989-d0e2-49da-b56c-0699db7c26e9-kube-api-access-vtkdl\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:49:11.800387 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.800391    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0a1d8989-d0e2-49da-b56c-0699db7c26e9-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:49:11.924845 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.924803    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02a372ad-ab53-49d7-90cb-eae2bf4b8121" path="/var/lib/kubelet/pods/02a372ad-ab53-49d7-90cb-eae2bf4b8121/volumes"
Jul 30 15:49:11.937502 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.937474    2553 generic.go:356] "Generic (PLEG): container finished" podID="0a1d8989-d0e2-49da-b56c-0699db7c26e9" containerID="d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384" exitCode=0
Jul 30 15:49:11.937647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.937517    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"
Jul 30 15:49:11.937647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.937522    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" event={"ID":"0a1d8989-d0e2-49da-b56c-0699db7c26e9","Type":"ContainerDied","Data":"d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384"}
Jul 30 15:49:11.937647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.937571    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx" event={"ID":"0a1d8989-d0e2-49da-b56c-0699db7c26e9","Type":"ContainerDied","Data":"dd29ab5ab9bf14f8fa81ee245af987d9aa0de4d4bcf1dd02872c62bb3fd93d41"}
Jul 30 15:49:11.937647 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.937601    2553 scope.go:117] "RemoveContainer" containerID="d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384"
Jul 30 15:49:11.946695 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.946676    2553 scope.go:117] "RemoveContainer" containerID="d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384"
Jul 30 15:49:11.946966 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:49:11.946947    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384\": container with ID starting with d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384 not found: ID does not exist" containerID="d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384"
Jul 30 15:49:11.947031 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.946973    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384"} err="failed to get container status \"d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384\": rpc error: code = NotFound desc = could not find container \"d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384\": container with ID starting with d0d297a88a416b40bd2af7d4d1d381c55413d2bf7c8481cc07afa3f095407384 not found: ID does not exist"
Jul 30 15:49:11.960121 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.960093    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"]
Jul 30 15:49:11.964314 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:11.964293    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-44cb5ac4-77b4df449d-9h6lx"]
Jul 30 15:49:13.926111 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:49:13.926081    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a1d8989-d0e2-49da-b56c-0699db7c26e9" path="/var/lib/kubelet/pods/0a1d8989-d0e2-49da-b56c-0699db7c26e9/volumes"
Jul 30 15:50:02.028208 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:02.028173    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:50:02.037450 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:02.037411    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:50:13.095520 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.095485    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"]
Jul 30 15:50:13.096022 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.095685    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm" podUID="c0631976-1912-4cbe-bbc7-ad7100a7ddf9" containerName="manager" containerID="cri-o://e6cd95cb5e5c74cae14ff6d14490c46e1b26421e7077eaff0578d1e1a88868d8" gracePeriod=10
Jul 30 15:50:13.304661 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.304630    2553 generic.go:356] "Generic (PLEG): container finished" podID="c0631976-1912-4cbe-bbc7-ad7100a7ddf9" containerID="e6cd95cb5e5c74cae14ff6d14490c46e1b26421e7077eaff0578d1e1a88868d8" exitCode=0
Jul 30 15:50:13.304834 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.304705    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm" event={"ID":"c0631976-1912-4cbe-bbc7-ad7100a7ddf9","Type":"ContainerDied","Data":"e6cd95cb5e5c74cae14ff6d14490c46e1b26421e7077eaff0578d1e1a88868d8"}
Jul 30 15:50:13.346130 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.346073    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:50:13.466049 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.466012    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-extensions-socket-volume\") pod \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") "
Jul 30 15:50:13.466243 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.466087    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vz8vx\" (UniqueName: \"kubernetes.io/projected/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-kube-api-access-vz8vx\") pod \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\" (UID: \"c0631976-1912-4cbe-bbc7-ad7100a7ddf9\") "
Jul 30 15:50:13.466372 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.466349    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c0631976-1912-4cbe-bbc7-ad7100a7ddf9" (UID: "c0631976-1912-4cbe-bbc7-ad7100a7ddf9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:50:13.468100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.468067    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-kube-api-access-vz8vx" (OuterVolumeSpecName: "kube-api-access-vz8vx") pod "c0631976-1912-4cbe-bbc7-ad7100a7ddf9" (UID: "c0631976-1912-4cbe-bbc7-ad7100a7ddf9"). InnerVolumeSpecName "kube-api-access-vz8vx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:50:13.566906 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.566870    2553 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-extensions-socket-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:50:13.566906 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:13.566899    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vz8vx\" (UniqueName: \"kubernetes.io/projected/c0631976-1912-4cbe-bbc7-ad7100a7ddf9-kube-api-access-vz8vx\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:50:14.311476 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:14.311363    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"
Jul 30 15:50:14.311476 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:14.311382    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm" event={"ID":"c0631976-1912-4cbe-bbc7-ad7100a7ddf9","Type":"ContainerDied","Data":"661bed61210760bdfdb800ddfc778c84b93314d7376485e71ad61048d274f636"}
Jul 30 15:50:14.312027 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:14.311484    2553 scope.go:117] "RemoveContainer" containerID="e6cd95cb5e5c74cae14ff6d14490c46e1b26421e7077eaff0578d1e1a88868d8"
Jul 30 15:50:14.337108 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:14.337076    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"]
Jul 30 15:50:14.342393 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:14.342367    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pxxmm"]
Jul 30 15:50:15.923656 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:50:15.923624    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c0631976-1912-4cbe-bbc7-ad7100a7ddf9" path="/var/lib/kubelet/pods/c0631976-1912-4cbe-bbc7-ad7100a7ddf9/volumes"
Jul 30 15:51:02.169990 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:02.169960    2553 scope.go:117] "RemoveContainer" containerID="8895c8dfee81c4084c057406109c9f39ad6549ce51539723de839c19445144b3"
Jul 30 15:51:28.773583 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773552    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"]
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773923    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0631976-1912-4cbe-bbc7-ad7100a7ddf9" containerName="manager"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773934    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0631976-1912-4cbe-bbc7-ad7100a7ddf9" containerName="manager"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773948    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02a372ad-ab53-49d7-90cb-eae2bf4b8121" containerName="revoke-keys"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773954    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="02a372ad-ab53-49d7-90cb-eae2bf4b8121" containerName="revoke-keys"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773962    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1d8989-d0e2-49da-b56c-0699db7c26e9" containerName="maas-api"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.773968    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1d8989-d0e2-49da-b56c-0699db7c26e9" containerName="maas-api"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.774041    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="02a372ad-ab53-49d7-90cb-eae2bf4b8121" containerName="revoke-keys"
Jul 30 15:51:28.774047 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.774052    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1d8989-d0e2-49da-b56c-0699db7c26e9" containerName="maas-api"
Jul 30 15:51:28.774297 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.774061    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0631976-1912-4cbe-bbc7-ad7100a7ddf9" containerName="manager"
Jul 30 15:51:28.777033 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.777018    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:28.780765 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.780745    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-ctjh9\""
Jul 30 15:51:28.795250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.795225    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"]
Jul 30 15:51:28.809185 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.809159    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-swtc8\" (UniqueName: \"kubernetes.io/projected/02baa9dc-e25c-4c97-b84d-8593d49fc438-kube-api-access-swtc8\") pod \"kuadrant-operator-controller-manager-86878c769f-vjnkb\" (UID: \"02baa9dc-e25c-4c97-b84d-8593d49fc438\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:28.809283 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.809269    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02baa9dc-e25c-4c97-b84d-8593d49fc438-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vjnkb\" (UID: \"02baa9dc-e25c-4c97-b84d-8593d49fc438\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:28.909716 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.909691    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02baa9dc-e25c-4c97-b84d-8593d49fc438-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vjnkb\" (UID: \"02baa9dc-e25c-4c97-b84d-8593d49fc438\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:28.909814 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.909727    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-swtc8\" (UniqueName: \"kubernetes.io/projected/02baa9dc-e25c-4c97-b84d-8593d49fc438-kube-api-access-swtc8\") pod \"kuadrant-operator-controller-manager-86878c769f-vjnkb\" (UID: \"02baa9dc-e25c-4c97-b84d-8593d49fc438\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:28.910028 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.910009    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/02baa9dc-e25c-4c97-b84d-8593d49fc438-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vjnkb\" (UID: \"02baa9dc-e25c-4c97-b84d-8593d49fc438\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:28.924010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:28.923983    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-swtc8\" (UniqueName: \"kubernetes.io/projected/02baa9dc-e25c-4c97-b84d-8593d49fc438-kube-api-access-swtc8\") pod \"kuadrant-operator-controller-manager-86878c769f-vjnkb\" (UID: \"02baa9dc-e25c-4c97-b84d-8593d49fc438\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:29.087163 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:29.087111    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:29.239534 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:29.239508    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"]
Jul 30 15:51:29.241702 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:51:29.241672    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02baa9dc_e25c_4c97_b84d_8593d49fc438.slice/crio-b71044bf52c3247650d373aa13b1f7c29bdd076aa2060c71fd6ec3c109013da7 WatchSource:0}: Error finding container b71044bf52c3247650d373aa13b1f7c29bdd076aa2060c71fd6ec3c109013da7: Status 404 returned error can't find the container with id b71044bf52c3247650d373aa13b1f7c29bdd076aa2060c71fd6ec3c109013da7
Jul 30 15:51:29.767994 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:29.767956    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb" event={"ID":"02baa9dc-e25c-4c97-b84d-8593d49fc438","Type":"ContainerStarted","Data":"6d450e95b7bc9cf938dd94a31158cab58a734c593f2683ed6b1a55937bf0814a"}
Jul 30 15:51:29.768181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:29.768013    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb" event={"ID":"02baa9dc-e25c-4c97-b84d-8593d49fc438","Type":"ContainerStarted","Data":"b71044bf52c3247650d373aa13b1f7c29bdd076aa2060c71fd6ec3c109013da7"}
Jul 30 15:51:29.768181 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:29.768043    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:29.796058 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:29.796008    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb" podStartSLOduration=1.795992007 podStartE2EDuration="1.795992007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:51:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:51:29.795704426 +0000 UTC m=+2488.401552529" watchObservedRunningTime="2026-07-30 15:51:29.795992007 +0000 UTC m=+2488.401840110"
Jul 30 15:51:40.776715 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:40.776682    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vjnkb"
Jul 30 15:51:52.180483 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.180441    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"]
Jul 30 15:51:52.183987 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.183967    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.188212 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.188190    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-db19ef93-serving-cert\""
Jul 30 15:51:52.206432 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.206402    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"]
Jul 30 15:51:52.297489 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.297459    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-openshift-service-ca\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.297602 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.297527    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hnzx2\" (UniqueName: \"kubernetes.io/projected/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-kube-api-access-hnzx2\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.297602 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.297559    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-maas-api-tls\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.398926 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.398887    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-openshift-service-ca\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.399067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.398957    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hnzx2\" (UniqueName: \"kubernetes.io/projected/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-kube-api-access-hnzx2\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.399067 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.399001    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-maas-api-tls\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.399767 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.399743    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-openshift-service-ca\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.401431 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.401402    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-maas-api-tls\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.408388 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.408369    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hnzx2\" (UniqueName: \"kubernetes.io/projected/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-kube-api-access-hnzx2\") pod \"maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.494547 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.494472    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:52.666654 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.666621    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"]
Jul 30 15:51:52.668603 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:51:52.668564    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f6ff3cb_61b4_479c_ab2c_af847f08d1cc.slice/crio-f78aa74d7326702655614d09b9f9ee8ce296f5cc13857d8877bf3118ba64bcad WatchSource:0}: Error finding container f78aa74d7326702655614d09b9f9ee8ce296f5cc13857d8877bf3118ba64bcad: Status 404 returned error can't find the container with id f78aa74d7326702655614d09b9f9ee8ce296f5cc13857d8877bf3118ba64bcad
Jul 30 15:51:52.670072 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.670050    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:51:52.905949 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:52.905863    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx" event={"ID":"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc","Type":"ContainerStarted","Data":"f78aa74d7326702655614d09b9f9ee8ce296f5cc13857d8877bf3118ba64bcad"}
Jul 30 15:51:53.913343 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:53.913305    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx" event={"ID":"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc","Type":"ContainerStarted","Data":"4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a"}
Jul 30 15:51:53.913791 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:53.913462    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:51:53.939250 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:53.939164    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx" podStartSLOduration=1.2920997810000001 podStartE2EDuration="1.939150204s" totalImagesPullingTime="647.050423ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:51:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:51:53.936100281 +0000 UTC m=+2512.541948384" watchObservedRunningTime="2026-07-30 15:51:53.939150204 +0000 UTC m=+2512.544998306"
Jul 30 15:51:59.925672 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:51:59.925647    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:52:02.194770 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:02.194736    2553 scope.go:117] "RemoveContainer" containerID="5f12ded4957505e03284dc7b5f1985fa351ebf821fe1c7011384d7fd25703fda"
Jul 30 15:52:02.204496 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:02.204472    2553 scope.go:117] "RemoveContainer" containerID="cfd89a76de4edf07f299ac6a8087ede856d0c7018a70fb0bab60b5ca58f7ceb4"
Jul 30 15:52:02.212257 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:02.212242    2553 scope.go:117] "RemoveContainer" containerID="77af7a5c348c303c274bc064478d9b5823622e255b050fe2963573bae00b08e4"
Jul 30 15:52:24.851315 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.851283    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"]
Jul 30 15:52:24.855159 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.855138    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:24.859968 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.859943    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-db19ef93\"/\"e2e-lifecycle-model-db19ef93-kserve-self-signed-certs\""
Jul 30 15:52:24.860080 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.859971    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-db19ef93\"/\"openshift-service-ca.crt\""
Jul 30 15:52:24.860080 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.860037    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-db19ef93\"/\"kube-root-ca.crt\""
Jul 30 15:52:24.860080 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.860060    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-db19ef93\"/\"default-dockercfg-4kzc4\""
Jul 30 15:52:24.869329 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.869308    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"]
Jul 30 15:52:24.975702 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.975674    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-dshm\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:24.975836 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.975710    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-model-cache\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:24.975836 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.975729    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23859dc3-81b0-4ac4-81fc-46666b630648-tls-certs\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:24.975969 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.975887    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7w8kh\" (UniqueName: \"kubernetes.io/projected/23859dc3-81b0-4ac4-81fc-46666b630648-kube-api-access-7w8kh\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:24.975969 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.975920    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-home\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:24.975969 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:24.975953    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-tmp-dir\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.076777 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.076752    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7w8kh\" (UniqueName: \"kubernetes.io/projected/23859dc3-81b0-4ac4-81fc-46666b630648-kube-api-access-7w8kh\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.076882 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.076801    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-home\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.076882 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.076831    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-tmp-dir\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.076882 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.076874    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-dshm\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.077037 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.076900    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-model-cache\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.077219 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.077193    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-home\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.077295 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.077247    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-model-cache\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.077295 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.077250    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23859dc3-81b0-4ac4-81fc-46666b630648-tls-certs\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.077399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.077271    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-tmp-dir\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.079149 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.079122    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-dshm\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.079475 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.079453    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23859dc3-81b0-4ac4-81fc-46666b630648-tls-certs\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.085870 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.085848    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7w8kh\" (UniqueName: \"kubernetes.io/projected/23859dc3-81b0-4ac4-81fc-46666b630648-kube-api-access-7w8kh\") pod \"e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") " pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.164668 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.164609    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:25.312258 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:25.312234    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"]
Jul 30 15:52:25.313436 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:52:25.313401    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod23859dc3_81b0_4ac4_81fc_46666b630648.slice/crio-12dc8210f96c94d7f95774df95d1cbe4bf466791c40a48a8421a309f6738f639 WatchSource:0}: Error finding container 12dc8210f96c94d7f95774df95d1cbe4bf466791c40a48a8421a309f6738f639: Status 404 returned error can't find the container with id 12dc8210f96c94d7f95774df95d1cbe4bf466791c40a48a8421a309f6738f639
Jul 30 15:52:26.100160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:26.100125    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v" event={"ID":"23859dc3-81b0-4ac4-81fc-46666b630648","Type":"ContainerStarted","Data":"cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e"}
Jul 30 15:52:26.100160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:26.100161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v" event={"ID":"23859dc3-81b0-4ac4-81fc-46666b630648","Type":"ContainerStarted","Data":"12dc8210f96c94d7f95774df95d1cbe4bf466791c40a48a8421a309f6738f639"}
Jul 30 15:52:26.123748 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:26.123701    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v" podStartSLOduration=2.123685939 podStartE2EDuration="2.123685939s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:52:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:52:26.122029085 +0000 UTC m=+2544.727877182" watchObservedRunningTime="2026-07-30 15:52:26.123685939 +0000 UTC m=+2544.729534043"
Jul 30 15:52:35.164787 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:35.164753    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:35.165179 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:35.164810    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:35.178187 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:35.178164    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:52:36.168549 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:52:36.168522    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:53:06.379189 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.379155    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"]
Jul 30 15:53:06.382914 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.382895    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:06.387285 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.387268    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:53:06.393851 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.393825    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"]
Jul 30 15:53:06.511631 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.511607    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e961d9af-0a9d-4bd2-9059-f86e95c9620b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db19ef93-csfzh\" (UID: \"e961d9af-0a9d-4bd2-9059-f86e95c9620b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:06.612848 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.612823    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e961d9af-0a9d-4bd2-9059-f86e95c9620b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db19ef93-csfzh\" (UID: \"e961d9af-0a9d-4bd2-9059-f86e95c9620b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:06.613399 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.613381    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e961d9af-0a9d-4bd2-9059-f86e95c9620b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-db19ef93-csfzh\" (UID: \"e961d9af-0a9d-4bd2-9059-f86e95c9620b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:06.695088 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.695068    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:06.833268 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:06.833240    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"]
Jul 30 15:53:06.834855 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:53:06.834817    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode961d9af_0a9d_4bd2_9059_f86e95c9620b.slice/crio-b3a57db713c1c7b84b2505947a61eb865c2ca51b5e157325f45e8e42c2ed2378 WatchSource:0}: Error finding container b3a57db713c1c7b84b2505947a61eb865c2ca51b5e157325f45e8e42c2ed2378: Status 404 returned error can't find the container with id b3a57db713c1c7b84b2505947a61eb865c2ca51b5e157325f45e8e42c2ed2378
Jul 30 15:53:07.332205 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:07.332140    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh" event={"ID":"e961d9af-0a9d-4bd2-9059-f86e95c9620b","Type":"ContainerStarted","Data":"3d94d0aec70c6ef1798482bb1868f689acc9cffcd04a5c1dbb9770b09f2488b5"}
Jul 30 15:53:07.332205 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:07.332192    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh" event={"ID":"e961d9af-0a9d-4bd2-9059-f86e95c9620b","Type":"ContainerStarted","Data":"b3a57db713c1c7b84b2505947a61eb865c2ca51b5e157325f45e8e42c2ed2378"}
Jul 30 15:53:07.356660 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:07.356618    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh" podStartSLOduration=1.35660152 podStartE2EDuration="1.35660152s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:53:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:53:07.351800018 +0000 UTC m=+2585.957648121" watchObservedRunningTime="2026-07-30 15:53:07.35660152 +0000 UTC m=+2585.962449623"
Jul 30 15:53:08.339110 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:08.339078    2553 generic.go:356] "Generic (PLEG): container finished" podID="e961d9af-0a9d-4bd2-9059-f86e95c9620b" containerID="3d94d0aec70c6ef1798482bb1868f689acc9cffcd04a5c1dbb9770b09f2488b5" exitCode=0
Jul 30 15:53:08.339526 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:08.339161    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh" event={"ID":"e961d9af-0a9d-4bd2-9059-f86e95c9620b","Type":"ContainerDied","Data":"3d94d0aec70c6ef1798482bb1868f689acc9cffcd04a5c1dbb9770b09f2488b5"}
Jul 30 15:53:09.483588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:09.483566    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:09.534390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:09.534365    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e961d9af-0a9d-4bd2-9059-f86e95c9620b-maas-api-service-ca\") pod \"e961d9af-0a9d-4bd2-9059-f86e95c9620b\" (UID: \"e961d9af-0a9d-4bd2-9059-f86e95c9620b\") "
Jul 30 15:53:09.534724 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:09.534705    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e961d9af-0a9d-4bd2-9059-f86e95c9620b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e961d9af-0a9d-4bd2-9059-f86e95c9620b" (UID: "e961d9af-0a9d-4bd2-9059-f86e95c9620b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:53:09.636251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:09.636198    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e961d9af-0a9d-4bd2-9059-f86e95c9620b-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:10.351650 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:10.351573    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"
Jul 30 15:53:10.351650 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:10.351583    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh" event={"ID":"e961d9af-0a9d-4bd2-9059-f86e95c9620b","Type":"ContainerDied","Data":"b3a57db713c1c7b84b2505947a61eb865c2ca51b5e157325f45e8e42c2ed2378"}
Jul 30 15:53:10.351650 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:10.351632    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3a57db713c1c7b84b2505947a61eb865c2ca51b5e157325f45e8e42c2ed2378"
Jul 30 15:53:22.106921 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.106889    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"]
Jul 30 15:53:22.107382 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.107096    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx" podUID="0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" containerName="maas-api" containerID="cri-o://4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a" gracePeriod=30
Jul 30 15:53:22.364502 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.364438    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:53:22.414068 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.414040    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"]
Jul 30 15:53:22.418483 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.418454    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-db19ef93-csfzh"]
Jul 30 15:53:22.422835 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.422813    2553 generic.go:356] "Generic (PLEG): container finished" podID="0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" containerID="4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a" exitCode=0
Jul 30 15:53:22.422944 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.422855    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"
Jul 30 15:53:22.422944 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.422891    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx" event={"ID":"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc","Type":"ContainerDied","Data":"4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a"}
Jul 30 15:53:22.422944 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.422939    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx" event={"ID":"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc","Type":"ContainerDied","Data":"f78aa74d7326702655614d09b9f9ee8ce296f5cc13857d8877bf3118ba64bcad"}
Jul 30 15:53:22.423058 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.422961    2553 scope.go:117] "RemoveContainer" containerID="4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a"
Jul 30 15:53:22.429829 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.429810    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hnzx2\" (UniqueName: \"kubernetes.io/projected/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-kube-api-access-hnzx2\") pod \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") "
Jul 30 15:53:22.429933 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.429921    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-openshift-service-ca\") pod \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") "
Jul 30 15:53:22.429996 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.429957    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-maas-api-tls\") pod \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\" (UID: \"0f6ff3cb-61b4-479c-ab2c-af847f08d1cc\") "
Jul 30 15:53:22.430281 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.430261    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" (UID: "0f6ff3cb-61b4-479c-ab2c-af847f08d1cc"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:53:22.431961 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.431938    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" (UID: "0f6ff3cb-61b4-479c-ab2c-af847f08d1cc"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:53:22.432278 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.432255    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-kube-api-access-hnzx2" (OuterVolumeSpecName: "kube-api-access-hnzx2") pod "0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" (UID: "0f6ff3cb-61b4-479c-ab2c-af847f08d1cc"). InnerVolumeSpecName "kube-api-access-hnzx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:53:22.432850 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.432834    2553 scope.go:117] "RemoveContainer" containerID="4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a"
Jul 30 15:53:22.433108 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:53:22.433082    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a\": container with ID starting with 4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a not found: ID does not exist" containerID="4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a"
Jul 30 15:53:22.433150 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.433120    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a"} err="failed to get container status \"4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a\": rpc error: code = NotFound desc = could not find container \"4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a\": container with ID starting with 4dd9ef0c3554249ed24b98d49e77b727056c61b289f747444459b6c22912a32a not found: ID does not exist"
Jul 30 15:53:22.530890 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.530872    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:22.530890 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.530890    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hnzx2\" (UniqueName: \"kubernetes.io/projected/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-kube-api-access-hnzx2\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:22.531024 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.530902    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:22.750204 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.750181    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"]
Jul 30 15:53:22.754336 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:22.754317    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-db19ef93-745c578fd5-9lwcx"]
Jul 30 15:53:23.925039 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:23.924966    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" path="/var/lib/kubelet/pods/0f6ff3cb-61b4-479c-ab2c-af847f08d1cc/volumes"
Jul 30 15:53:23.925377 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:23.925272    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e961d9af-0a9d-4bd2-9059-f86e95c9620b" path="/var/lib/kubelet/pods/e961d9af-0a9d-4bd2-9059-f86e95c9620b/volumes"
Jul 30 15:53:30.790530 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:30.790495    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"]
Jul 30 15:53:45.809723 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:45.809659    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v" podUID="23859dc3-81b0-4ac4-81fc-46666b630648" containerName="main" containerID="cri-o://cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e" gracePeriod=45
Jul 30 15:53:46.068762 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.068702    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:53:46.217556 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217527    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-home\") pod \"23859dc3-81b0-4ac4-81fc-46666b630648\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") "
Jul 30 15:53:46.217735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217583    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7w8kh\" (UniqueName: \"kubernetes.io/projected/23859dc3-81b0-4ac4-81fc-46666b630648-kube-api-access-7w8kh\") pod \"23859dc3-81b0-4ac4-81fc-46666b630648\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") "
Jul 30 15:53:46.217735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217620    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-model-cache\") pod \"23859dc3-81b0-4ac4-81fc-46666b630648\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") "
Jul 30 15:53:46.217735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217670    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23859dc3-81b0-4ac4-81fc-46666b630648-tls-certs\") pod \"23859dc3-81b0-4ac4-81fc-46666b630648\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") "
Jul 30 15:53:46.217735 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217726    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-dshm\") pod \"23859dc3-81b0-4ac4-81fc-46666b630648\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") "
Jul 30 15:53:46.217940 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217767    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-tmp-dir\") pod \"23859dc3-81b0-4ac4-81fc-46666b630648\" (UID: \"23859dc3-81b0-4ac4-81fc-46666b630648\") "
Jul 30 15:53:46.217940 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217790    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-home" (OuterVolumeSpecName: "home") pod "23859dc3-81b0-4ac4-81fc-46666b630648" (UID: "23859dc3-81b0-4ac4-81fc-46666b630648"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:53:46.217940 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.217896    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-model-cache" (OuterVolumeSpecName: "model-cache") pod "23859dc3-81b0-4ac4-81fc-46666b630648" (UID: "23859dc3-81b0-4ac4-81fc-46666b630648"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:53:46.218095 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.218066    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "23859dc3-81b0-4ac4-81fc-46666b630648" (UID: "23859dc3-81b0-4ac4-81fc-46666b630648"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:53:46.218148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.218133    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-model-cache\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:46.218148 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.218146    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-tmp-dir\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:46.218223 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.218158    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-home\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:46.219747 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.219723    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-dshm" (OuterVolumeSpecName: "dshm") pod "23859dc3-81b0-4ac4-81fc-46666b630648" (UID: "23859dc3-81b0-4ac4-81fc-46666b630648"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:53:46.220124 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.220099    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/23859dc3-81b0-4ac4-81fc-46666b630648-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "23859dc3-81b0-4ac4-81fc-46666b630648" (UID: "23859dc3-81b0-4ac4-81fc-46666b630648"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:53:46.220174 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.220115    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23859dc3-81b0-4ac4-81fc-46666b630648-kube-api-access-7w8kh" (OuterVolumeSpecName: "kube-api-access-7w8kh") pod "23859dc3-81b0-4ac4-81fc-46666b630648" (UID: "23859dc3-81b0-4ac4-81fc-46666b630648"). InnerVolumeSpecName "kube-api-access-7w8kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:53:46.318665 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.318642    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/23859dc3-81b0-4ac4-81fc-46666b630648-dshm\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:46.318665 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.318663    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7w8kh\" (UniqueName: \"kubernetes.io/projected/23859dc3-81b0-4ac4-81fc-46666b630648-kube-api-access-7w8kh\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:46.318828 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.318672    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/23859dc3-81b0-4ac4-81fc-46666b630648-tls-certs\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:53:46.570198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.570105    2553 generic.go:356] "Generic (PLEG): container finished" podID="23859dc3-81b0-4ac4-81fc-46666b630648" containerID="cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e" exitCode=0
Jul 30 15:53:46.570198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.570146    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v" event={"ID":"23859dc3-81b0-4ac4-81fc-46666b630648","Type":"ContainerDied","Data":"cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e"}
Jul 30 15:53:46.570198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.570160    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"
Jul 30 15:53:46.570198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.570178    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v" event={"ID":"23859dc3-81b0-4ac4-81fc-46666b630648","Type":"ContainerDied","Data":"12dc8210f96c94d7f95774df95d1cbe4bf466791c40a48a8421a309f6738f639"}
Jul 30 15:53:46.570198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.570200    2553 scope.go:117] "RemoveContainer" containerID="cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e"
Jul 30 15:53:46.579581 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.579561    2553 scope.go:117] "RemoveContainer" containerID="cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e"
Jul 30 15:53:46.579829 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:53:46.579812    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e\": container with ID starting with cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e not found: ID does not exist" containerID="cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e"
Jul 30 15:53:46.579911 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.579837    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e"} err="failed to get container status \"cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e\": rpc error: code = NotFound desc = could not find container \"cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e\": container with ID starting with cd36c02103b5d6bd37a9955afda65799c69ed77c77bde0d8d82078d72103773e not found: ID does not exist"
Jul 30 15:53:46.595373 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.595354    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"]
Jul 30 15:53:46.600456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:46.600438    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-db19ef93/e2e-lifecycle-model-db19ef93-kserve-75d8669467-g2g8v"]
Jul 30 15:53:47.925193 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:53:47.925152    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23859dc3-81b0-4ac4-81fc-46666b630648" path="/var/lib/kubelet/pods/23859dc3-81b0-4ac4-81fc-46666b630648/volumes"
Jul 30 15:55:02.064765 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:02.064735    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:55:02.076763 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:02.076738    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 15:55:02.274753 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:02.274722    2553 scope.go:117] "RemoveContainer" containerID="46247df3151f394911c3f738c38bd7d7fde0bf11b9332ced418bea67aecadbfa"
Jul 30 15:55:39.352097 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352062    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"]
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352440    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e961d9af-0a9d-4bd2-9059-f86e95c9620b" containerName="revoke-keys"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352452    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e961d9af-0a9d-4bd2-9059-f86e95c9620b" containerName="revoke-keys"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352472    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" containerName="maas-api"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352479    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" containerName="maas-api"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352491    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23859dc3-81b0-4ac4-81fc-46666b630648" containerName="main"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352496    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="23859dc3-81b0-4ac4-81fc-46666b630648" containerName="main"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352553    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="23859dc3-81b0-4ac4-81fc-46666b630648" containerName="main"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352560    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e961d9af-0a9d-4bd2-9059-f86e95c9620b" containerName="revoke-keys"
Jul 30 15:55:39.352786 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.352571    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f6ff3cb-61b4-479c-ab2c-af847f08d1cc" containerName="maas-api"
Jul 30 15:55:39.355671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.355651    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.362213 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.362186    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-9ef991-serving-cert\""
Jul 30 15:55:39.376716 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.376693    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"]
Jul 30 15:55:39.472057 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.472031    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3abf248-1e42-4059-98f3-61176f3a3ed8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.472180 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.472079    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3abf248-1e42-4059-98f3-61176f3a3ed8-maas-api-tls\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.472180 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.472139    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8twx\" (UniqueName: \"kubernetes.io/projected/f3abf248-1e42-4059-98f3-61176f3a3ed8-kube-api-access-g8twx\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.573091 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.573069    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8twx\" (UniqueName: \"kubernetes.io/projected/f3abf248-1e42-4059-98f3-61176f3a3ed8-kube-api-access-g8twx\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.573212 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.573128    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3abf248-1e42-4059-98f3-61176f3a3ed8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.573212 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.573171    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3abf248-1e42-4059-98f3-61176f3a3ed8-maas-api-tls\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.573946 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.573926    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3abf248-1e42-4059-98f3-61176f3a3ed8-openshift-service-ca\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.575803 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.575778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3abf248-1e42-4059-98f3-61176f3a3ed8-maas-api-tls\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.582449 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.582429    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8twx\" (UniqueName: \"kubernetes.io/projected/f3abf248-1e42-4059-98f3-61176f3a3ed8-kube-api-access-g8twx\") pod \"maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:39.666066 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:39.666012    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:40.015480 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:40.015456    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"]
Jul 30 15:55:40.015902 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:55:40.015883    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3abf248_1e42_4059_98f3_61176f3a3ed8.slice/crio-5e06360d1c99a0315b2fd5b023f5d0e152f6f1042c697c887b37b1f1c99d8a23 WatchSource:0}: Error finding container 5e06360d1c99a0315b2fd5b023f5d0e152f6f1042c697c887b37b1f1c99d8a23: Status 404 returned error can't find the container with id 5e06360d1c99a0315b2fd5b023f5d0e152f6f1042c697c887b37b1f1c99d8a23
Jul 30 15:55:40.213848 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:40.213816    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p" event={"ID":"f3abf248-1e42-4059-98f3-61176f3a3ed8","Type":"ContainerStarted","Data":"5e06360d1c99a0315b2fd5b023f5d0e152f6f1042c697c887b37b1f1c99d8a23"}
Jul 30 15:55:41.220487 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:41.220450    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p" event={"ID":"f3abf248-1e42-4059-98f3-61176f3a3ed8","Type":"ContainerStarted","Data":"64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe"}
Jul 30 15:55:41.220873 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:41.220547    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:47.230555 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:47.230525    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:55:47.253261 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:55:47.253214    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p" podStartSLOduration=7.721798565 podStartE2EDuration="8.253202567s" totalImagesPullingTime="531.404002ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:55:41.241668545 +0000 UTC m=+2739.847516649" watchObservedRunningTime="2026-07-30 15:55:47.253202567 +0000 UTC m=+2745.859050670"
Jul 30 15:56:08.418745 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.418712    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"]
Jul 30 15:56:08.422798 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.422773    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.426217 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.426192    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-762215-serving-cert\""
Jul 30 15:56:08.438009 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.437985    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"]
Jul 30 15:56:08.494491 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.494465    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-258wl\" (UniqueName: \"kubernetes.io/projected/16bbe166-65e4-43f5-924e-c1d5623f2127-kube-api-access-258wl\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.494589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.494503    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.494589 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.494522    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16bbe166-65e4-43f5-924e-c1d5623f2127-openshift-service-ca\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.595984 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.595959    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-258wl\" (UniqueName: \"kubernetes.io/projected/16bbe166-65e4-43f5-924e-c1d5623f2127-kube-api-access-258wl\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.596099 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.595997    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.596099 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.596016    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16bbe166-65e4-43f5-924e-c1d5623f2127-openshift-service-ca\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.596178 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:56:08.596122    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-serving-cert: secret "maas-api-e2e-inf-b-762215-serving-cert" not found
Jul 30 15:56:08.596212 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:56:08.596188    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls podName:16bbe166-65e4-43f5-924e-c1d5623f2127 nodeName:}" failed. No retries permitted until 2026-07-30 15:56:09.096167627 +0000 UTC m=+2767.702015721 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls") pod "maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" (UID: "16bbe166-65e4-43f5-924e-c1d5623f2127") : secret "maas-api-e2e-inf-b-762215-serving-cert" not found
Jul 30 15:56:08.596676 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.596658    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16bbe166-65e4-43f5-924e-c1d5623f2127-openshift-service-ca\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:08.606559 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:08.606531    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-258wl\" (UniqueName: \"kubernetes.io/projected/16bbe166-65e4-43f5-924e-c1d5623f2127-kube-api-access-258wl\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:09.100622 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.100596    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:09.102857 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.102836    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls\") pod \"maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:09.169599 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.169572    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"]
Jul 30 15:56:09.173345 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.173326    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.176560 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.176540    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-762215\""
Jul 30 15:56:09.191788 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.191768    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"]
Jul 30 15:56:09.201869 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.201834    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6738602e-69ed-4212-8d04-446814e76d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.201869 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.201865    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc5jl\" (UniqueName: \"kubernetes.io/projected/6738602e-69ed-4212-8d04-446814e76d2f-kube-api-access-vc5jl\") pod \"payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.302897 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.302870    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6738602e-69ed-4212-8d04-446814e76d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.303010 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.302901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc5jl\" (UniqueName: \"kubernetes.io/projected/6738602e-69ed-4212-8d04-446814e76d2f-kube-api-access-vc5jl\") pod \"payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.303592 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.303573    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6738602e-69ed-4212-8d04-446814e76d2f-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.332860 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.332838    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:09.348100 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.348073    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc5jl\" (UniqueName: \"kubernetes.io/projected/6738602e-69ed-4212-8d04-446814e76d2f-kube-api-access-vc5jl\") pod \"payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.483983 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.483947    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:09.508757 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.508734    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"]
Jul 30 15:56:09.509332 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:56:09.509306    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16bbe166_65e4_43f5_924e_c1d5623f2127.slice/crio-c3e80be9628e39970c2e1183b7feceea4e6e3b3466e94b4ae182324462680272 WatchSource:0}: Error finding container c3e80be9628e39970c2e1183b7feceea4e6e3b3466e94b4ae182324462680272: Status 404 returned error can't find the container with id c3e80be9628e39970c2e1183b7feceea4e6e3b3466e94b4ae182324462680272
Jul 30 15:56:09.632860 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:09.632758    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"]
Jul 30 15:56:09.635187 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:56:09.635162    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6738602e_69ed_4212_8d04_446814e76d2f.slice/crio-f9ce1b93269fb853859ecdca56ada8a71d540eddcb7d6fc717e2dd74f1ff4cc0 WatchSource:0}: Error finding container f9ce1b93269fb853859ecdca56ada8a71d540eddcb7d6fc717e2dd74f1ff4cc0: Status 404 returned error can't find the container with id f9ce1b93269fb853859ecdca56ada8a71d540eddcb7d6fc717e2dd74f1ff4cc0
Jul 30 15:56:10.387721 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.387638    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" event={"ID":"6738602e-69ed-4212-8d04-446814e76d2f","Type":"ContainerStarted","Data":"20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547"}
Jul 30 15:56:10.387721 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.387708    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:10.388014 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.387728    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" event={"ID":"6738602e-69ed-4212-8d04-446814e76d2f","Type":"ContainerStarted","Data":"f9ce1b93269fb853859ecdca56ada8a71d540eddcb7d6fc717e2dd74f1ff4cc0"}
Jul 30 15:56:10.389151 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.389121    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" event={"ID":"16bbe166-65e4-43f5-924e-c1d5623f2127","Type":"ContainerStarted","Data":"f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f"}
Jul 30 15:56:10.389287 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.389166    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:10.389287 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.389181    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" event={"ID":"16bbe166-65e4-43f5-924e-c1d5623f2127","Type":"ContainerStarted","Data":"c3e80be9628e39970c2e1183b7feceea4e6e3b3466e94b4ae182324462680272"}
Jul 30 15:56:10.415001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.414958    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" podStartSLOduration=1.414945358 podStartE2EDuration="1.414945358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:56:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:56:10.413357086 +0000 UTC m=+2769.019205189" watchObservedRunningTime="2026-07-30 15:56:10.414945358 +0000 UTC m=+2769.020793461"
Jul 30 15:56:10.438623 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:10.438583    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" podStartSLOduration=1.956835131 podStartE2EDuration="2.438567728s" totalImagesPullingTime="481.732597ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:56:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:56:10.437655987 +0000 UTC m=+2769.043504102" watchObservedRunningTime="2026-07-30 15:56:10.438567728 +0000 UTC m=+2769.044415832"
Jul 30 15:56:16.400239 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:16.400208    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:56:21.396029 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:21.395979    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" podUID="6738602e-69ed-4212-8d04-446814e76d2f" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.86:9004: connect: connection refused"
Jul 30 15:56:31.396296 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:31.396199    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:56:41.260049 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.260010    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"]
Jul 30 15:56:41.263823 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.263802    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.266751 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.266730    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9ef991\"/\"default-dockercfg-9n85v\""
Jul 30 15:56:41.268048 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.268026    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9ef991\"/\"kube-root-ca.crt\""
Jul 30 15:56:41.268162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.268071    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-9ef991\"/\"openshift-service-ca.crt\""
Jul 30 15:56:41.268162 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.268148    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-9ef991\"/\"test-model-9ef991-kserve-self-signed-certs\""
Jul 30 15:56:41.278682 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.278660    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"]
Jul 30 15:56:41.363296 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.363267    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-home\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.363456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.363303    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tls-certs\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.363456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.363347    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-model-cache\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.363456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.363395    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-dshm\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.363576 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.363461    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tmp-dir\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.363576 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.363485    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xfmb\" (UniqueName: \"kubernetes.io/projected/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-kube-api-access-4xfmb\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464240 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464210    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-model-cache\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464240 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464244    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-dshm\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464440 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464272    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tmp-dir\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464440 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464384    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xfmb\" (UniqueName: \"kubernetes.io/projected/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-kube-api-access-4xfmb\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464538 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464503    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-home\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464581 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464537    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tls-certs\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464671 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464650    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-model-cache\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464727 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464683    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tmp-dir\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.464810 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.464794    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-home\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.466595 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.466573    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-dshm\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.466785 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.466769    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tls-certs\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.473525 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.473506    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xfmb\" (UniqueName: \"kubernetes.io/projected/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-kube-api-access-4xfmb\") pod \"test-model-9ef991-kserve-798fb788b7-xtlgt\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") " pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.573462 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.573395    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:41.713944 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:41.713916    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"]
Jul 30 15:56:41.714918 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:56:41.714891    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeea1cde2_0a7c_4caa_ad5a_6b560444b8c2.slice/crio-f3a6ac7912bb5393b42812c82769dbefb68d7b4a2ba389c4a15019c015165fa5 WatchSource:0}: Error finding container f3a6ac7912bb5393b42812c82769dbefb68d7b4a2ba389c4a15019c015165fa5: Status 404 returned error can't find the container with id f3a6ac7912bb5393b42812c82769dbefb68d7b4a2ba389c4a15019c015165fa5
Jul 30 15:56:42.582146 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:42.582115    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt" event={"ID":"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2","Type":"ContainerStarted","Data":"a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c"}
Jul 30 15:56:42.582531 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:42.582163    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt" event={"ID":"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2","Type":"ContainerStarted","Data":"f3a6ac7912bb5393b42812c82769dbefb68d7b4a2ba389c4a15019c015165fa5"}
Jul 30 15:56:42.604107 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:42.604060    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt" podStartSLOduration=1.604045443 podStartE2EDuration="1.604045443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:56:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:56:42.601497077 +0000 UTC m=+2801.207345206" watchObservedRunningTime="2026-07-30 15:56:42.604045443 +0000 UTC m=+2801.209893599"
Jul 30 15:56:51.573699 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:51.573664    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:51.574071 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:51.573736    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:51.586455 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:51.586436    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:56:51.650820 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:56:51.650797    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:58:23.700307 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:23.700274    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"]
Jul 30 15:58:24.817460 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:24.817407    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"]
Jul 30 15:58:24.821216 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:24.821191    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:24.823957 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:24.823929    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:58:24.830251 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:24.830222    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"]
Jul 30 15:58:24.913547 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:24.913515    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48c696f-e03b-4ab2-bde0-0ee63001be85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f\" (UID: \"f48c696f-e03b-4ab2-bde0-0ee63001be85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:25.014352 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:25.014323    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48c696f-e03b-4ab2-bde0-0ee63001be85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f\" (UID: \"f48c696f-e03b-4ab2-bde0-0ee63001be85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:25.014946 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:25.014923    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48c696f-e03b-4ab2-bde0-0ee63001be85-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f\" (UID: \"f48c696f-e03b-4ab2-bde0-0ee63001be85\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:25.133245 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:25.133176    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:25.274990 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:58:25.274904    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf48c696f_e03b_4ab2_bde0_0ee63001be85.slice/crio-16204c1266162bc900a7442fc8b8b149d4cbb73ac11a3d985565501ca611bfe3 WatchSource:0}: Error finding container 16204c1266162bc900a7442fc8b8b149d4cbb73ac11a3d985565501ca611bfe3: Status 404 returned error can't find the container with id 16204c1266162bc900a7442fc8b8b149d4cbb73ac11a3d985565501ca611bfe3
Jul 30 15:58:25.276400 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:25.276303    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"]
Jul 30 15:58:26.172350 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:26.172313    2553 generic.go:356] "Generic (PLEG): container finished" podID="f48c696f-e03b-4ab2-bde0-0ee63001be85" containerID="fe6070edec3e27316b4b1153d34dd6163ddb8dc4f6f89d7318a9958c40195a32" exitCode=0
Jul 30 15:58:26.172769 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:26.172401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f" event={"ID":"f48c696f-e03b-4ab2-bde0-0ee63001be85","Type":"ContainerDied","Data":"fe6070edec3e27316b4b1153d34dd6163ddb8dc4f6f89d7318a9958c40195a32"}
Jul 30 15:58:26.172769 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:26.172488    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f" event={"ID":"f48c696f-e03b-4ab2-bde0-0ee63001be85","Type":"ContainerStarted","Data":"16204c1266162bc900a7442fc8b8b149d4cbb73ac11a3d985565501ca611bfe3"}
Jul 30 15:58:27.318456 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:27.318411    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:27.335001 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:27.334979    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48c696f-e03b-4ab2-bde0-0ee63001be85-maas-api-service-ca\") pod \"f48c696f-e03b-4ab2-bde0-0ee63001be85\" (UID: \"f48c696f-e03b-4ab2-bde0-0ee63001be85\") "
Jul 30 15:58:27.335280 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:27.335259    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f48c696f-e03b-4ab2-bde0-0ee63001be85-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f48c696f-e03b-4ab2-bde0-0ee63001be85" (UID: "f48c696f-e03b-4ab2-bde0-0ee63001be85"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:58:27.435990 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:27.435923    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f48c696f-e03b-4ab2-bde0-0ee63001be85-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:28.184380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:28.184305    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f" event={"ID":"f48c696f-e03b-4ab2-bde0-0ee63001be85","Type":"ContainerDied","Data":"16204c1266162bc900a7442fc8b8b149d4cbb73ac11a3d985565501ca611bfe3"}
Jul 30 15:58:28.184380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:28.184353    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16204c1266162bc900a7442fc8b8b149d4cbb73ac11a3d985565501ca611bfe3"
Jul 30 15:58:28.184380 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:28.184355    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"
Jul 30 15:58:35.236055 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.236021    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"]
Jul 30 15:58:35.236512 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.236284    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p" podUID="f3abf248-1e42-4059-98f3-61176f3a3ed8" containerName="maas-api" containerID="cri-o://64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe" gracePeriod=30
Jul 30 15:58:35.464289 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.464247    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"]
Jul 30 15:58:35.467644 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.467620    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-9ef991-qwz2f"]
Jul 30 15:58:35.504757 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.504735    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:58:35.598209 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.598183    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3abf248-1e42-4059-98f3-61176f3a3ed8-maas-api-tls\") pod \"f3abf248-1e42-4059-98f3-61176f3a3ed8\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") "
Jul 30 15:58:35.598350 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.598262    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8twx\" (UniqueName: \"kubernetes.io/projected/f3abf248-1e42-4059-98f3-61176f3a3ed8-kube-api-access-g8twx\") pod \"f3abf248-1e42-4059-98f3-61176f3a3ed8\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") "
Jul 30 15:58:35.598410 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.598385    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3abf248-1e42-4059-98f3-61176f3a3ed8-openshift-service-ca\") pod \"f3abf248-1e42-4059-98f3-61176f3a3ed8\" (UID: \"f3abf248-1e42-4059-98f3-61176f3a3ed8\") "
Jul 30 15:58:35.598775 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.598747    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3abf248-1e42-4059-98f3-61176f3a3ed8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3abf248-1e42-4059-98f3-61176f3a3ed8" (UID: "f3abf248-1e42-4059-98f3-61176f3a3ed8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:58:35.600351 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.600322    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3abf248-1e42-4059-98f3-61176f3a3ed8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3abf248-1e42-4059-98f3-61176f3a3ed8" (UID: "f3abf248-1e42-4059-98f3-61176f3a3ed8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:58:35.600469 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.600449    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3abf248-1e42-4059-98f3-61176f3a3ed8-kube-api-access-g8twx" (OuterVolumeSpecName: "kube-api-access-g8twx") pod "f3abf248-1e42-4059-98f3-61176f3a3ed8" (UID: "f3abf248-1e42-4059-98f3-61176f3a3ed8"). InnerVolumeSpecName "kube-api-access-g8twx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:58:35.700118 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.700090    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3abf248-1e42-4059-98f3-61176f3a3ed8-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:35.700118 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.700114    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3abf248-1e42-4059-98f3-61176f3a3ed8-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:35.700263 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.700124    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8twx\" (UniqueName: \"kubernetes.io/projected/f3abf248-1e42-4059-98f3-61176f3a3ed8-kube-api-access-g8twx\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:35.925611 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:35.925583    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f48c696f-e03b-4ab2-bde0-0ee63001be85" path="/var/lib/kubelet/pods/f48c696f-e03b-4ab2-bde0-0ee63001be85/volumes"
Jul 30 15:58:36.235145 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.235069    2553 generic.go:356] "Generic (PLEG): container finished" podID="f3abf248-1e42-4059-98f3-61176f3a3ed8" containerID="64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe" exitCode=0
Jul 30 15:58:36.235145 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.235116    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"
Jul 30 15:58:36.235350 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.235150    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p" event={"ID":"f3abf248-1e42-4059-98f3-61176f3a3ed8","Type":"ContainerDied","Data":"64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe"}
Jul 30 15:58:36.235350 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.235201    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p" event={"ID":"f3abf248-1e42-4059-98f3-61176f3a3ed8","Type":"ContainerDied","Data":"5e06360d1c99a0315b2fd5b023f5d0e152f6f1042c697c887b37b1f1c99d8a23"}
Jul 30 15:58:36.235350 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.235223    2553 scope.go:117] "RemoveContainer" containerID="64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe"
Jul 30 15:58:36.246914 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.246730    2553 scope.go:117] "RemoveContainer" containerID="64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe"
Jul 30 15:58:36.247126 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:58:36.246967    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe\": container with ID starting with 64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe not found: ID does not exist" containerID="64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe"
Jul 30 15:58:36.247126 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.246992    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe"} err="failed to get container status \"64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe\": rpc error: code = NotFound desc = could not find container \"64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe\": container with ID starting with 64b10d8c344bbbfb1761231e2c61eb91aac803b1860871f853af9188639c51fe not found: ID does not exist"
Jul 30 15:58:36.256552 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.256528    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"]
Jul 30 15:58:36.269070 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:36.264582    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-9ef991-555668c9f9-fsn2p"]
Jul 30 15:58:37.924664 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:37.924632    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3abf248-1e42-4059-98f3-61176f3a3ed8" path="/var/lib/kubelet/pods/f3abf248-1e42-4059-98f3-61176f3a3ed8/volumes"
Jul 30 15:58:38.719628 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:38.719587    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt" podUID="eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" containerName="main" containerID="cri-o://a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c" gracePeriod=45
Jul 30 15:58:38.976064 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:38.976004    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:58:39.028438 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028389    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-dshm\") pod \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") "
Jul 30 15:58:39.028545 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028513    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-model-cache\") pod \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") "
Jul 30 15:58:39.028591 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028554    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tls-certs\") pod \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") "
Jul 30 15:58:39.028627 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028595    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tmp-dir\") pod \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") "
Jul 30 15:58:39.028627 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028612    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xfmb\" (UniqueName: \"kubernetes.io/projected/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-kube-api-access-4xfmb\") pod \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") "
Jul 30 15:58:39.028691 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028636    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-home\") pod \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\" (UID: \"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2\") "
Jul 30 15:58:39.028838 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028813    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" (UID: "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:58:39.028917 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028850    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" (UID: "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:58:39.028980 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028961    2553 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-model-cache\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:39.028980 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028975    2553 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tmp-dir\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:39.029061 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.028984    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-home" (OuterVolumeSpecName: "home") pod "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" (UID: "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:58:39.030507 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.030488    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-dshm" (OuterVolumeSpecName: "dshm") pod "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" (UID: "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 15:58:39.030586 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.030567    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" (UID: "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:58:39.030692 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.030676    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-kube-api-access-4xfmb" (OuterVolumeSpecName: "kube-api-access-4xfmb") pod "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" (UID: "eea1cde2-0a7c-4caa-ad5a-6b560444b8c2"). InnerVolumeSpecName "kube-api-access-4xfmb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:58:39.129681 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.129657    2553 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-tls-certs\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:39.129681 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.129679    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xfmb\" (UniqueName: \"kubernetes.io/projected/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-kube-api-access-4xfmb\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:39.129817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.129688    2553 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-home\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:39.129817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.129712    2553 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2-dshm\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:39.254312 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.254246    2553 generic.go:356] "Generic (PLEG): container finished" podID="eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" containerID="a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c" exitCode=0
Jul 30 15:58:39.254312 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.254286    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"
Jul 30 15:58:39.254486 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.254330    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt" event={"ID":"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2","Type":"ContainerDied","Data":"a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c"}
Jul 30 15:58:39.254486 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.254377    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt" event={"ID":"eea1cde2-0a7c-4caa-ad5a-6b560444b8c2","Type":"ContainerDied","Data":"f3a6ac7912bb5393b42812c82769dbefb68d7b4a2ba389c4a15019c015165fa5"}
Jul 30 15:58:39.254486 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.254398    2553 scope.go:117] "RemoveContainer" containerID="a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c"
Jul 30 15:58:39.263572 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.263553    2553 scope.go:117] "RemoveContainer" containerID="a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c"
Jul 30 15:58:39.263821 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:58:39.263804    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c\": container with ID starting with a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c not found: ID does not exist" containerID="a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c"
Jul 30 15:58:39.263863 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.263830    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c"} err="failed to get container status \"a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c\": rpc error: code = NotFound desc = could not find container \"a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c\": container with ID starting with a81aaa2f7fb6495238b3eb74693748fd6866b726284bfd0e0d5e0a848280dd6c not found: ID does not exist"
Jul 30 15:58:39.280690 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.280668    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"]
Jul 30 15:58:39.288360 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.288339    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-9ef991/test-model-9ef991-kserve-798fb788b7-xtlgt"]
Jul 30 15:58:39.924536 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:39.924509    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" path="/var/lib/kubelet/pods/eea1cde2-0a7c-4caa-ad5a-6b560444b8c2/volumes"
Jul 30 15:58:42.365204 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365163    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"]
Jul 30 15:58:42.365821 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365801    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f48c696f-e03b-4ab2-bde0-0ee63001be85" containerName="revoke-keys"
Jul 30 15:58:42.365929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365824    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f48c696f-e03b-4ab2-bde0-0ee63001be85" containerName="revoke-keys"
Jul 30 15:58:42.365929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365854    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" containerName="main"
Jul 30 15:58:42.365929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365863    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" containerName="main"
Jul 30 15:58:42.365929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365875    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3abf248-1e42-4059-98f3-61176f3a3ed8" containerName="maas-api"
Jul 30 15:58:42.365929 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365884    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3abf248-1e42-4059-98f3-61176f3a3ed8" containerName="maas-api"
Jul 30 15:58:42.366159 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.365993    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f48c696f-e03b-4ab2-bde0-0ee63001be85" containerName="revoke-keys"
Jul 30 15:58:42.366159 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.366009    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3abf248-1e42-4059-98f3-61176f3a3ed8" containerName="maas-api"
Jul 30 15:58:42.366159 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.366020    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="eea1cde2-0a7c-4caa-ad5a-6b560444b8c2" containerName="main"
Jul 30 15:58:42.369154 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.369131    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:42.373513 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.373489    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 15:58:42.390517 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.390478    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"]
Jul 30 15:58:42.459235 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.459203    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-762215-mzw86\" (UID: \"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:42.560049 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.560017    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-762215-mzw86\" (UID: \"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:42.560641 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.560622    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-762215-mzw86\" (UID: \"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:42.679218 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.679176    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:42.832824 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:58:42.832798    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa03ff5b_86c7_46e2_b70f_d9a6c9b5df53.slice/crio-26713080ca4d14d8bc16ffeeeb6bd108b5b9bf1878ddab4aa5227fe10300f920 WatchSource:0}: Error finding container 26713080ca4d14d8bc16ffeeeb6bd108b5b9bf1878ddab4aa5227fe10300f920: Status 404 returned error can't find the container with id 26713080ca4d14d8bc16ffeeeb6bd108b5b9bf1878ddab4aa5227fe10300f920
Jul 30 15:58:42.832934 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:42.832898    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"]
Jul 30 15:58:43.279809 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:43.279722    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86" event={"ID":"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53","Type":"ContainerStarted","Data":"977dcd67d85e0f605f5b4721127f50b9e6fdc8320539d697b962c25b91e4709d"}
Jul 30 15:58:43.279809 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:43.279786    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86" event={"ID":"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53","Type":"ContainerStarted","Data":"26713080ca4d14d8bc16ffeeeb6bd108b5b9bf1878ddab4aa5227fe10300f920"}
Jul 30 15:58:43.297751 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:43.297697    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86" podStartSLOduration=1.297679839 podStartE2EDuration="1.297679839s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:58:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:58:43.297222105 +0000 UTC m=+2921.903070213" watchObservedRunningTime="2026-07-30 15:58:43.297679839 +0000 UTC m=+2921.903527942"
Jul 30 15:58:44.288298 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:44.288264    2553 generic.go:356] "Generic (PLEG): container finished" podID="fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53" containerID="977dcd67d85e0f605f5b4721127f50b9e6fdc8320539d697b962c25b91e4709d" exitCode=0
Jul 30 15:58:44.288709 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:44.288337    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86" event={"ID":"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53","Type":"ContainerDied","Data":"977dcd67d85e0f605f5b4721127f50b9e6fdc8320539d697b962c25b91e4709d"}
Jul 30 15:58:45.431342 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:45.431317    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:45.485841 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:45.485813    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53-maas-api-service-ca\") pod \"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53\" (UID: \"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53\") "
Jul 30 15:58:45.486198 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:45.486177    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53" (UID: "fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:58:45.586767 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:45.586705    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:46.300839 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:46.300769    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"
Jul 30 15:58:46.300977 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:46.300769    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86" event={"ID":"fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53","Type":"ContainerDied","Data":"26713080ca4d14d8bc16ffeeeb6bd108b5b9bf1878ddab4aa5227fe10300f920"}
Jul 30 15:58:46.300977 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:46.300899    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26713080ca4d14d8bc16ffeeeb6bd108b5b9bf1878ddab4aa5227fe10300f920"
Jul 30 15:58:52.764771 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:52.764732    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"]
Jul 30 15:58:52.765248 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:52.764960    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" podUID="16bbe166-65e4-43f5-924e-c1d5623f2127" containerName="maas-api" containerID="cri-o://f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f" gracePeriod=30
Jul 30 15:58:52.844320 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:52.844286    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"]
Jul 30 15:58:52.844560 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:52.844514    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" podUID="6738602e-69ed-4212-8d04-446814e76d2f" containerName="payload-pre-processing" containerID="cri-o://20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547" gracePeriod=30
Jul 30 15:58:52.994493 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:52.994412    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"]
Jul 30 15:58:52.998261 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:52.998231    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-762215-mzw86"]
Jul 30 15:58:53.128703 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.128675    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:58:53.234226 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.234204    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:58:53.258581 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.258555    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6738602e-69ed-4212-8d04-446814e76d2f-plugins-config-volume\") pod \"6738602e-69ed-4212-8d04-446814e76d2f\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") "
Jul 30 15:58:53.258946 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.258910    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6738602e-69ed-4212-8d04-446814e76d2f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6738602e-69ed-4212-8d04-446814e76d2f" (UID: "6738602e-69ed-4212-8d04-446814e76d2f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:58:53.259065 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.259001    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc5jl\" (UniqueName: \"kubernetes.io/projected/6738602e-69ed-4212-8d04-446814e76d2f-kube-api-access-vc5jl\") pod \"6738602e-69ed-4212-8d04-446814e76d2f\" (UID: \"6738602e-69ed-4212-8d04-446814e76d2f\") "
Jul 30 15:58:53.259319 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.259300    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6738602e-69ed-4212-8d04-446814e76d2f-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:53.261600 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.261567    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6738602e-69ed-4212-8d04-446814e76d2f-kube-api-access-vc5jl" (OuterVolumeSpecName: "kube-api-access-vc5jl") pod "6738602e-69ed-4212-8d04-446814e76d2f" (UID: "6738602e-69ed-4212-8d04-446814e76d2f"). InnerVolumeSpecName "kube-api-access-vc5jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:58:53.342588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.342507    2553 generic.go:356] "Generic (PLEG): container finished" podID="6738602e-69ed-4212-8d04-446814e76d2f" containerID="20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547" exitCode=0
Jul 30 15:58:53.342588 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.342557    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"
Jul 30 15:58:53.342788 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.342587    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" event={"ID":"6738602e-69ed-4212-8d04-446814e76d2f","Type":"ContainerDied","Data":"20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547"}
Jul 30 15:58:53.342788 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.342641    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t" event={"ID":"6738602e-69ed-4212-8d04-446814e76d2f","Type":"ContainerDied","Data":"f9ce1b93269fb853859ecdca56ada8a71d540eddcb7d6fc717e2dd74f1ff4cc0"}
Jul 30 15:58:53.342788 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.342674    2553 scope.go:117] "RemoveContainer" containerID="20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547"
Jul 30 15:58:53.343925 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.343906    2553 generic.go:356] "Generic (PLEG): container finished" podID="16bbe166-65e4-43f5-924e-c1d5623f2127" containerID="f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f" exitCode=0
Jul 30 15:58:53.344034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.343953    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"
Jul 30 15:58:53.344034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.343983    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" event={"ID":"16bbe166-65e4-43f5-924e-c1d5623f2127","Type":"ContainerDied","Data":"f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f"}
Jul 30 15:58:53.344034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.344025    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj" event={"ID":"16bbe166-65e4-43f5-924e-c1d5623f2127","Type":"ContainerDied","Data":"c3e80be9628e39970c2e1183b7feceea4e6e3b3466e94b4ae182324462680272"}
Jul 30 15:58:53.353701 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.353670    2553 scope.go:117] "RemoveContainer" containerID="20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547"
Jul 30 15:58:53.353955 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:58:53.353937    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547\": container with ID starting with 20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547 not found: ID does not exist" containerID="20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547"
Jul 30 15:58:53.354019 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.353964    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547"} err="failed to get container status \"20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547\": rpc error: code = NotFound desc = could not find container \"20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547\": container with ID starting with 20bb87426a9c0b7f7881392a7c3f90273cd5bdc5586b1338a5d172435336e547 not found: ID does not exist"
Jul 30 15:58:53.354019 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.353978    2553 scope.go:117] "RemoveContainer" containerID="f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f"
Jul 30 15:58:53.364469 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.364414    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls\") pod \"16bbe166-65e4-43f5-924e-c1d5623f2127\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") "
Jul 30 15:58:53.364593 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.364485    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-258wl\" (UniqueName: \"kubernetes.io/projected/16bbe166-65e4-43f5-924e-c1d5623f2127-kube-api-access-258wl\") pod \"16bbe166-65e4-43f5-924e-c1d5623f2127\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") "
Jul 30 15:58:53.364720 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.364688    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16bbe166-65e4-43f5-924e-c1d5623f2127-openshift-service-ca\") pod \"16bbe166-65e4-43f5-924e-c1d5623f2127\" (UID: \"16bbe166-65e4-43f5-924e-c1d5623f2127\") "
Jul 30 15:58:53.364908 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.364886    2553 scope.go:117] "RemoveContainer" containerID="f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f"
Jul 30 15:58:53.365118 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.365046    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc5jl\" (UniqueName: \"kubernetes.io/projected/6738602e-69ed-4212-8d04-446814e76d2f-kube-api-access-vc5jl\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:53.365298 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:58:53.365259    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f\": container with ID starting with f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f not found: ID does not exist" containerID="f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f"
Jul 30 15:58:53.365298 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.365275    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16bbe166-65e4-43f5-924e-c1d5623f2127-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "16bbe166-65e4-43f5-924e-c1d5623f2127" (UID: "16bbe166-65e4-43f5-924e-c1d5623f2127"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 15:58:53.365497 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.365296    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f"} err="failed to get container status \"f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f\": rpc error: code = NotFound desc = could not find container \"f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f\": container with ID starting with f4efb3903f9a7634511e9a14edf5a6dbe288d55a16c74ea5ee6c00c8722a572f not found: ID does not exist"
Jul 30 15:58:53.366838 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.366816    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "16bbe166-65e4-43f5-924e-c1d5623f2127" (UID: "16bbe166-65e4-43f5-924e-c1d5623f2127"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 15:58:53.367026 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.367011    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16bbe166-65e4-43f5-924e-c1d5623f2127-kube-api-access-258wl" (OuterVolumeSpecName: "kube-api-access-258wl") pod "16bbe166-65e4-43f5-924e-c1d5623f2127" (UID: "16bbe166-65e4-43f5-924e-c1d5623f2127"). InnerVolumeSpecName "kube-api-access-258wl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 15:58:53.369305 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.369285    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"]
Jul 30 15:58:53.374761 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.374740    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-762215-79f895b7b-lvk5t"]
Jul 30 15:58:53.466517 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.466487    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/16bbe166-65e4-43f5-924e-c1d5623f2127-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:53.466517 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.466514    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-258wl\" (UniqueName: \"kubernetes.io/projected/16bbe166-65e4-43f5-924e-c1d5623f2127-kube-api-access-258wl\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:53.466517 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.466525    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/16bbe166-65e4-43f5-924e-c1d5623f2127-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 15:58:53.666301 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.666272    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"]
Jul 30 15:58:53.671453 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.671428    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-762215-7f9bcfdd94-vc6qj"]
Jul 30 15:58:53.923954 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.923922    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16bbe166-65e4-43f5-924e-c1d5623f2127" path="/var/lib/kubelet/pods/16bbe166-65e4-43f5-924e-c1d5623f2127/volumes"
Jul 30 15:58:53.924302 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.924288    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6738602e-69ed-4212-8d04-446814e76d2f" path="/var/lib/kubelet/pods/6738602e-69ed-4212-8d04-446814e76d2f/volumes"
Jul 30 15:58:53.924605 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:58:53.924592    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53" path="/var/lib/kubelet/pods/fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53/volumes"
Jul 30 15:59:04.294356 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294319    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"]
Jul 30 15:59:04.294837 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294820    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53" containerName="revoke-keys"
Jul 30 15:59:04.294885 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294840    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53" containerName="revoke-keys"
Jul 30 15:59:04.294885 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294849    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16bbe166-65e4-43f5-924e-c1d5623f2127" containerName="maas-api"
Jul 30 15:59:04.294885 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294855    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="16bbe166-65e4-43f5-924e-c1d5623f2127" containerName="maas-api"
Jul 30 15:59:04.294885 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294870    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6738602e-69ed-4212-8d04-446814e76d2f" containerName="payload-pre-processing"
Jul 30 15:59:04.294885 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294876    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6738602e-69ed-4212-8d04-446814e76d2f" containerName="payload-pre-processing"
Jul 30 15:59:04.295034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294953    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6738602e-69ed-4212-8d04-446814e76d2f" containerName="payload-pre-processing"
Jul 30 15:59:04.295034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294961    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa03ff5b-86c7-46e2-b70f-d9a6c9b5df53" containerName="revoke-keys"
Jul 30 15:59:04.295034 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.294968    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="16bbe166-65e4-43f5-924e-c1d5623f2127" containerName="maas-api"
Jul 30 15:59:04.299842 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.299820    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.302428 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.302393    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-51545f-serving-cert\""
Jul 30 15:59:04.311726 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.311700    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"]
Jul 30 15:59:04.361806 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.361776    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d42tf\" (UniqueName: \"kubernetes.io/projected/a2675169-b12b-400d-98fd-f66b65802201-kube-api-access-d42tf\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.361936 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.361861    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2675169-b12b-400d-98fd-f66b65802201-maas-api-tls\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.361987 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.361969    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2675169-b12b-400d-98fd-f66b65802201-openshift-service-ca\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.463152 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.463121    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2675169-b12b-400d-98fd-f66b65802201-maas-api-tls\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.463275 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.463189    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2675169-b12b-400d-98fd-f66b65802201-openshift-service-ca\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.463275 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.463221    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d42tf\" (UniqueName: \"kubernetes.io/projected/a2675169-b12b-400d-98fd-f66b65802201-kube-api-access-d42tf\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.463831 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.463813    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2675169-b12b-400d-98fd-f66b65802201-openshift-service-ca\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.465515 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.465494    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2675169-b12b-400d-98fd-f66b65802201-maas-api-tls\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.472160 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.472136    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d42tf\" (UniqueName: \"kubernetes.io/projected/a2675169-b12b-400d-98fd-f66b65802201-kube-api-access-d42tf\") pod \"maas-api-e2e-api-a-51545f-855c675d7f-6cq68\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.612133 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.612051    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:04.749959 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.749929    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"]
Jul 30 15:59:04.755037 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:59:04.755009    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2675169_b12b_400d_98fd_f66b65802201.slice/crio-d1f253588f697ffc7c6d63489a58e20a25e69f51a08c309949a380badaf32293 WatchSource:0}: Error finding container d1f253588f697ffc7c6d63489a58e20a25e69f51a08c309949a380badaf32293: Status 404 returned error can't find the container with id d1f253588f697ffc7c6d63489a58e20a25e69f51a08c309949a380badaf32293
Jul 30 15:59:04.756539 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:04.756516    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 15:59:05.419432 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:05.419386    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68" event={"ID":"a2675169-b12b-400d-98fd-f66b65802201","Type":"ContainerStarted","Data":"27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7"}
Jul 30 15:59:05.419906 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:05.419458    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68" event={"ID":"a2675169-b12b-400d-98fd-f66b65802201","Type":"ContainerStarted","Data":"d1f253588f697ffc7c6d63489a58e20a25e69f51a08c309949a380badaf32293"}
Jul 30 15:59:05.419906 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:05.419548    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:05.439817 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:05.439767    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68" podStartSLOduration=0.892507569 podStartE2EDuration="1.439754068s" totalImagesPullingTime="547.246499ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:59:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:59:05.439356072 +0000 UTC m=+2944.045204176" watchObservedRunningTime="2026-07-30 15:59:05.439754068 +0000 UTC m=+2944.045602170"
Jul 30 15:59:11.432537 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:11.432510    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 15:59:33.456414 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.456329    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"]
Jul 30 15:59:33.460187 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.460163    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.463695 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.463678    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-985263-serving-cert\""
Jul 30 15:59:33.477206 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.477178    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"]
Jul 30 15:59:33.615211 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.615180    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da586d4d-1506-4e86-9a6d-1c64c5b81402-openshift-service-ca\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.615390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.615330    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zld9\" (UniqueName: \"kubernetes.io/projected/da586d4d-1506-4e86-9a6d-1c64c5b81402-kube-api-access-9zld9\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.615390 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.615361    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.716669 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.716603    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zld9\" (UniqueName: \"kubernetes.io/projected/da586d4d-1506-4e86-9a6d-1c64c5b81402-kube-api-access-9zld9\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.716669 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.716636    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.716870 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.716672    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da586d4d-1506-4e86-9a6d-1c64c5b81402-openshift-service-ca\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.716870 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:59:33.716775    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-985263-serving-cert: secret "maas-api-e2e-api-b-985263-serving-cert" not found
Jul 30 15:59:33.716870 ip-10-0-138-79 kubenswrapper[2553]: E0730 15:59:33.716855    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls podName:da586d4d-1506-4e86-9a6d-1c64c5b81402 nodeName:}" failed. No retries permitted until 2026-07-30 15:59:34.216831628 +0000 UTC m=+2972.822679712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls") pod "maas-api-e2e-api-b-985263-7898567665-mfrs2" (UID: "da586d4d-1506-4e86-9a6d-1c64c5b81402") : secret "maas-api-e2e-api-b-985263-serving-cert" not found
Jul 30 15:59:33.717300 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.717281    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da586d4d-1506-4e86-9a6d-1c64c5b81402-openshift-service-ca\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:33.726949 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:33.726928    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zld9\" (UniqueName: \"kubernetes.io/projected/da586d4d-1506-4e86-9a6d-1c64c5b81402-kube-api-access-9zld9\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:34.221159 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:34.221126    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:34.223649 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:34.223627    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls\") pod \"maas-api-e2e-api-b-985263-7898567665-mfrs2\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:34.371013 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:34.370982    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:34.529441 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:34.529400    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"]
Jul 30 15:59:34.530540 ip-10-0-138-79 kubenswrapper[2553]: W0730 15:59:34.530516    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda586d4d_1506_4e86_9a6d_1c64c5b81402.slice/crio-09dd735d8a16d69ebc92312830519c60efc8ce8fff0ba9e4f9308a576191c243 WatchSource:0}: Error finding container 09dd735d8a16d69ebc92312830519c60efc8ce8fff0ba9e4f9308a576191c243: Status 404 returned error can't find the container with id 09dd735d8a16d69ebc92312830519c60efc8ce8fff0ba9e4f9308a576191c243
Jul 30 15:59:34.589927 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:34.589891    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2" event={"ID":"da586d4d-1506-4e86-9a6d-1c64c5b81402","Type":"ContainerStarted","Data":"09dd735d8a16d69ebc92312830519c60efc8ce8fff0ba9e4f9308a576191c243"}
Jul 30 15:59:35.596982 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:35.596949    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2" event={"ID":"da586d4d-1506-4e86-9a6d-1c64c5b81402","Type":"ContainerStarted","Data":"78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59"}
Jul 30 15:59:35.597370 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:35.597037    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 15:59:35.619790 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:35.619750    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2" podStartSLOduration=1.638955194 podStartE2EDuration="2.61973667s" totalImagesPullingTime="980.781476ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 15:59:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 15:59:35.617338024 +0000 UTC m=+2974.223186127" watchObservedRunningTime="2026-07-30 15:59:35.61973667 +0000 UTC m=+2974.225584773"
Jul 30 15:59:41.614245 ip-10-0-138-79 kubenswrapper[2553]: I0730 15:59:41.614216    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 16:00:00.147372 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.147332    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"]
Jul 30 16:00:00.151785 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.151757    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"]
Jul 30 16:00:00.151935 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.151856    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"
Jul 30 16:00:00.154671 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.154649    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 16:00:00.155702 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.155682    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"]
Jul 30 16:00:00.155908 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.155886    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"
Jul 30 16:00:00.160009 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.159992    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"]
Jul 30 16:00:00.160128 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.160065    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"
Jul 30 16:00:00.167067 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.166975    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"
Jul 30 16:00:00.170113 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.169693    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"]
Jul 30 16:00:00.176031 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.171640    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"]
Jul 30 16:00:00.180090 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.180071    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"
Jul 30 16:00:00.222159 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.222134    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"
Jul 30 16:00:00.355016 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.354981    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"]
Jul 30 16:00:00.357275 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:00:00.357243    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12629ef1_f131_44f5_aa56_b18721902dfc.slice/crio-2b0f0bec9e5207b76a45b613fd76cf451eaf1714dc1a2df7a3622cbea605ad2e WatchSource:0}: Error finding container 2b0f0bec9e5207b76a45b613fd76cf451eaf1714dc1a2df7a3622cbea605ad2e: Status 404 returned error can't find the container with id 2b0f0bec9e5207b76a45b613fd76cf451eaf1714dc1a2df7a3622cbea605ad2e
Jul 30 16:00:00.426084 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.426061    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"]
Jul 30 16:00:00.426796 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:00:00.426768    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35e8e36e_6a65_4b88_bc31_2b04d00f88bb.slice/crio-a54c7cbd95f57b8921d83bd1932f4d4834af4696b7527774b4cb40ece9ba7200 WatchSource:0}: Error finding container a54c7cbd95f57b8921d83bd1932f4d4834af4696b7527774b4cb40ece9ba7200: Status 404 returned error can't find the container with id a54c7cbd95f57b8921d83bd1932f4d4834af4696b7527774b4cb40ece9ba7200
Jul 30 16:00:00.594395 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.594366    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"]
Jul 30 16:00:00.594768 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:00:00.594743    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67b534c8_9b6e_40d0_815a_94bf5fa6b6d0.slice/crio-e4c242de6e9c246754efd63380ff9a391eaba6a215aa31a30963055231b5be7f WatchSource:0}: Error finding container e4c242de6e9c246754efd63380ff9a391eaba6a215aa31a30963055231b5be7f: Status 404 returned error can't find the container with id e4c242de6e9c246754efd63380ff9a391eaba6a215aa31a30963055231b5be7f
Jul 30 16:00:00.608511 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.608484    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"]
Jul 30 16:00:00.612773 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.612743    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:00.622441 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.622086    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"]
Jul 30 16:00:00.638032 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.638010    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87ee14c8-a48f-4cd3-b120-12e75f14ca87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-51545f-ftmrl\" (UID: \"87ee14c8-a48f-4cd3-b120-12e75f14ca87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:00.738772 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.738743    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87ee14c8-a48f-4cd3-b120-12e75f14ca87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-51545f-ftmrl\" (UID: \"87ee14c8-a48f-4cd3-b120-12e75f14ca87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:00.739360 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.739340    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87ee14c8-a48f-4cd3-b120-12e75f14ca87-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-51545f-ftmrl\" (UID: \"87ee14c8-a48f-4cd3-b120-12e75f14ca87\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:00.740893 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.740867    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r" event={"ID":"35e8e36e-6a65-4b88-bc31-2b04d00f88bb","Type":"ContainerStarted","Data":"a54c7cbd95f57b8921d83bd1932f4d4834af4696b7527774b4cb40ece9ba7200"}
Jul 30 16:00:00.742187 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.742162    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw" event={"ID":"67b534c8-9b6e-40d0-815a-94bf5fa6b6d0","Type":"ContainerStarted","Data":"e4c242de6e9c246754efd63380ff9a391eaba6a215aa31a30963055231b5be7f"}
Jul 30 16:00:00.743696 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.743672    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp" event={"ID":"12629ef1-f131-44f5-aa56-b18721902dfc","Type":"ContainerStarted","Data":"d282a05238d8f48804509a76ceb8ee3b3ea0bc43339d95ff658418f4b8aaaa0c"}
Jul 30 16:00:00.743784 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.743718    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp" event={"ID":"12629ef1-f131-44f5-aa56-b18721902dfc","Type":"ContainerStarted","Data":"2b0f0bec9e5207b76a45b613fd76cf451eaf1714dc1a2df7a3622cbea605ad2e"}
Jul 30 16:00:00.763139 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.763095    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp" podStartSLOduration=0.763082388 podStartE2EDuration="763.082388ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:00:00.76231255 +0000 UTC m=+2999.368160644" watchObservedRunningTime="2026-07-30 16:00:00.763082388 +0000 UTC m=+2999.368930490"
Jul 30 16:00:00.939631 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:00.939565    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:01.117662 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.117638    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"]
Jul 30 16:00:01.117958 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:00:01.117935    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87ee14c8_a48f_4cd3_b120_12e75f14ca87.slice/crio-29536951aa69fce1569922b66e542c09b92e29a7931403e29e24032aa2297f81 WatchSource:0}: Error finding container 29536951aa69fce1569922b66e542c09b92e29a7931403e29e24032aa2297f81: Status 404 returned error can't find the container with id 29536951aa69fce1569922b66e542c09b92e29a7931403e29e24032aa2297f81
Jul 30 16:00:01.751372 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.751343    2553 generic.go:356] "Generic (PLEG): container finished" podID="12629ef1-f131-44f5-aa56-b18721902dfc" containerID="d282a05238d8f48804509a76ceb8ee3b3ea0bc43339d95ff658418f4b8aaaa0c" exitCode=0
Jul 30 16:00:01.751788 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.751411    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp" event={"ID":"12629ef1-f131-44f5-aa56-b18721902dfc","Type":"ContainerDied","Data":"d282a05238d8f48804509a76ceb8ee3b3ea0bc43339d95ff658418f4b8aaaa0c"}
Jul 30 16:00:01.753294 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.753274    2553 generic.go:356] "Generic (PLEG): container finished" podID="35e8e36e-6a65-4b88-bc31-2b04d00f88bb" containerID="2f829e5ba41daf1326f54349ef2943b517300101cdeebfcc22746a5009607ec3" exitCode=0
Jul 30 16:00:01.753446 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.753363    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r" event={"ID":"35e8e36e-6a65-4b88-bc31-2b04d00f88bb","Type":"ContainerDied","Data":"2f829e5ba41daf1326f54349ef2943b517300101cdeebfcc22746a5009607ec3"}
Jul 30 16:00:01.755123 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.755101    2553 generic.go:356] "Generic (PLEG): container finished" podID="67b534c8-9b6e-40d0-815a-94bf5fa6b6d0" containerID="51bd2f23ab13466aeee4ddff4386755635b1102970700a23cb27959567b118fb" exitCode=0
Jul 30 16:00:01.755229 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.755166    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw" event={"ID":"67b534c8-9b6e-40d0-815a-94bf5fa6b6d0","Type":"ContainerDied","Data":"51bd2f23ab13466aeee4ddff4386755635b1102970700a23cb27959567b118fb"}
Jul 30 16:00:01.756895 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.756861    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl" event={"ID":"87ee14c8-a48f-4cd3-b120-12e75f14ca87","Type":"ContainerStarted","Data":"00182aeeb94896d51b4c087257918f5cda253e6685a3c81f79f3d6015ec8bc1c"}
Jul 30 16:00:01.756992 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.756910    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl" event={"ID":"87ee14c8-a48f-4cd3-b120-12e75f14ca87","Type":"ContainerStarted","Data":"29536951aa69fce1569922b66e542c09b92e29a7931403e29e24032aa2297f81"}
Jul 30 16:00:01.841728 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:01.841627    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl" podStartSLOduration=1.84161062 podStartE2EDuration="1.84161062s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:00:01.840057026 +0000 UTC m=+3000.445905141" watchObservedRunningTime="2026-07-30 16:00:01.84161062 +0000 UTC m=+3000.447458722"
Jul 30 16:00:02.108690 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.108612    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:00:02.125469 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.125435    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:00:02.346373 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.346339    2553 scope.go:117] "RemoveContainer" containerID="3d94d0aec70c6ef1798482bb1868f689acc9cffcd04a5c1dbb9770b09f2488b5"
Jul 30 16:00:02.764607 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.764574    2553 generic.go:356] "Generic (PLEG): container finished" podID="87ee14c8-a48f-4cd3-b120-12e75f14ca87" containerID="00182aeeb94896d51b4c087257918f5cda253e6685a3c81f79f3d6015ec8bc1c" exitCode=0
Jul 30 16:00:02.764997 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.764632    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl" event={"ID":"87ee14c8-a48f-4cd3-b120-12e75f14ca87","Type":"ContainerDied","Data":"00182aeeb94896d51b4c087257918f5cda253e6685a3c81f79f3d6015ec8bc1c"}
Jul 30 16:00:02.942350 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.942325    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"
Jul 30 16:00:02.944742 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.944721    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"
Jul 30 16:00:02.984693 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:02.984668    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"
Jul 30 16:00:03.771393 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.771361    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp"
Jul 30 16:00:03.771393 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.771369    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757120-pv6rp" event={"ID":"12629ef1-f131-44f5-aa56-b18721902dfc","Type":"ContainerDied","Data":"2b0f0bec9e5207b76a45b613fd76cf451eaf1714dc1a2df7a3622cbea605ad2e"}
Jul 30 16:00:03.771901 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.771447    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2b0f0bec9e5207b76a45b613fd76cf451eaf1714dc1a2df7a3622cbea605ad2e"
Jul 30 16:00:03.772764 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.772745    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"
Jul 30 16:00:03.772875 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.772778    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r" event={"ID":"35e8e36e-6a65-4b88-bc31-2b04d00f88bb","Type":"ContainerDied","Data":"a54c7cbd95f57b8921d83bd1932f4d4834af4696b7527774b4cb40ece9ba7200"}
Jul 30 16:00:03.772875 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.772827    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a54c7cbd95f57b8921d83bd1932f4d4834af4696b7527774b4cb40ece9ba7200"
Jul 30 16:00:03.773980 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.773965    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"
Jul 30 16:00:03.774068 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.774014    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw" event={"ID":"67b534c8-9b6e-40d0-815a-94bf5fa6b6d0","Type":"ContainerDied","Data":"e4c242de6e9c246754efd63380ff9a391eaba6a215aa31a30963055231b5be7f"}
Jul 30 16:00:03.774068 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.774050    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e4c242de6e9c246754efd63380ff9a391eaba6a215aa31a30963055231b5be7f"
Jul 30 16:00:03.900495 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.900473    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:03.968908 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.968885    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87ee14c8-a48f-4cd3-b120-12e75f14ca87-maas-api-service-ca\") pod \"87ee14c8-a48f-4cd3-b120-12e75f14ca87\" (UID: \"87ee14c8-a48f-4cd3-b120-12e75f14ca87\") "
Jul 30 16:00:03.969224 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:03.969202    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87ee14c8-a48f-4cd3-b120-12e75f14ca87-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87ee14c8-a48f-4cd3-b120-12e75f14ca87" (UID: "87ee14c8-a48f-4cd3-b120-12e75f14ca87"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:00:04.069536 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:04.069466    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87ee14c8-a48f-4cd3-b120-12e75f14ca87-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:04.781811 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:04.781786    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"
Jul 30 16:00:04.782183 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:04.781775    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl" event={"ID":"87ee14c8-a48f-4cd3-b120-12e75f14ca87","Type":"ContainerDied","Data":"29536951aa69fce1569922b66e542c09b92e29a7931403e29e24032aa2297f81"}
Jul 30 16:00:04.782183 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:04.781910    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="29536951aa69fce1569922b66e542c09b92e29a7931403e29e24032aa2297f81"
Jul 30 16:00:16.003948 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.003906    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"]
Jul 30 16:00:16.004404 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.004152    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68" podUID="a2675169-b12b-400d-98fd-f66b65802201" containerName="maas-api" containerID="cri-o://27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7" gracePeriod=30
Jul 30 16:00:16.029953 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.029928    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"]
Jul 30 16:00:16.032528 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.032508    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-51545f-29757120-8vhsw"]
Jul 30 16:00:16.194850 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.194817    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"]
Jul 30 16:00:16.198482 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.198453    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-51545f-ftmrl"]
Jul 30 16:00:16.265555 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.265502    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 16:00:16.374387 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.374357    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2675169-b12b-400d-98fd-f66b65802201-openshift-service-ca\") pod \"a2675169-b12b-400d-98fd-f66b65802201\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") "
Jul 30 16:00:16.374568 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.374532    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d42tf\" (UniqueName: \"kubernetes.io/projected/a2675169-b12b-400d-98fd-f66b65802201-kube-api-access-d42tf\") pod \"a2675169-b12b-400d-98fd-f66b65802201\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") "
Jul 30 16:00:16.374568 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.374566    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2675169-b12b-400d-98fd-f66b65802201-maas-api-tls\") pod \"a2675169-b12b-400d-98fd-f66b65802201\" (UID: \"a2675169-b12b-400d-98fd-f66b65802201\") "
Jul 30 16:00:16.377034 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.374794    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2675169-b12b-400d-98fd-f66b65802201-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a2675169-b12b-400d-98fd-f66b65802201" (UID: "a2675169-b12b-400d-98fd-f66b65802201"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:00:16.377034 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.374902    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a2675169-b12b-400d-98fd-f66b65802201-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:16.378601 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.378572    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2675169-b12b-400d-98fd-f66b65802201-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a2675169-b12b-400d-98fd-f66b65802201" (UID: "a2675169-b12b-400d-98fd-f66b65802201"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 16:00:16.378723 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.378575    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2675169-b12b-400d-98fd-f66b65802201-kube-api-access-d42tf" (OuterVolumeSpecName: "kube-api-access-d42tf") pod "a2675169-b12b-400d-98fd-f66b65802201" (UID: "a2675169-b12b-400d-98fd-f66b65802201"). InnerVolumeSpecName "kube-api-access-d42tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:00:16.475732 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.475707    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d42tf\" (UniqueName: \"kubernetes.io/projected/a2675169-b12b-400d-98fd-f66b65802201-kube-api-access-d42tf\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:16.475732 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.475735    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a2675169-b12b-400d-98fd-f66b65802201-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:16.855071 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.855044    2553 generic.go:356] "Generic (PLEG): container finished" podID="a2675169-b12b-400d-98fd-f66b65802201" containerID="27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7" exitCode=0
Jul 30 16:00:16.855236 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.855094    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"
Jul 30 16:00:16.855236 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.855128    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68" event={"ID":"a2675169-b12b-400d-98fd-f66b65802201","Type":"ContainerDied","Data":"27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7"}
Jul 30 16:00:16.855236 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.855175    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68" event={"ID":"a2675169-b12b-400d-98fd-f66b65802201","Type":"ContainerDied","Data":"d1f253588f697ffc7c6d63489a58e20a25e69f51a08c309949a380badaf32293"}
Jul 30 16:00:16.855236 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.855197    2553 scope.go:117] "RemoveContainer" containerID="27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7"
Jul 30 16:00:16.865034 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.865015    2553 scope.go:117] "RemoveContainer" containerID="27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7"
Jul 30 16:00:16.865286 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:00:16.865264    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7\": container with ID starting with 27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7 not found: ID does not exist" containerID="27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7"
Jul 30 16:00:16.865372 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.865292    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7"} err="failed to get container status \"27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7\": rpc error: code = NotFound desc = could not find container \"27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7\": container with ID starting with 27dfc0c57ae04cabd524c6231a0cfddfb2c50ee56461ac07b98f09b96c6cf4e7 not found: ID does not exist"
Jul 30 16:00:16.878610 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.878582    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"]
Jul 30 16:00:16.881129 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:16.881106    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-51545f-855c675d7f-6cq68"]
Jul 30 16:00:17.924301 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:17.924270    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="67b534c8-9b6e-40d0-815a-94bf5fa6b6d0" path="/var/lib/kubelet/pods/67b534c8-9b6e-40d0-815a-94bf5fa6b6d0/volumes"
Jul 30 16:00:17.924686 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:17.924588    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ee14c8-a48f-4cd3-b120-12e75f14ca87" path="/var/lib/kubelet/pods/87ee14c8-a48f-4cd3-b120-12e75f14ca87/volumes"
Jul 30 16:00:17.924930 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:17.924918    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2675169-b12b-400d-98fd-f66b65802201" path="/var/lib/kubelet/pods/a2675169-b12b-400d-98fd-f66b65802201/volumes"
Jul 30 16:00:22.807488 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807456    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"]
Jul 30 16:00:22.807907 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807892    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67b534c8-9b6e-40d0-815a-94bf5fa6b6d0" containerName="cleanup"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807909    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="67b534c8-9b6e-40d0-815a-94bf5fa6b6d0" containerName="cleanup"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807917    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ee14c8-a48f-4cd3-b120-12e75f14ca87" containerName="revoke-keys"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807933    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ee14c8-a48f-4cd3-b120-12e75f14ca87" containerName="revoke-keys"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807946    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35e8e36e-6a65-4b88-bc31-2b04d00f88bb" containerName="cleanup"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807952    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="35e8e36e-6a65-4b88-bc31-2b04d00f88bb" containerName="cleanup"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807960    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="12629ef1-f131-44f5-aa56-b18721902dfc" containerName="cleanup"
Jul 30 16:00:22.807971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807965    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="12629ef1-f131-44f5-aa56-b18721902dfc" containerName="cleanup"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807974    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2675169-b12b-400d-98fd-f66b65802201" containerName="maas-api"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.807980    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2675169-b12b-400d-98fd-f66b65802201" containerName="maas-api"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.808053    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="12629ef1-f131-44f5-aa56-b18721902dfc" containerName="cleanup"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.808067    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="67b534c8-9b6e-40d0-815a-94bf5fa6b6d0" containerName="cleanup"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.808079    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ee14c8-a48f-4cd3-b120-12e75f14ca87" containerName="revoke-keys"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.808091    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="35e8e36e-6a65-4b88-bc31-2b04d00f88bb" containerName="cleanup"
Jul 30 16:00:22.808212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.808102    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2675169-b12b-400d-98fd-f66b65802201" containerName="maas-api"
Jul 30 16:00:22.812548 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.812531    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:22.815703 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.815683    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 16:00:22.819696 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.819668    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"]
Jul 30 16:00:22.927575 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:22.927550    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06af87d-05dd-4b22-a365-8ae95da3d2ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-985263-mkj5d\" (UID: \"d06af87d-05dd-4b22-a365-8ae95da3d2ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:23.028393 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.028368    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06af87d-05dd-4b22-a365-8ae95da3d2ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-985263-mkj5d\" (UID: \"d06af87d-05dd-4b22-a365-8ae95da3d2ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:23.029042 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.029023    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06af87d-05dd-4b22-a365-8ae95da3d2ba-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-985263-mkj5d\" (UID: \"d06af87d-05dd-4b22-a365-8ae95da3d2ba\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:23.124981 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.124910    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:23.261817 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.261789    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"]
Jul 30 16:00:23.263592 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:00:23.263564    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd06af87d_05dd_4b22_a365_8ae95da3d2ba.slice/crio-b4bf0c13246914829dcf9814ad7f1346f08d2354ef1bde6a17d58be4600a5f82 WatchSource:0}: Error finding container b4bf0c13246914829dcf9814ad7f1346f08d2354ef1bde6a17d58be4600a5f82: Status 404 returned error can't find the container with id b4bf0c13246914829dcf9814ad7f1346f08d2354ef1bde6a17d58be4600a5f82
Jul 30 16:00:23.898962 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.898858    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d" event={"ID":"d06af87d-05dd-4b22-a365-8ae95da3d2ba","Type":"ContainerStarted","Data":"462a52bdf6153ad284c760b2f4e40005dfdf1876cf4d38bacee37a8cab9d023f"}
Jul 30 16:00:23.898962 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.898959    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d" event={"ID":"d06af87d-05dd-4b22-a365-8ae95da3d2ba","Type":"ContainerStarted","Data":"b4bf0c13246914829dcf9814ad7f1346f08d2354ef1bde6a17d58be4600a5f82"}
Jul 30 16:00:23.929199 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:23.929154    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d" podStartSLOduration=1.929141255 podStartE2EDuration="1.929141255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:00:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:00:23.927365538 +0000 UTC m=+3022.533213641" watchObservedRunningTime="2026-07-30 16:00:23.929141255 +0000 UTC m=+3022.534989357"
Jul 30 16:00:24.907073 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:24.907040    2553 generic.go:356] "Generic (PLEG): container finished" podID="d06af87d-05dd-4b22-a365-8ae95da3d2ba" containerID="462a52bdf6153ad284c760b2f4e40005dfdf1876cf4d38bacee37a8cab9d023f" exitCode=0
Jul 30 16:00:24.907518 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:24.907127    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d" event={"ID":"d06af87d-05dd-4b22-a365-8ae95da3d2ba","Type":"ContainerDied","Data":"462a52bdf6153ad284c760b2f4e40005dfdf1876cf4d38bacee37a8cab9d023f"}
Jul 30 16:00:26.038737 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.038709    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:26.152301 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.152279    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06af87d-05dd-4b22-a365-8ae95da3d2ba-maas-api-service-ca\") pod \"d06af87d-05dd-4b22-a365-8ae95da3d2ba\" (UID: \"d06af87d-05dd-4b22-a365-8ae95da3d2ba\") "
Jul 30 16:00:26.152631 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.152610    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d06af87d-05dd-4b22-a365-8ae95da3d2ba-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d06af87d-05dd-4b22-a365-8ae95da3d2ba" (UID: "d06af87d-05dd-4b22-a365-8ae95da3d2ba"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:00:26.253368 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.253341    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d06af87d-05dd-4b22-a365-8ae95da3d2ba-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:26.919780 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.919753    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"
Jul 30 16:00:26.919947 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.919791    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d" event={"ID":"d06af87d-05dd-4b22-a365-8ae95da3d2ba","Type":"ContainerDied","Data":"b4bf0c13246914829dcf9814ad7f1346f08d2354ef1bde6a17d58be4600a5f82"}
Jul 30 16:00:26.919947 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:26.919842    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b4bf0c13246914829dcf9814ad7f1346f08d2354ef1bde6a17d58be4600a5f82"
Jul 30 16:00:38.194658 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.194627    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"]
Jul 30 16:00:38.195220 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.195170    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2" podUID="da586d4d-1506-4e86-9a6d-1c64c5b81402" containerName="maas-api" containerID="cri-o://78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59" gracePeriod=30
Jul 30 16:00:38.225367 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.225333    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"]
Jul 30 16:00:38.227672 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.227651    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-985263-29757120-xz78r"]
Jul 30 16:00:38.384609 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.384535    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"]
Jul 30 16:00:38.388611 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.388584    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-985263-mkj5d"]
Jul 30 16:00:38.450116 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.450067    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 16:00:38.551927 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.551894    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls\") pod \"da586d4d-1506-4e86-9a6d-1c64c5b81402\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") "
Jul 30 16:00:38.552065 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.551977    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zld9\" (UniqueName: \"kubernetes.io/projected/da586d4d-1506-4e86-9a6d-1c64c5b81402-kube-api-access-9zld9\") pod \"da586d4d-1506-4e86-9a6d-1c64c5b81402\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") "
Jul 30 16:00:38.552065 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.552011    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da586d4d-1506-4e86-9a6d-1c64c5b81402-openshift-service-ca\") pod \"da586d4d-1506-4e86-9a6d-1c64c5b81402\" (UID: \"da586d4d-1506-4e86-9a6d-1c64c5b81402\") "
Jul 30 16:00:38.552481 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.552442    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da586d4d-1506-4e86-9a6d-1c64c5b81402-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "da586d4d-1506-4e86-9a6d-1c64c5b81402" (UID: "da586d4d-1506-4e86-9a6d-1c64c5b81402"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:00:38.553968 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.553946    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "da586d4d-1506-4e86-9a6d-1c64c5b81402" (UID: "da586d4d-1506-4e86-9a6d-1c64c5b81402"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 16:00:38.554170 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.554147    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da586d4d-1506-4e86-9a6d-1c64c5b81402-kube-api-access-9zld9" (OuterVolumeSpecName: "kube-api-access-9zld9") pod "da586d4d-1506-4e86-9a6d-1c64c5b81402" (UID: "da586d4d-1506-4e86-9a6d-1c64c5b81402"). InnerVolumeSpecName "kube-api-access-9zld9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:00:38.652922 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.652885    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/da586d4d-1506-4e86-9a6d-1c64c5b81402-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:38.652922 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.652917    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zld9\" (UniqueName: \"kubernetes.io/projected/da586d4d-1506-4e86-9a6d-1c64c5b81402-kube-api-access-9zld9\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:38.652922 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.652927    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/da586d4d-1506-4e86-9a6d-1c64c5b81402-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:00:38.988347 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.988313    2553 generic.go:356] "Generic (PLEG): container finished" podID="da586d4d-1506-4e86-9a6d-1c64c5b81402" containerID="78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59" exitCode=0
Jul 30 16:00:38.988532 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.988359    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"
Jul 30 16:00:38.988532 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.988396    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2" event={"ID":"da586d4d-1506-4e86-9a6d-1c64c5b81402","Type":"ContainerDied","Data":"78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59"}
Jul 30 16:00:38.988532 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.988457    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2" event={"ID":"da586d4d-1506-4e86-9a6d-1c64c5b81402","Type":"ContainerDied","Data":"09dd735d8a16d69ebc92312830519c60efc8ce8fff0ba9e4f9308a576191c243"}
Jul 30 16:00:38.988532 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.988479    2553 scope.go:117] "RemoveContainer" containerID="78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59"
Jul 30 16:00:38.998289 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.998271    2553 scope.go:117] "RemoveContainer" containerID="78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59"
Jul 30 16:00:38.998567 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:00:38.998549    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59\": container with ID starting with 78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59 not found: ID does not exist" containerID="78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59"
Jul 30 16:00:38.998621 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:38.998576    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59"} err="failed to get container status \"78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59\": rpc error: code = NotFound desc = could not find container \"78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59\": container with ID starting with 78886a11335ba97812d418acdbbcc2583d2f229256c22ad37e5fa3074d95dc59 not found: ID does not exist"
Jul 30 16:00:39.012136 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:39.012112    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"]
Jul 30 16:00:39.014503 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:39.014483    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-985263-7898567665-mfrs2"]
Jul 30 16:00:39.924321 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:39.924284    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35e8e36e-6a65-4b88-bc31-2b04d00f88bb" path="/var/lib/kubelet/pods/35e8e36e-6a65-4b88-bc31-2b04d00f88bb/volumes"
Jul 30 16:00:39.924726 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:39.924658    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d06af87d-05dd-4b22-a365-8ae95da3d2ba" path="/var/lib/kubelet/pods/d06af87d-05dd-4b22-a365-8ae95da3d2ba/volumes"
Jul 30 16:00:39.925047 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:39.925031    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da586d4d-1506-4e86-9a6d-1c64c5b81402" path="/var/lib/kubelet/pods/da586d4d-1506-4e86-9a6d-1c64c5b81402/volumes"
Jul 30 16:00:49.786481 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786441    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"]
Jul 30 16:00:49.787060 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786839    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da586d4d-1506-4e86-9a6d-1c64c5b81402" containerName="maas-api"
Jul 30 16:00:49.787060 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786850    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="da586d4d-1506-4e86-9a6d-1c64c5b81402" containerName="maas-api"
Jul 30 16:00:49.787060 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786861    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d06af87d-05dd-4b22-a365-8ae95da3d2ba" containerName="revoke-keys"
Jul 30 16:00:49.787060 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786866    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="d06af87d-05dd-4b22-a365-8ae95da3d2ba" containerName="revoke-keys"
Jul 30 16:00:49.787060 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786980    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="da586d4d-1506-4e86-9a6d-1c64c5b81402" containerName="maas-api"
Jul 30 16:00:49.787060 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.786997    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="d06af87d-05dd-4b22-a365-8ae95da3d2ba" containerName="revoke-keys"
Jul 30 16:00:49.790374 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.790355    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:49.792760 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.792738    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-f2cf4d-serving-cert\""
Jul 30 16:00:49.800195 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.800160    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"]
Jul 30 16:00:49.950299 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.950273    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098ddd2b-2e47-41e5-8209-dc12e13dd06a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:49.950458 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.950319    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098ddd2b-2e47-41e5-8209-dc12e13dd06a-maas-api-tls\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:49.950458 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:49.950346    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqw22\" (UniqueName: \"kubernetes.io/projected/098ddd2b-2e47-41e5-8209-dc12e13dd06a-kube-api-access-wqw22\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.050962 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.050901    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098ddd2b-2e47-41e5-8209-dc12e13dd06a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.050962 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.050946    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098ddd2b-2e47-41e5-8209-dc12e13dd06a-maas-api-tls\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.051156 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.050964    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqw22\" (UniqueName: \"kubernetes.io/projected/098ddd2b-2e47-41e5-8209-dc12e13dd06a-kube-api-access-wqw22\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.051638 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.051617    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098ddd2b-2e47-41e5-8209-dc12e13dd06a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.053163 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.053140    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098ddd2b-2e47-41e5-8209-dc12e13dd06a-maas-api-tls\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.059696 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.059673    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqw22\" (UniqueName: \"kubernetes.io/projected/098ddd2b-2e47-41e5-8209-dc12e13dd06a-kube-api-access-wqw22\") pod \"maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.103125 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.103107    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:50.245737 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:50.245709    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"]
Jul 30 16:00:50.247721 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:00:50.247699    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098ddd2b_2e47_41e5_8209_dc12e13dd06a.slice/crio-f402aebd502bde13fe8231061f2885ecf3c7eb32f82e2cf1c27c4f7ea2728163 WatchSource:0}: Error finding container f402aebd502bde13fe8231061f2885ecf3c7eb32f82e2cf1c27c4f7ea2728163: Status 404 returned error can't find the container with id f402aebd502bde13fe8231061f2885ecf3c7eb32f82e2cf1c27c4f7ea2728163
Jul 30 16:00:51.057732 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:51.057701    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl" event={"ID":"098ddd2b-2e47-41e5-8209-dc12e13dd06a","Type":"ContainerStarted","Data":"f402aebd502bde13fe8231061f2885ecf3c7eb32f82e2cf1c27c4f7ea2728163"}
Jul 30 16:00:52.066238 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:52.066195    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl" event={"ID":"098ddd2b-2e47-41e5-8209-dc12e13dd06a","Type":"ContainerStarted","Data":"6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f"}
Jul 30 16:00:52.066692 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:52.066395    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:00:52.084788 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:52.084747    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl" podStartSLOduration=1.777957319 podStartE2EDuration="3.084734019s" totalImagesPullingTime="1.3067767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:00:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:00:52.083716173 +0000 UTC m=+3050.689564277" watchObservedRunningTime="2026-07-30 16:00:52.084734019 +0000 UTC m=+3050.690582122"
Jul 30 16:00:58.077334 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:00:58.077307    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:01:19.045882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.045849    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"]
Jul 30 16:01:19.049395 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.049379    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.052026 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.052007    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-5468b9-serving-cert\""
Jul 30 16:01:19.059734 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.059709    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"]
Jul 30 16:01:19.069824 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.069801    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh572\" (UniqueName: \"kubernetes.io/projected/fe536ebf-dba5-4413-b1c0-d7f9f461132e-kube-api-access-wh572\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.069940 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.069848    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe536ebf-dba5-4413-b1c0-d7f9f461132e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.069940 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.069897    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.170990 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.170960    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh572\" (UniqueName: \"kubernetes.io/projected/fe536ebf-dba5-4413-b1c0-d7f9f461132e-kube-api-access-wh572\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.171103 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.171004    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe536ebf-dba5-4413-b1c0-d7f9f461132e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.171103 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.171034    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.171187 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:01:19.171153    2553 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-serving-cert: secret "maas-api-e2e-shared-b-5468b9-serving-cert" not found
Jul 30 16:01:19.171222 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:01:19.171217    2553 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls podName:fe536ebf-dba5-4413-b1c0-d7f9f461132e nodeName:}" failed. No retries permitted until 2026-07-30 16:01:19.671199936 +0000 UTC m=+3078.277048019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls") pod "maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" (UID: "fe536ebf-dba5-4413-b1c0-d7f9f461132e") : secret "maas-api-e2e-shared-b-5468b9-serving-cert" not found
Jul 30 16:01:19.171705 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.171687    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe536ebf-dba5-4413-b1c0-d7f9f461132e-openshift-service-ca\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.183716 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.183683    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh572\" (UniqueName: \"kubernetes.io/projected/fe536ebf-dba5-4413-b1c0-d7f9f461132e-kube-api-access-wh572\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.667627 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.667595    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"]
Jul 30 16:01:19.671348 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.671328    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.674245 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.674225    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrjmc\" (UniqueName: \"kubernetes.io/projected/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-kube-api-access-xrjmc\") pod \"payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.674339 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.674319    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.674389 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.674374    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.674822 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.674802    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-5468b9-dockercfg-x7jwl\""
Jul 30 16:01:19.675037 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.674895    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-5468b9\""
Jul 30 16:01:19.677322 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.677296    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls\") pod \"maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.689867 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.689796    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"]
Jul 30 16:01:19.775120 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.775088    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrjmc\" (UniqueName: \"kubernetes.io/projected/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-kube-api-access-xrjmc\") pod \"payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.775247 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.775178    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.775855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.775838    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.787295 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.787274    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrjmc\" (UniqueName: \"kubernetes.io/projected/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-kube-api-access-xrjmc\") pod \"payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:19.961106 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.961079    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:19.997577 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:19.997546    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:20.120770 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.120739    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"]
Jul 30 16:01:20.122674 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:01:20.122651    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe536ebf_dba5_4413_b1c0_d7f9f461132e.slice/crio-cbe4c475f9c66b7cc16177c7abd802f9ae56f6271ea0c4e15b4bf8d029660bb9 WatchSource:0}: Error finding container cbe4c475f9c66b7cc16177c7abd802f9ae56f6271ea0c4e15b4bf8d029660bb9: Status 404 returned error can't find the container with id cbe4c475f9c66b7cc16177c7abd802f9ae56f6271ea0c4e15b4bf8d029660bb9
Jul 30 16:01:20.152023 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.152003    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"]
Jul 30 16:01:20.154338 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:01:20.154314    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8551542_caa5_4e6b_b5a3_2eaf6c7d2422.slice/crio-598109fd2b94b5a04d48bbeeca117d153048df723e23bc03e99da3ac7dbe8300 WatchSource:0}: Error finding container 598109fd2b94b5a04d48bbeeca117d153048df723e23bc03e99da3ac7dbe8300: Status 404 returned error can't find the container with id 598109fd2b94b5a04d48bbeeca117d153048df723e23bc03e99da3ac7dbe8300
Jul 30 16:01:20.237318 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.237285    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7" event={"ID":"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422","Type":"ContainerStarted","Data":"9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f"}
Jul 30 16:01:20.237446 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.237336    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7" event={"ID":"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422","Type":"ContainerStarted","Data":"598109fd2b94b5a04d48bbeeca117d153048df723e23bc03e99da3ac7dbe8300"}
Jul 30 16:01:20.237446 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.237366    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:01:20.238604 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.238582    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" event={"ID":"fe536ebf-dba5-4413-b1c0-d7f9f461132e","Type":"ContainerStarted","Data":"cbe4c475f9c66b7cc16177c7abd802f9ae56f6271ea0c4e15b4bf8d029660bb9"}
Jul 30 16:01:20.253364 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:20.253325    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7" podStartSLOduration=1.253310764 podStartE2EDuration="1.253310764s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:01:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:01:20.251547754 +0000 UTC m=+3078.857395857" watchObservedRunningTime="2026-07-30 16:01:20.253310764 +0000 UTC m=+3078.859158867"
Jul 30 16:01:21.246239 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:21.246206    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" event={"ID":"fe536ebf-dba5-4413-b1c0-d7f9f461132e","Type":"ContainerStarted","Data":"23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab"}
Jul 30 16:01:21.246640 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:21.246281    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:21.266979 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:21.266937    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" podStartSLOduration=1.831540044 podStartE2EDuration="2.266924739s" totalImagesPullingTime="435.384695ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:01:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:01:21.263481142 +0000 UTC m=+3079.869329244" watchObservedRunningTime="2026-07-30 16:01:21.266924739 +0000 UTC m=+3079.872772841"
Jul 30 16:01:27.258069 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:27.258036    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:01:31.248586 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:01:31.248552    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:03:13.497494 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.497460    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zcmtt"]
Jul 30 16:03:13.501429 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.501393    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:13.509106 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.509082    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zcmtt"]
Jul 30 16:03:13.625888 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.625853    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt2wz\" (UniqueName: \"kubernetes.io/projected/dc7d98be-d038-4487-8325-48a0c49af1ea-kube-api-access-lt2wz\") pod \"kuadrant-operator-catalog-zcmtt\" (UID: \"dc7d98be-d038-4487-8325-48a0c49af1ea\") " pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:13.726586 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.726558    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt2wz\" (UniqueName: \"kubernetes.io/projected/dc7d98be-d038-4487-8325-48a0c49af1ea-kube-api-access-lt2wz\") pod \"kuadrant-operator-catalog-zcmtt\" (UID: \"dc7d98be-d038-4487-8325-48a0c49af1ea\") " pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:13.735407 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.735386    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt2wz\" (UniqueName: \"kubernetes.io/projected/dc7d98be-d038-4487-8325-48a0c49af1ea-kube-api-access-lt2wz\") pod \"kuadrant-operator-catalog-zcmtt\" (UID: \"dc7d98be-d038-4487-8325-48a0c49af1ea\") " pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:13.813521 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.813464    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:13.954564 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:13.954542    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zcmtt"]
Jul 30 16:03:13.956973 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:03:13.956946    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc7d98be_d038_4487_8325_48a0c49af1ea.slice/crio-5e07e332f7c0404d7445fae605925d93eb91548bd0680bc5fcdef9a0054e0528 WatchSource:0}: Error finding container 5e07e332f7c0404d7445fae605925d93eb91548bd0680bc5fcdef9a0054e0528: Status 404 returned error can't find the container with id 5e07e332f7c0404d7445fae605925d93eb91548bd0680bc5fcdef9a0054e0528
Jul 30 16:03:14.938792 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:14.938758    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt" event={"ID":"dc7d98be-d038-4487-8325-48a0c49af1ea","Type":"ContainerStarted","Data":"2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2"}
Jul 30 16:03:14.939216 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:14.938811    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt" event={"ID":"dc7d98be-d038-4487-8325-48a0c49af1ea","Type":"ContainerStarted","Data":"5e07e332f7c0404d7445fae605925d93eb91548bd0680bc5fcdef9a0054e0528"}
Jul 30 16:03:14.957436 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:14.957369    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt" podStartSLOduration=1.397191294 podStartE2EDuration="1.957351719s" totalImagesPullingTime="560.160425ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:03:14.9553427 +0000 UTC m=+3193.561190873" watchObservedRunningTime="2026-07-30 16:03:14.957351719 +0000 UTC m=+3193.563199822"
Jul 30 16:03:23.813973 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:23.813935    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:23.814532 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:23.814029    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:23.835965 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:23.835940    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:24.013855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:24.013826    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:24.064132 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:24.064059    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zcmtt"]
Jul 30 16:03:26.004152 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:26.004114    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt" podUID="dc7d98be-d038-4487-8325-48a0c49af1ea" containerName="registry-server" containerID="cri-o://2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2" gracePeriod=2
Jul 30 16:03:26.268927 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:26.268869    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:26.341375 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:26.341341    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lt2wz\" (UniqueName: \"kubernetes.io/projected/dc7d98be-d038-4487-8325-48a0c49af1ea-kube-api-access-lt2wz\") pod \"dc7d98be-d038-4487-8325-48a0c49af1ea\" (UID: \"dc7d98be-d038-4487-8325-48a0c49af1ea\") "
Jul 30 16:03:26.343448 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:26.343413    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dc7d98be-d038-4487-8325-48a0c49af1ea-kube-api-access-lt2wz" (OuterVolumeSpecName: "kube-api-access-lt2wz") pod "dc7d98be-d038-4487-8325-48a0c49af1ea" (UID: "dc7d98be-d038-4487-8325-48a0c49af1ea"). InnerVolumeSpecName "kube-api-access-lt2wz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:03:26.442735 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:26.442695    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lt2wz\" (UniqueName: \"kubernetes.io/projected/dc7d98be-d038-4487-8325-48a0c49af1ea-kube-api-access-lt2wz\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:03:27.010892 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.010855    2553 generic.go:356] "Generic (PLEG): container finished" podID="dc7d98be-d038-4487-8325-48a0c49af1ea" containerID="2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2" exitCode=0
Jul 30 16:03:27.010892 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.010878    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt"
Jul 30 16:03:27.011373 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.010931    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt" event={"ID":"dc7d98be-d038-4487-8325-48a0c49af1ea","Type":"ContainerDied","Data":"2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2"}
Jul 30 16:03:27.011373 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.010974    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-zcmtt" event={"ID":"dc7d98be-d038-4487-8325-48a0c49af1ea","Type":"ContainerDied","Data":"5e07e332f7c0404d7445fae605925d93eb91548bd0680bc5fcdef9a0054e0528"}
Jul 30 16:03:27.011373 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.010995    2553 scope.go:117] "RemoveContainer" containerID="2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2"
Jul 30 16:03:27.021212 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.021196    2553 scope.go:117] "RemoveContainer" containerID="2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2"
Jul 30 16:03:27.021471 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:03:27.021452    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2\": container with ID starting with 2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2 not found: ID does not exist" containerID="2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2"
Jul 30 16:03:27.021515 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.021479    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2"} err="failed to get container status \"2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2\": rpc error: code = NotFound desc = could not find container \"2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2\": container with ID starting with 2c2f85c8d9db645bb214c87c71ca03ae96fccadda5e663b385969249fc88f4d2 not found: ID does not exist"
Jul 30 16:03:27.033108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.033086    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zcmtt"]
Jul 30 16:03:27.036322 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.036302    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-zcmtt"]
Jul 30 16:03:27.924744 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:03:27.924710    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dc7d98be-d038-4487-8325-48a0c49af1ea" path="/var/lib/kubelet/pods/dc7d98be-d038-4487-8325-48a0c49af1ea/volumes"
Jul 30 16:05:02.153997 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:05:02.153972    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:05:02.165308 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:05:02.165289    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:05:02.427437 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:05:02.427397    2553 scope.go:117] "RemoveContainer" containerID="fe6070edec3e27316b4b1153d34dd6163ddb8dc4f6f89d7318a9958c40195a32"
Jul 30 16:05:02.436324 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:05:02.436303    2553 scope.go:117] "RemoveContainer" containerID="977dcd67d85e0f605f5b4721127f50b9e6fdc8320539d697b962c25b91e4709d"
Jul 30 16:06:02.461474 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:06:02.461443    2553 scope.go:117] "RemoveContainer" containerID="51bd2f23ab13466aeee4ddff4386755635b1102970700a23cb27959567b118fb"
Jul 30 16:06:02.470585 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:06:02.470567    2553 scope.go:117] "RemoveContainer" containerID="00182aeeb94896d51b4c087257918f5cda253e6685a3c81f79f3d6015ec8bc1c"
Jul 30 16:06:02.478906 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:06:02.478889    2553 scope.go:117] "RemoveContainer" containerID="2f829e5ba41daf1326f54349ef2943b517300101cdeebfcc22746a5009607ec3"
Jul 30 16:07:02.508074 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:07:02.508045    2553 scope.go:117] "RemoveContainer" containerID="462a52bdf6153ad284c760b2f4e40005dfdf1876cf4d38bacee37a8cab9d023f"
Jul 30 16:10:02.191804 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:10:02.191776    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:10:02.205351 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:10:02.205333    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:11:12.887317 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.887280    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7734-139820177257520"]
Jul 30 16:11:12.888949 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.888915    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dc7d98be-d038-4487-8325-48a0c49af1ea" containerName="registry-server"
Jul 30 16:11:12.888949 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.888954    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="dc7d98be-d038-4487-8325-48a0c49af1ea" containerName="registry-server"
Jul 30 16:11:12.889192 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.889178    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="dc7d98be-d038-4487-8325-48a0c49af1ea" containerName="registry-server"
Jul 30 16:11:12.893296 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.893273    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:12.896616 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.896592    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-mf6g7\""
Jul 30 16:11:12.901164 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.901098    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177257520"]
Jul 30 16:11:12.943376 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:12.943355    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mc2m\" (UniqueName: \"kubernetes.io/projected/368a7139-0245-42b5-86d2-bd980bfecdc3-kube-api-access-5mc2m\") pod \"test-curl-7734-139820177257520\" (UID: \"368a7139-0245-42b5-86d2-bd980bfecdc3\") " pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:13.043786 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:13.043757    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mc2m\" (UniqueName: \"kubernetes.io/projected/368a7139-0245-42b5-86d2-bd980bfecdc3-kube-api-access-5mc2m\") pod \"test-curl-7734-139820177257520\" (UID: \"368a7139-0245-42b5-86d2-bd980bfecdc3\") " pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:13.052363 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:13.052342    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mc2m\" (UniqueName: \"kubernetes.io/projected/368a7139-0245-42b5-86d2-bd980bfecdc3-kube-api-access-5mc2m\") pod \"test-curl-7734-139820177257520\" (UID: \"368a7139-0245-42b5-86d2-bd980bfecdc3\") " pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:13.205703 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:13.205684    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:13.344833 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:13.344796    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177257520"]
Jul 30 16:11:13.346477 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:13.346448    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod368a7139_0245_42b5_86d2_bd980bfecdc3.slice/crio-5105e74e2d681518ccd6dde306bb41ab97085da57e4a39dc69fc582d72a7bd00 WatchSource:0}: Error finding container 5105e74e2d681518ccd6dde306bb41ab97085da57e4a39dc69fc582d72a7bd00: Status 404 returned error can't find the container with id 5105e74e2d681518ccd6dde306bb41ab97085da57e4a39dc69fc582d72a7bd00
Jul 30 16:11:13.347803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:13.347785    2553 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 30 16:11:13.747252 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:13.747217    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177257520" event={"ID":"368a7139-0245-42b5-86d2-bd980bfecdc3","Type":"ContainerStarted","Data":"5105e74e2d681518ccd6dde306bb41ab97085da57e4a39dc69fc582d72a7bd00"}
Jul 30 16:11:14.754313 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:14.754283    2553 generic.go:356] "Generic (PLEG): container finished" podID="368a7139-0245-42b5-86d2-bd980bfecdc3" containerID="0a9cad56e5aeab4fa7a086df4c1629487dd69f1fe34ff5ef0d98afd7ee6a2296" exitCode=0
Jul 30 16:11:14.754745 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:14.754374    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177257520" event={"ID":"368a7139-0245-42b5-86d2-bd980bfecdc3","Type":"ContainerDied","Data":"0a9cad56e5aeab4fa7a086df4c1629487dd69f1fe34ff5ef0d98afd7ee6a2296"}
Jul 30 16:11:15.904536 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:15.904514    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:15.937539 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:15.937510    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7734-139820177257520_368a7139-0245-42b5-86d2-bd980bfecdc3/test-curl-7734-139820177257520/0.log"
Jul 30 16:11:15.964839 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:15.964815    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7734-139820177257520"]
Jul 30 16:11:15.968278 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:15.968252    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7734-139820177257520"]
Jul 30 16:11:15.971579 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:15.971560    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mc2m\" (UniqueName: \"kubernetes.io/projected/368a7139-0245-42b5-86d2-bd980bfecdc3-kube-api-access-5mc2m\") pod \"368a7139-0245-42b5-86d2-bd980bfecdc3\" (UID: \"368a7139-0245-42b5-86d2-bd980bfecdc3\") "
Jul 30 16:11:15.973557 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:15.973532    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/368a7139-0245-42b5-86d2-bd980bfecdc3-kube-api-access-5mc2m" (OuterVolumeSpecName: "kube-api-access-5mc2m") pod "368a7139-0245-42b5-86d2-bd980bfecdc3" (UID: "368a7139-0245-42b5-86d2-bd980bfecdc3"). InnerVolumeSpecName "kube-api-access-5mc2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:11:16.072973 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.072920    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mc2m\" (UniqueName: \"kubernetes.io/projected/368a7139-0245-42b5-86d2-bd980bfecdc3-kube-api-access-5mc2m\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:11:16.114560 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.114537    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7734-139820177417392"]
Jul 30 16:11:16.114939 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.114928    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="368a7139-0245-42b5-86d2-bd980bfecdc3" containerName="test-curl-7734-139820177257520"
Jul 30 16:11:16.114984 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.114941    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="368a7139-0245-42b5-86d2-bd980bfecdc3" containerName="test-curl-7734-139820177257520"
Jul 30 16:11:16.115019 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.115004    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="368a7139-0245-42b5-86d2-bd980bfecdc3" containerName="test-curl-7734-139820177257520"
Jul 30 16:11:16.118012 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.117997    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:16.122872 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.122850    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177417392"]
Jul 30 16:11:16.173557 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.173535    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bt22\" (UniqueName: \"kubernetes.io/projected/6faa0229-25a5-4110-a79a-eaa9a92b4cab-kube-api-access-7bt22\") pod \"test-curl-7734-139820177417392\" (UID: \"6faa0229-25a5-4110-a79a-eaa9a92b4cab\") " pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:16.274634 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.274609    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bt22\" (UniqueName: \"kubernetes.io/projected/6faa0229-25a5-4110-a79a-eaa9a92b4cab-kube-api-access-7bt22\") pod \"test-curl-7734-139820177417392\" (UID: \"6faa0229-25a5-4110-a79a-eaa9a92b4cab\") " pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:16.282655 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.282636    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bt22\" (UniqueName: \"kubernetes.io/projected/6faa0229-25a5-4110-a79a-eaa9a92b4cab-kube-api-access-7bt22\") pod \"test-curl-7734-139820177417392\" (UID: \"6faa0229-25a5-4110-a79a-eaa9a92b4cab\") " pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:16.429113 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.429090    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:16.767330 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.767304    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177417392"]
Jul 30 16:11:16.767483 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.767450    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5105e74e2d681518ccd6dde306bb41ab97085da57e4a39dc69fc582d72a7bd00"
Jul 30 16:11:16.767483 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:16.767457    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:16.768618 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:16.768592    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6faa0229_25a5_4110_a79a_eaa9a92b4cab.slice/crio-00ca863231738714aaf42dacb7c3679086e197aa3fdf03338763f1a80a6ff64a WatchSource:0}: Error finding container 00ca863231738714aaf42dacb7c3679086e197aa3fdf03338763f1a80a6ff64a: Status 404 returned error can't find the container with id 00ca863231738714aaf42dacb7c3679086e197aa3fdf03338763f1a80a6ff64a
Jul 30 16:11:16.778829 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:11:16.778793    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7734-139820177257520\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="368a7139-0245-42b5-86d2-bd980bfecdc3" pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:17.774633 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:17.774596    2553 generic.go:356] "Generic (PLEG): container finished" podID="6faa0229-25a5-4110-a79a-eaa9a92b4cab" containerID="559f6569e573f1161723119509a9fb794a06003347aafa980e5afd3355f03703" exitCode=0
Jul 30 16:11:17.775101 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:17.774678    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177417392" event={"ID":"6faa0229-25a5-4110-a79a-eaa9a92b4cab","Type":"ContainerDied","Data":"559f6569e573f1161723119509a9fb794a06003347aafa980e5afd3355f03703"}
Jul 30 16:11:17.775101 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:17.774722    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177417392" event={"ID":"6faa0229-25a5-4110-a79a-eaa9a92b4cab","Type":"ContainerStarted","Data":"00ca863231738714aaf42dacb7c3679086e197aa3fdf03338763f1a80a6ff64a"}
Jul 30 16:11:17.776918 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:11:17.776892    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7734-139820177257520\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="368a7139-0245-42b5-86d2-bd980bfecdc3" pod="opendatahub/test-curl-7734-139820177257520"
Jul 30 16:11:17.924486 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:17.924461    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="368a7139-0245-42b5-86d2-bd980bfecdc3" path="/var/lib/kubelet/pods/368a7139-0245-42b5-86d2-bd980bfecdc3/volumes"
Jul 30 16:11:18.917168 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:18.917147    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:18.937171 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:18.937148    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7734-139820177417392_6faa0229-25a5-4110-a79a-eaa9a92b4cab/test-curl-7734-139820177417392/0.log"
Jul 30 16:11:18.964940 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:18.964908    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7734-139820177417392"]
Jul 30 16:11:18.968573 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:18.968544    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7734-139820177417392"]
Jul 30 16:11:18.997367 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:18.997344    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bt22\" (UniqueName: \"kubernetes.io/projected/6faa0229-25a5-4110-a79a-eaa9a92b4cab-kube-api-access-7bt22\") pod \"6faa0229-25a5-4110-a79a-eaa9a92b4cab\" (UID: \"6faa0229-25a5-4110-a79a-eaa9a92b4cab\") "
Jul 30 16:11:18.999170 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:18.999148    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6faa0229-25a5-4110-a79a-eaa9a92b4cab-kube-api-access-7bt22" (OuterVolumeSpecName: "kube-api-access-7bt22") pod "6faa0229-25a5-4110-a79a-eaa9a92b4cab" (UID: "6faa0229-25a5-4110-a79a-eaa9a92b4cab"). InnerVolumeSpecName "kube-api-access-7bt22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:11:19.099219 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.099168    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bt22\" (UniqueName: \"kubernetes.io/projected/6faa0229-25a5-4110-a79a-eaa9a92b4cab-kube-api-access-7bt22\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:11:19.148142 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.148119    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:19.148532 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.148520    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6faa0229-25a5-4110-a79a-eaa9a92b4cab" containerName="test-curl-7734-139820177417392"
Jul 30 16:11:19.148580 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.148534    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="6faa0229-25a5-4110-a79a-eaa9a92b4cab" containerName="test-curl-7734-139820177417392"
Jul 30 16:11:19.148619 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.148604    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="6faa0229-25a5-4110-a79a-eaa9a92b4cab" containerName="test-curl-7734-139820177417392"
Jul 30 16:11:19.151550 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.151537    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:19.159634 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.158760    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:19.200146 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.200121    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qq49s\" (UniqueName: \"kubernetes.io/projected/0a28d3f1-19cc-4c18-9acd-3dab58f2440b-kube-api-access-qq49s\") pod \"test-curl-7734-139820171906912\" (UID: \"0a28d3f1-19cc-4c18-9acd-3dab58f2440b\") " pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:19.301512 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.301484    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qq49s\" (UniqueName: \"kubernetes.io/projected/0a28d3f1-19cc-4c18-9acd-3dab58f2440b-kube-api-access-qq49s\") pod \"test-curl-7734-139820171906912\" (UID: \"0a28d3f1-19cc-4c18-9acd-3dab58f2440b\") " pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:19.308926 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.308902    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qq49s\" (UniqueName: \"kubernetes.io/projected/0a28d3f1-19cc-4c18-9acd-3dab58f2440b-kube-api-access-qq49s\") pod \"test-curl-7734-139820171906912\" (UID: \"0a28d3f1-19cc-4c18-9acd-3dab58f2440b\") " pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:19.461698 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.461676    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:19.590571 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.590547    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:19.592767 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:19.592740    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a28d3f1_19cc_4c18_9acd_3dab58f2440b.slice/crio-8d2acab3513c5f51b9515f861b4cba973e8363c6146ef5599b6678f9a3d54fd6 WatchSource:0}: Error finding container 8d2acab3513c5f51b9515f861b4cba973e8363c6146ef5599b6678f9a3d54fd6: Status 404 returned error can't find the container with id 8d2acab3513c5f51b9515f861b4cba973e8363c6146ef5599b6678f9a3d54fd6
Jul 30 16:11:19.787709 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.787650    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820171906912" event={"ID":"0a28d3f1-19cc-4c18-9acd-3dab58f2440b","Type":"ContainerStarted","Data":"8d2acab3513c5f51b9515f861b4cba973e8363c6146ef5599b6678f9a3d54fd6"}
Jul 30 16:11:19.788940 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.788917    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:19.789028 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.788949    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="00ca863231738714aaf42dacb7c3679086e197aa3fdf03338763f1a80a6ff64a"
Jul 30 16:11:19.799866 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:11:19.799843    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7734-139820177417392\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="6faa0229-25a5-4110-a79a-eaa9a92b4cab" pod="opendatahub/test-curl-7734-139820177417392"
Jul 30 16:11:19.925106 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:19.925079    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6faa0229-25a5-4110-a79a-eaa9a92b4cab" path="/var/lib/kubelet/pods/6faa0229-25a5-4110-a79a-eaa9a92b4cab/volumes"
Jul 30 16:11:20.796051 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:20.796018    2553 generic.go:356] "Generic (PLEG): container finished" podID="0a28d3f1-19cc-4c18-9acd-3dab58f2440b" containerID="0260a01b5aa710f806fa58d05f9adf927a3de6a8cbf95102a57ee8f912fc25b9" exitCode=0
Jul 30 16:11:20.796230 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:20.796107    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820171906912" event={"ID":"0a28d3f1-19cc-4c18-9acd-3dab58f2440b","Type":"ContainerDied","Data":"0260a01b5aa710f806fa58d05f9adf927a3de6a8cbf95102a57ee8f912fc25b9"}
Jul 30 16:11:21.941956 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:21.941935    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:21.960923 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:21.960897    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7734-139820171906912_0a28d3f1-19cc-4c18-9acd-3dab58f2440b/test-curl-7734-139820171906912/0.log"
Jul 30 16:11:21.987347 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:21.987320    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:21.989863 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:21.989841    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:22.026522 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.026499    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qq49s\" (UniqueName: \"kubernetes.io/projected/0a28d3f1-19cc-4c18-9acd-3dab58f2440b-kube-api-access-qq49s\") pod \"0a28d3f1-19cc-4c18-9acd-3dab58f2440b\" (UID: \"0a28d3f1-19cc-4c18-9acd-3dab58f2440b\") "
Jul 30 16:11:22.028526 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.028507    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a28d3f1-19cc-4c18-9acd-3dab58f2440b-kube-api-access-qq49s" (OuterVolumeSpecName: "kube-api-access-qq49s") pod "0a28d3f1-19cc-4c18-9acd-3dab58f2440b" (UID: "0a28d3f1-19cc-4c18-9acd-3dab58f2440b"). InnerVolumeSpecName "kube-api-access-qq49s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:11:22.117038 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.116982    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:22.117356 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.117344    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a28d3f1-19cc-4c18-9acd-3dab58f2440b" containerName="test-curl-7734-139820171906912"
Jul 30 16:11:22.117397 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.117358    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a28d3f1-19cc-4c18-9acd-3dab58f2440b" containerName="test-curl-7734-139820171906912"
Jul 30 16:11:22.117464 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.117459    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a28d3f1-19cc-4c18-9acd-3dab58f2440b" containerName="test-curl-7734-139820171906912"
Jul 30 16:11:22.120551 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.120537    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:22.124834 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.124809    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:22.127770 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.127742    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qq49s\" (UniqueName: \"kubernetes.io/projected/0a28d3f1-19cc-4c18-9acd-3dab58f2440b-kube-api-access-qq49s\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:11:22.228973 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.228944    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf66x\" (UniqueName: \"kubernetes.io/projected/ff54bb07-5307-41f8-98e6-dd06b714dfd9-kube-api-access-lf66x\") pod \"test-curl-7734-139820171906912\" (UID: \"ff54bb07-5307-41f8-98e6-dd06b714dfd9\") " pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:22.329375 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.329347    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf66x\" (UniqueName: \"kubernetes.io/projected/ff54bb07-5307-41f8-98e6-dd06b714dfd9-kube-api-access-lf66x\") pod \"test-curl-7734-139820171906912\" (UID: \"ff54bb07-5307-41f8-98e6-dd06b714dfd9\") " pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:22.336988 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.336967    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf66x\" (UniqueName: \"kubernetes.io/projected/ff54bb07-5307-41f8-98e6-dd06b714dfd9-kube-api-access-lf66x\") pod \"test-curl-7734-139820171906912\" (UID: \"ff54bb07-5307-41f8-98e6-dd06b714dfd9\") " pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:22.431092 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.431071    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:22.562165 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.562136    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:22.563472 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:22.563445    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff54bb07_5307_41f8_98e6_dd06b714dfd9.slice/crio-079dfaaa1044760ff4b64cf7e170ad51f4c3d482f5deb9e12078b9a52244d626 WatchSource:0}: Error finding container 079dfaaa1044760ff4b64cf7e170ad51f4c3d482f5deb9e12078b9a52244d626: Status 404 returned error can't find the container with id 079dfaaa1044760ff4b64cf7e170ad51f4c3d482f5deb9e12078b9a52244d626
Jul 30 16:11:22.809129 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.809057    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820171906912" event={"ID":"ff54bb07-5307-41f8-98e6-dd06b714dfd9","Type":"ContainerStarted","Data":"079dfaaa1044760ff4b64cf7e170ad51f4c3d482f5deb9e12078b9a52244d626"}
Jul 30 16:11:22.810244 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.810229    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:22.810326 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.810230    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d2acab3513c5f51b9515f861b4cba973e8363c6146ef5599b6678f9a3d54fd6"
Jul 30 16:11:22.822591 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:22.822564    2553 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7734-139820171906912" oldPodUID="0a28d3f1-19cc-4c18-9acd-3dab58f2440b" podUID="ff54bb07-5307-41f8-98e6-dd06b714dfd9"
Jul 30 16:11:23.819583 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:23.819550    2553 generic.go:356] "Generic (PLEG): container finished" podID="ff54bb07-5307-41f8-98e6-dd06b714dfd9" containerID="3708062b739102f88b5c563a2c4ed9e8915952bc298cf7fdb84a1cf166d79425" exitCode=0
Jul 30 16:11:23.819982 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:23.819644    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820171906912" event={"ID":"ff54bb07-5307-41f8-98e6-dd06b714dfd9","Type":"ContainerDied","Data":"3708062b739102f88b5c563a2c4ed9e8915952bc298cf7fdb84a1cf166d79425"}
Jul 30 16:11:23.924669 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:23.924607    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a28d3f1-19cc-4c18-9acd-3dab58f2440b" path="/var/lib/kubelet/pods/0a28d3f1-19cc-4c18-9acd-3dab58f2440b/volumes"
Jul 30 16:11:24.967279 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:24.967252    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:24.986766 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:24.986745    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7734-139820171906912_ff54bb07-5307-41f8-98e6-dd06b714dfd9/test-curl-7734-139820171906912/0.log"
Jul 30 16:11:25.012657 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.012630    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:25.016277 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.016254    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7734-139820171906912"]
Jul 30 16:11:25.051124 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.051102    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lf66x\" (UniqueName: \"kubernetes.io/projected/ff54bb07-5307-41f8-98e6-dd06b714dfd9-kube-api-access-lf66x\") pod \"ff54bb07-5307-41f8-98e6-dd06b714dfd9\" (UID: \"ff54bb07-5307-41f8-98e6-dd06b714dfd9\") "
Jul 30 16:11:25.053056 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.053035    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff54bb07-5307-41f8-98e6-dd06b714dfd9-kube-api-access-lf66x" (OuterVolumeSpecName: "kube-api-access-lf66x") pod "ff54bb07-5307-41f8-98e6-dd06b714dfd9" (UID: "ff54bb07-5307-41f8-98e6-dd06b714dfd9"). InnerVolumeSpecName "kube-api-access-lf66x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:11:25.142307 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.142247    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:25.142664 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.142651    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff54bb07-5307-41f8-98e6-dd06b714dfd9" containerName="test-curl-7734-139820171906912"
Jul 30 16:11:25.142715 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.142666    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff54bb07-5307-41f8-98e6-dd06b714dfd9" containerName="test-curl-7734-139820171906912"
Jul 30 16:11:25.142760 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.142751    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff54bb07-5307-41f8-98e6-dd06b714dfd9" containerName="test-curl-7734-139820171906912"
Jul 30 16:11:25.145795 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.145778    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:25.150381 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.150351    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:25.152584 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.152562    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lf66x\" (UniqueName: \"kubernetes.io/projected/ff54bb07-5307-41f8-98e6-dd06b714dfd9-kube-api-access-lf66x\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:11:25.253660 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.253633    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7pr7z\" (UniqueName: \"kubernetes.io/projected/fc6b82c7-30db-4c41-b0e5-69e664bec944-kube-api-access-7pr7z\") pod \"test-curl-7734-139820177278704\" (UID: \"fc6b82c7-30db-4c41-b0e5-69e664bec944\") " pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:25.354244 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.354221    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7pr7z\" (UniqueName: \"kubernetes.io/projected/fc6b82c7-30db-4c41-b0e5-69e664bec944-kube-api-access-7pr7z\") pod \"test-curl-7734-139820177278704\" (UID: \"fc6b82c7-30db-4c41-b0e5-69e664bec944\") " pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:25.362087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.362066    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7pr7z\" (UniqueName: \"kubernetes.io/projected/fc6b82c7-30db-4c41-b0e5-69e664bec944-kube-api-access-7pr7z\") pod \"test-curl-7734-139820177278704\" (UID: \"fc6b82c7-30db-4c41-b0e5-69e664bec944\") " pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:25.457248 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.457226    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:25.587683 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.587655    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:25.588969 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:25.588945    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc6b82c7_30db_4c41_b0e5_69e664bec944.slice/crio-3b8e1bdddda3ab9381d154c5923ebda93be2e12d5af652d96607f02e73d8045b WatchSource:0}: Error finding container 3b8e1bdddda3ab9381d154c5923ebda93be2e12d5af652d96607f02e73d8045b: Status 404 returned error can't find the container with id 3b8e1bdddda3ab9381d154c5923ebda93be2e12d5af652d96607f02e73d8045b
Jul 30 16:11:25.832005 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.831941    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:25.832005 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.831962    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="079dfaaa1044760ff4b64cf7e170ad51f4c3d482f5deb9e12078b9a52244d626"
Jul 30 16:11:25.833172 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.833142    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177278704" event={"ID":"fc6b82c7-30db-4c41-b0e5-69e664bec944","Type":"ContainerStarted","Data":"3b8e1bdddda3ab9381d154c5923ebda93be2e12d5af652d96607f02e73d8045b"}
Jul 30 16:11:25.843104 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:11:25.843078    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7734-139820171906912\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="ff54bb07-5307-41f8-98e6-dd06b714dfd9" pod="opendatahub/test-curl-7734-139820171906912"
Jul 30 16:11:25.924866 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:25.924840    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff54bb07-5307-41f8-98e6-dd06b714dfd9" path="/var/lib/kubelet/pods/ff54bb07-5307-41f8-98e6-dd06b714dfd9/volumes"
Jul 30 16:11:26.841318 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:26.841291    2553 generic.go:356] "Generic (PLEG): container finished" podID="fc6b82c7-30db-4c41-b0e5-69e664bec944" containerID="822593677d1538e17506777235f7897c77aee91b964e1b08f9ffe1b91d15eab0" exitCode=0
Jul 30 16:11:26.841728 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:26.841323    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177278704" event={"ID":"fc6b82c7-30db-4c41-b0e5-69e664bec944","Type":"ContainerDied","Data":"822593677d1538e17506777235f7897c77aee91b964e1b08f9ffe1b91d15eab0"}
Jul 30 16:11:27.982580 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:27.982558    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.004454 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.004435    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7734-139820177278704_fc6b82c7-30db-4c41-b0e5-69e664bec944/test-curl-7734-139820177278704/0.log"
Jul 30 16:11:28.032357 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.032334    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:28.035475 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.035445    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:28.077988 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.077967    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7pr7z\" (UniqueName: \"kubernetes.io/projected/fc6b82c7-30db-4c41-b0e5-69e664bec944-kube-api-access-7pr7z\") pod \"fc6b82c7-30db-4c41-b0e5-69e664bec944\" (UID: \"fc6b82c7-30db-4c41-b0e5-69e664bec944\") "
Jul 30 16:11:28.079905 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.079884    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc6b82c7-30db-4c41-b0e5-69e664bec944-kube-api-access-7pr7z" (OuterVolumeSpecName: "kube-api-access-7pr7z") pod "fc6b82c7-30db-4c41-b0e5-69e664bec944" (UID: "fc6b82c7-30db-4c41-b0e5-69e664bec944"). InnerVolumeSpecName "kube-api-access-7pr7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:11:28.164555 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.164500    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:28.164918 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.164905    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc6b82c7-30db-4c41-b0e5-69e664bec944" containerName="test-curl-7734-139820177278704"
Jul 30 16:11:28.164957 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.164919    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc6b82c7-30db-4c41-b0e5-69e664bec944" containerName="test-curl-7734-139820177278704"
Jul 30 16:11:28.164989 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.164981    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc6b82c7-30db-4c41-b0e5-69e664bec944" containerName="test-curl-7734-139820177278704"
Jul 30 16:11:28.168078 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.168064    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.175165 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.175087    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:28.179024 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.179001    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7pr7z\" (UniqueName: \"kubernetes.io/projected/fc6b82c7-30db-4c41-b0e5-69e664bec944-kube-api-access-7pr7z\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:11:28.279891 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.279864    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g69kj\" (UniqueName: \"kubernetes.io/projected/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7-kube-api-access-g69kj\") pod \"test-curl-7734-139820177278704\" (UID: \"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7\") " pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.380647 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.380620    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g69kj\" (UniqueName: \"kubernetes.io/projected/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7-kube-api-access-g69kj\") pod \"test-curl-7734-139820177278704\" (UID: \"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7\") " pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.388864 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.388836    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g69kj\" (UniqueName: \"kubernetes.io/projected/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7-kube-api-access-g69kj\") pod \"test-curl-7734-139820177278704\" (UID: \"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7\") " pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.479639 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.479618    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.610960 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.610934    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:28.612187 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:28.612162    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a0c2e7d_9bce_4f53_841b_5bfe26e1f8d7.slice/crio-674ca4490a28a33c56623d0d3c7331c08631dba00a08d63444615259519f397b WatchSource:0}: Error finding container 674ca4490a28a33c56623d0d3c7331c08631dba00a08d63444615259519f397b: Status 404 returned error can't find the container with id 674ca4490a28a33c56623d0d3c7331c08631dba00a08d63444615259519f397b
Jul 30 16:11:28.853315 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.853249    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:28.853315 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.853285    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b8e1bdddda3ab9381d154c5923ebda93be2e12d5af652d96607f02e73d8045b"
Jul 30 16:11:28.854569 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.854543    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177278704" event={"ID":"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7","Type":"ContainerStarted","Data":"674ca4490a28a33c56623d0d3c7331c08631dba00a08d63444615259519f397b"}
Jul 30 16:11:28.864236 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:28.864215    2553 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7734-139820177278704" oldPodUID="fc6b82c7-30db-4c41-b0e5-69e664bec944" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7"
Jul 30 16:11:29.861932 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:29.861892    2553 generic.go:356] "Generic (PLEG): container finished" podID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" containerID="d1b6e1d0d721d934de14d016dead0df92d24fe5d4d795a1f8c8736ed2f106ee7" exitCode=0
Jul 30 16:11:29.862389 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:29.861978    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7734-139820177278704" event={"ID":"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7","Type":"ContainerDied","Data":"d1b6e1d0d721d934de14d016dead0df92d24fe5d4d795a1f8c8736ed2f106ee7"}
Jul 30 16:11:29.925063 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:29.925029    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc6b82c7-30db-4c41-b0e5-69e664bec944" path="/var/lib/kubelet/pods/fc6b82c7-30db-4c41-b0e5-69e664bec944/volumes"
Jul 30 16:11:31.012033 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.012004    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:31.032190 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.032158    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7734-139820177278704_9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7/test-curl-7734-139820177278704/0.log"
Jul 30 16:11:31.056611 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.056574    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:31.060377 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.060343    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7734-139820177278704"]
Jul 30 16:11:31.105650 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.105617    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g69kj\" (UniqueName: \"kubernetes.io/projected/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7-kube-api-access-g69kj\") pod \"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7\" (UID: \"9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7\") "
Jul 30 16:11:31.107705 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.107680    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7-kube-api-access-g69kj" (OuterVolumeSpecName: "kube-api-access-g69kj") pod "9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" (UID: "9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7"). InnerVolumeSpecName "kube-api-access-g69kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:11:31.207294 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.207256    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g69kj\" (UniqueName: \"kubernetes.io/projected/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7-kube-api-access-g69kj\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:11:31.875259 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.875226    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:31.875455 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.875284    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="674ca4490a28a33c56623d0d3c7331c08631dba00a08d63444615259519f397b"
Jul 30 16:11:31.887820 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:11:31.887772    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7734-139820177278704\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:31.923319 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:11:31.923282    2553 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7734-139820177278704\" is forbidden: User \"system:node:ip-10-0-138-79.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-138-79.ec2.internal' and this object" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" pod="opendatahub/test-curl-7734-139820177278704"
Jul 30 16:11:31.926852 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:31.926824    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" path="/var/lib/kubelet/pods/9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7/volumes"
Jul 30 16:11:36.757972 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.757935    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"]
Jul 30 16:11:36.758388 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.758371    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" containerName="test-curl-7734-139820177278704"
Jul 30 16:11:36.758455 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.758389    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" containerName="test-curl-7734-139820177278704"
Jul 30 16:11:36.758511 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.758500    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a0c2e7d-9bce-4f53-841b-5bfe26e1f8d7" containerName="test-curl-7734-139820177278704"
Jul 30 16:11:36.761936 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.761913    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:36.764534 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.764517    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-6bc161-dockercfg-kl7pj\""
Jul 30 16:11:36.764636 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.764531    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-6bc161\""
Jul 30 16:11:36.773954 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.773926    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"]
Jul 30 16:11:36.815067 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.815030    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"]
Jul 30 16:11:36.818622 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.818605    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:36.827862 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.827838    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"]
Jul 30 16:11:36.859536 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.859505    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c174ec-75e8-47ab-bb37-a7537ce8176b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:36.859670 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.859622    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w89q6\" (UniqueName: \"kubernetes.io/projected/36c174ec-75e8-47ab-bb37-a7537ce8176b-kube-api-access-w89q6\") pod \"payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:36.960442 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.960372    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fe186d9-521b-450f-83ac-09293bb9db2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:36.960642 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.960530    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w89q6\" (UniqueName: \"kubernetes.io/projected/36c174ec-75e8-47ab-bb37-a7537ce8176b-kube-api-access-w89q6\") pod \"payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:36.960642 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.960595    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c174ec-75e8-47ab-bb37-a7537ce8176b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:36.960821 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.960676    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7226\" (UniqueName: \"kubernetes.io/projected/4fe186d9-521b-450f-83ac-09293bb9db2b-kube-api-access-p7226\") pod \"payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:36.961485 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.961461    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c174ec-75e8-47ab-bb37-a7537ce8176b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:36.970217 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:36.970195    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w89q6\" (UniqueName: \"kubernetes.io/projected/36c174ec-75e8-47ab-bb37-a7537ce8176b-kube-api-access-w89q6\") pod \"payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:37.061464 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.061345    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fe186d9-521b-450f-83ac-09293bb9db2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:37.061650 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.061493    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7226\" (UniqueName: \"kubernetes.io/projected/4fe186d9-521b-450f-83ac-09293bb9db2b-kube-api-access-p7226\") pod \"payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:37.062120 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.062099    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fe186d9-521b-450f-83ac-09293bb9db2b-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:37.072191 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.072163    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7226\" (UniqueName: \"kubernetes.io/projected/4fe186d9-521b-450f-83ac-09293bb9db2b-kube-api-access-p7226\") pod \"payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:37.077034 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.077008    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:37.130410 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.130341    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:37.233826 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.233800    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"]
Jul 30 16:11:37.235755 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:37.235617    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36c174ec_75e8_47ab_bb37_a7537ce8176b.slice/crio-867fdeb39ba830d64f8f6d9cdc967068dd2d8ed1e04ea982df2f41bbae34d40e WatchSource:0}: Error finding container 867fdeb39ba830d64f8f6d9cdc967068dd2d8ed1e04ea982df2f41bbae34d40e: Status 404 returned error can't find the container with id 867fdeb39ba830d64f8f6d9cdc967068dd2d8ed1e04ea982df2f41bbae34d40e
Jul 30 16:11:37.299351 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.299249    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"]
Jul 30 16:11:37.302331 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:11:37.302295    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe186d9_521b_450f_83ac_09293bb9db2b.slice/crio-af41f2bec891cc60596fed4ab665d1efcdae2a9ddf54fbb1a7928b9c134cce2d WatchSource:0}: Error finding container af41f2bec891cc60596fed4ab665d1efcdae2a9ddf54fbb1a7928b9c134cce2d: Status 404 returned error can't find the container with id af41f2bec891cc60596fed4ab665d1efcdae2a9ddf54fbb1a7928b9c134cce2d
Jul 30 16:11:37.924909 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.924875    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z" event={"ID":"36c174ec-75e8-47ab-bb37-a7537ce8176b","Type":"ContainerStarted","Data":"420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59"}
Jul 30 16:11:37.925302 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.924923    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z" event={"ID":"36c174ec-75e8-47ab-bb37-a7537ce8176b","Type":"ContainerStarted","Data":"867fdeb39ba830d64f8f6d9cdc967068dd2d8ed1e04ea982df2f41bbae34d40e"}
Jul 30 16:11:37.925302 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.924940    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct" event={"ID":"4fe186d9-521b-450f-83ac-09293bb9db2b","Type":"ContainerStarted","Data":"3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431"}
Jul 30 16:11:37.925302 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.924959    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:11:37.925302 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.924974    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:37.925302 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.924986    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct" event={"ID":"4fe186d9-521b-450f-83ac-09293bb9db2b","Type":"ContainerStarted","Data":"af41f2bec891cc60596fed4ab665d1efcdae2a9ddf54fbb1a7928b9c134cce2d"}
Jul 30 16:11:37.934877 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.934832    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z" podStartSLOduration=1.934812773 podStartE2EDuration="1.934812773s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:11:37.93386354 +0000 UTC m=+3696.539711644" watchObservedRunningTime="2026-07-30 16:11:37.934812773 +0000 UTC m=+3696.540660886"
Jul 30 16:11:37.949735 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:37.949689    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct" podStartSLOduration=1.949673848 podStartE2EDuration="1.949673848s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:11:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:11:37.948351438 +0000 UTC m=+3696.554199541" watchObservedRunningTime="2026-07-30 16:11:37.949673848 +0000 UTC m=+3696.555521951"
Jul 30 16:11:48.929115 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:48.929083    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:11:48.929669 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:11:48.929166    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:12:01.192748 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.192719    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"]
Jul 30 16:12:01.196698 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.196678    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.199434 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.199398    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 30 16:12:01.199529 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.199491    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-ae9970-openshift-default-dockercfg-d6h59\""
Jul 30 16:12:01.210090 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.210069    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"]
Jul 30 16:12:01.287939 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.287910    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvqf\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-kube-api-access-rrvqf\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288065 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.287982    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-certs\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288055    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-credential-socket\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288088    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-socket\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288179 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288110    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-envoy\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288179 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288173    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-istio-token\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288247 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288211    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-data\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288247 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288229    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22f271dc-9801-4283-b4a7-763fb6248823-istiod-ca-cert\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.288309 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.288249    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22f271dc-9801-4283-b4a7-763fb6248823-istio-podinfo\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389284 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389255    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-istio-token\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389461 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389301    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-data\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389461 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389321    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22f271dc-9801-4283-b4a7-763fb6248823-istiod-ca-cert\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389461 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389372    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22f271dc-9801-4283-b4a7-763fb6248823-istio-podinfo\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389461 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389454    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvqf\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-kube-api-access-rrvqf\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389700 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389517    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-certs\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389700 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389605    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-credential-socket\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389700 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389637    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-socket\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389700 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389675    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-envoy\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389905 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389801    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-data\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.389905 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.389890    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-certs\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.390039 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.390012    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-socket\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.390308 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.390281    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22f271dc-9801-4283-b4a7-763fb6248823-istiod-ca-cert\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.390401 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.390304    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-credential-socket\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.391864 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.391845    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-envoy\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.391988 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.391971    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22f271dc-9801-4283-b4a7-763fb6248823-istio-podinfo\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.397338 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.397317    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-istio-token\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.397540 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.397522    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvqf\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-kube-api-access-rrvqf\") pod \"e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") " pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.508803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.508731    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:01.654494 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:01.654448    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"]
Jul 30 16:12:01.654901 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:12:01.654878    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f271dc_9801_4283_b4a7_763fb6248823.slice/crio-e1e03ee23d16997927db3ebafb1bc28f228559d5e1a1a8ae608d8268f54e2e28 WatchSource:0}: Error finding container e1e03ee23d16997927db3ebafb1bc28f228559d5e1a1a8ae608d8268f54e2e28: Status 404 returned error can't find the container with id e1e03ee23d16997927db3ebafb1bc28f228559d5e1a1a8ae608d8268f54e2e28
Jul 30 16:12:02.070378 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:02.070343    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" event={"ID":"22f271dc-9801-4283-b4a7-763fb6248823","Type":"ContainerStarted","Data":"e1e03ee23d16997927db3ebafb1bc28f228559d5e1a1a8ae608d8268f54e2e28"}
Jul 30 16:12:05.143965 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:05.143916    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:12:05.144257 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:05.144002    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:12:05.144257 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:05.144034    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:12:06.097628 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:06.097588    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" event={"ID":"22f271dc-9801-4283-b4a7-763fb6248823","Type":"ContainerStarted","Data":"b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"}
Jul 30 16:12:06.117584 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:06.117536    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podStartSLOduration=1.6309916370000002 podStartE2EDuration="5.117519366s" totalImagesPullingTime="3.486527729s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:12:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:12:06.115905908 +0000 UTC m=+3724.721754012" watchObservedRunningTime="2026-07-30 16:12:06.117519366 +0000 UTC m=+3724.723367469"
Jul 30 16:12:06.509921 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:06.509885    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:06.515221 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:06.515197    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:07.103380 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:07.103343    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:07.104307 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:07.104287    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:22.404046 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:22.404010    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": read tcp 10.133.0.2:60054->10.133.0.109:15021: read: connection reset by peer" start-of-body=
Jul 30 16:12:22.404516 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:22.404078    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": read tcp 10.133.0.2:60054->10.133.0.109:15021: read: connection reset by peer"
Jul 30 16:12:23.228228 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:23.228197    2553 generic.go:356] "Generic (PLEG): container finished" podID="22f271dc-9801-4283-b4a7-763fb6248823" containerID="b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d" exitCode=0
Jul 30 16:12:23.228393 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:23.228246    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" event={"ID":"22f271dc-9801-4283-b4a7-763fb6248823","Type":"ContainerDied","Data":"b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"}
Jul 30 16:12:23.228630 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:23.228614    2553 scope.go:117] "RemoveContainer" containerID="b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"
Jul 30 16:12:23.230748 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:23.230707    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:12:23.230837 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:23.230787    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:12:23.230837 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:23.230818    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:12:24.235918 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:24.235885    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" event={"ID":"22f271dc-9801-4283-b4a7-763fb6248823","Type":"ContainerStarted","Data":"53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613"}
Jul 30 16:12:24.509457 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:24.509366    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:24.509591 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:24.509540    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:24.509637 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:24.509584    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:25.509557 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:25.509522    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:25.509927 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:25.509572    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:26.509682 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:26.509628    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:26.510168 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:26.509710    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:27.509736 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:27.509698    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:27.510157 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:27.509757    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:28.509301 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:28.509257    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:28.509529 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:28.509324    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:29.509904 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:29.509873    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:29.510297 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:29.509924    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:30.509263 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:30.509228    2553 patch_prober.go:28] interesting pod/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused" start-of-body=
Jul 30 16:12:30.509488 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:30.509289    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.109:15021/healthz/ready\": dial tcp 10.133.0.109:15021: connect: connection refused"
Jul 30 16:12:31.512839 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:31.512806    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:31.513307 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:31.513166    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:31.513737 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:31.513719    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:12:40.288558 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:12:40.288524    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-qdbwx_ea16af77-73d0-4d5c-8e33-db205867a5c5/payload-processing/0.log"
Jul 30 16:13:30.572188 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:30.572159    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct_4fe186d9-521b-450f-83ac-09293bb9db2b/payload-processing/0.log"
Jul 30 16:13:30.715330 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:30.715302    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-qdbwx_ea16af77-73d0-4d5c-8e33-db205867a5c5/payload-processing/0.log"
Jul 30 16:13:31.455659 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.455622    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"]
Jul 30 16:13:31.458438 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.458401    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.461672 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.461638    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-812b03-openshift-default-dockercfg-smdnl\""
Jul 30 16:13:31.472601 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.472580    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"]
Jul 30 16:13:31.543962 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.543929    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-socket\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544085 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.543988    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-data\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544085 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544040    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2z6m\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-kube-api-access-k2z6m\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544115    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-podinfo\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544149    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-credential-socket\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544170    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-certs\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544189    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544354 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544233    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-envoy\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.544354 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.544279    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-token\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645289 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645259    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-data\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645289 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645293    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2z6m\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-kube-api-access-k2z6m\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645333    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-podinfo\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645369    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-credential-socket\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645396    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-certs\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645437    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645681    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-envoy\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645760    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-token\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645778    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-data\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645799    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-certs\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645877    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-socket\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.645883 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.645883    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-credential-socket\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.646325 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.646159    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-socket\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.646325 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.646254    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istiod-ca-cert\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.647866 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.647848    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-podinfo\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.647979 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.647954    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-envoy\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.653189 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.653169    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-token\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.653389 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.653371    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2z6m\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-kube-api-access-k2z6m\") pod \"e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") " pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.768990 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.768925    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:31.914731 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.914701    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"]
Jul 30 16:13:31.915532 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:13:31.915507    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1da932_4ad0_487d_b35e_4b262e99d3bb.slice/crio-386c3dde48c1917352e1ad2a5e4d69773bfaec34623dbc9ab5b924a914031e90 WatchSource:0}: Error finding container 386c3dde48c1917352e1ad2a5e4d69773bfaec34623dbc9ab5b924a914031e90: Status 404 returned error can't find the container with id 386c3dde48c1917352e1ad2a5e4d69773bfaec34623dbc9ab5b924a914031e90
Jul 30 16:13:31.917718 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.917681    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:13:31.917828 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.917746    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:13:31.917828 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:31.917775    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:13:32.650450 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:32.650401    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" event={"ID":"0c1da932-4ad0-487d-b35e-4b262e99d3bb","Type":"ContainerStarted","Data":"0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"}
Jul 30 16:13:32.650934 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:32.650482    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" event={"ID":"0c1da932-4ad0-487d-b35e-4b262e99d3bb","Type":"ContainerStarted","Data":"386c3dde48c1917352e1ad2a5e4d69773bfaec34623dbc9ab5b924a914031e90"}
Jul 30 16:13:32.671581 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:32.671530    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" podStartSLOduration=1.671514112 podStartE2EDuration="1.671514112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:13:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:13:32.669349848 +0000 UTC m=+3811.275197951" watchObservedRunningTime="2026-07-30 16:13:32.671514112 +0000 UTC m=+3811.277362215"
Jul 30 16:13:32.769190 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:32.769166    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:32.774201 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:32.774178    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:33.661180 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:33.661153    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:33.662002 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:33.661984    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:48.663607 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.663572    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Jul 30 16:13:48.664036 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.663658    2553 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Jul 30 16:13:48.764146 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.764114    2553 generic.go:356] "Generic (PLEG): container finished" podID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerID="0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e" exitCode=0
Jul 30 16:13:48.764319 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.764185    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" event={"ID":"0c1da932-4ad0-487d-b35e-4b262e99d3bb","Type":"ContainerDied","Data":"0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"}
Jul 30 16:13:48.764667 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.764652    2553 scope.go:117] "RemoveContainer" containerID="0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"
Jul 30 16:13:48.765854 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.765826    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:13:48.765911 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.765898    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:13:48.765953 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:48.765927    2553 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236216Ki","pods":"250"}
Jul 30 16:13:49.772954 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:49.772920    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" event={"ID":"0c1da932-4ad0-487d-b35e-4b262e99d3bb","Type":"ContainerStarted","Data":"9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737"}
Jul 30 16:13:50.769310 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:50.769273    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:50.769567 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:50.769545    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Jul 30 16:13:50.769620 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:50.769597    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Jul 30 16:13:51.770118 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:51.770079    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Jul 30 16:13:51.770635 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:51.770147    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Jul 30 16:13:52.769874 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:52.769826    2553 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused" start-of-body=
Jul 30 16:13:52.770074 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:52.769899    2553 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.110:15021/healthz/ready\": dial tcp 10.133.0.110:15021: connect: connection refused"
Jul 30 16:13:53.773361 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:53.773327    2553 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:53.773776 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:53.773744    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:13:53.774367 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:13:53.774349    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:14:00.475823 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.475784    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"]
Jul 30 16:14:00.478566 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.478547    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:00.481651 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.481631    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 16:14:00.487939 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.487856    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"]
Jul 30 16:14:00.643157 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.643118    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9\" (UID: \"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:00.744232 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.744149    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9\" (UID: \"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:00.744833 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.744814    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9\" (UID: \"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:00.791627 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.791601    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:00.941081 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:00.941051    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"]
Jul 30 16:14:00.942360 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:14:00.942334    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f80fe8_4c3d_4259_b629_cbe5eb0f31b6.slice/crio-486821468f3fab9a9ff96a1f48126b99705f81dcf8b9e337f7fae3bd95221f1c WatchSource:0}: Error finding container 486821468f3fab9a9ff96a1f48126b99705f81dcf8b9e337f7fae3bd95221f1c: Status 404 returned error can't find the container with id 486821468f3fab9a9ff96a1f48126b99705f81dcf8b9e337f7fae3bd95221f1c
Jul 30 16:14:01.874755 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:01.874723    2553 generic.go:356] "Generic (PLEG): container finished" podID="e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6" containerID="735e6d8288db52cc7dafd9c57fc45f9ba448a86513ae4e0ec9a42216476beca6" exitCode=0
Jul 30 16:14:01.875080 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:01.874761    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9" event={"ID":"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6","Type":"ContainerDied","Data":"735e6d8288db52cc7dafd9c57fc45f9ba448a86513ae4e0ec9a42216476beca6"}
Jul 30 16:14:01.875080 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:01.874834    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9" event={"ID":"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6","Type":"ContainerStarted","Data":"486821468f3fab9a9ff96a1f48126b99705f81dcf8b9e337f7fae3bd95221f1c"}
Jul 30 16:14:03.033139 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.033113    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:03.168110 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.168045    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6-maas-api-service-ca\") pod \"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6\" (UID: \"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6\") "
Jul 30 16:14:03.168363 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.168343    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6" (UID: "e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:14:03.268656 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.268633    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:03.889447 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.889395    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"
Jul 30 16:14:03.889627 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.889436    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9" event={"ID":"e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6","Type":"ContainerDied","Data":"486821468f3fab9a9ff96a1f48126b99705f81dcf8b9e337f7fae3bd95221f1c"}
Jul 30 16:14:03.889627 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:03.889489    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="486821468f3fab9a9ff96a1f48126b99705f81dcf8b9e337f7fae3bd95221f1c"
Jul 30 16:14:06.559342 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:06.559289    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"]
Jul 30 16:14:06.562630 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:06.562606    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-812b03-gdzr9"]
Jul 30 16:14:07.925727 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:07.925695    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6" path="/var/lib/kubelet/pods/e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6/volumes"
Jul 30 16:14:12.954438 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:12.954380    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"]
Jul 30 16:14:12.954951 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:12.954624    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy" containerID="cri-o://9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737" gracePeriod=30
Jul 30 16:14:16.994521 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:16.994481    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"]
Jul 30 16:14:16.995107 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:16.994944    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6" containerName="revoke-keys"
Jul 30 16:14:16.995107 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:16.994955    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6" containerName="revoke-keys"
Jul 30 16:14:16.995107 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:16.995039    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f80fe8-4c3d-4259-b629-cbe5eb0f31b6" containerName="revoke-keys"
Jul 30 16:14:16.997203 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:16.997181    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:16.999768 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:16.999750    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 16:14:17.007890 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.007867    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"]
Jul 30 16:14:17.097252 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.097215    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec47294-be08-4a37-bed8-9dddf8c3a49e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn\" (UID: \"dec47294-be08-4a37-bed8-9dddf8c3a49e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:17.198625 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.198583    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec47294-be08-4a37-bed8-9dddf8c3a49e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn\" (UID: \"dec47294-be08-4a37-bed8-9dddf8c3a49e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:17.199243 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.199221    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec47294-be08-4a37-bed8-9dddf8c3a49e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn\" (UID: \"dec47294-be08-4a37-bed8-9dddf8c3a49e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:17.319373 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.319280    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:17.460380 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.460342    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"]
Jul 30 16:14:17.461210 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:14:17.461175    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddec47294_be08_4a37_bed8_9dddf8c3a49e.slice/crio-5044f8f19f0776fc4173ce2bb025d4f76cbe6b021d0144f8f330058b3f8052fc WatchSource:0}: Error finding container 5044f8f19f0776fc4173ce2bb025d4f76cbe6b021d0144f8f330058b3f8052fc: Status 404 returned error can't find the container with id 5044f8f19f0776fc4173ce2bb025d4f76cbe6b021d0144f8f330058b3f8052fc
Jul 30 16:14:17.980624 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.980594    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn" event={"ID":"dec47294-be08-4a37-bed8-9dddf8c3a49e","Type":"ContainerStarted","Data":"8ac7788d415e9f769cf308a39fe3dca97c81768527376f366eaa0b219106e6df"}
Jul 30 16:14:17.980753 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.980649    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn" event={"ID":"dec47294-be08-4a37-bed8-9dddf8c3a49e","Type":"ContainerStarted","Data":"5044f8f19f0776fc4173ce2bb025d4f76cbe6b021d0144f8f330058b3f8052fc"}
Jul 30 16:14:17.999730 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:17.999674    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn" podStartSLOduration=1.99965752 podStartE2EDuration="1.99965752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:14:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:14:17.99848902 +0000 UTC m=+3856.604337127" watchObservedRunningTime="2026-07-30 16:14:17.99965752 +0000 UTC m=+3856.605505623"
Jul 30 16:14:18.250738 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.250673    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:14:18.310603 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310566    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-data\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.310603 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310606    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-podinfo\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.310855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310642    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istiod-ca-cert\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.310855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310698    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-credential-socket\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.310855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310760    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-certs\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.310855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310814    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-socket\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.310855 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310855    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2z6m\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-kube-api-access-k2z6m\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.311108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310917    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-token\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.311108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.310944    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-envoy\") pod \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\" (UID: \"0c1da932-4ad0-487d-b35e-4b262e99d3bb\") "
Jul 30 16:14:18.311108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311082    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:14:18.311273 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311125    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:14:18.311358 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311325    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istiod-ca-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.311358 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311354    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-credential-socket\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.311519 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311490    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:14:18.311620 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311597    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:14:18.311754 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.311740    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:14:18.313354 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.313330    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:14:18.313473 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.313336    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 16:14:18.313549 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.313518    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:14:18.313603 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.313555    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-kube-api-access-k2z6m" (OuterVolumeSpecName: "kube-api-access-k2z6m") pod "0c1da932-4ad0-487d-b35e-4b262e99d3bb" (UID: "0c1da932-4ad0-487d-b35e-4b262e99d3bb"). InnerVolumeSpecName "kube-api-access-k2z6m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:14:18.412949 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.412905    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-token\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.412949 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.412942    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-envoy\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.412949 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.412956    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-data\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.413190 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.412967    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1da932-4ad0-487d-b35e-4b262e99d3bb-istio-podinfo\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.413190 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.412980    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-certs\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.413190 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.412990    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1da932-4ad0-487d-b35e-4b262e99d3bb-workload-socket\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.413190 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.413002    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2z6m\" (UniqueName: \"kubernetes.io/projected/0c1da932-4ad0-487d-b35e-4b262e99d3bb-kube-api-access-k2z6m\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:18.988708 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.988673    2553 generic.go:356] "Generic (PLEG): container finished" podID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerID="9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737" exitCode=0
Jul 30 16:14:18.988919 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.988730    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"
Jul 30 16:14:18.988919 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.988760    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" event={"ID":"0c1da932-4ad0-487d-b35e-4b262e99d3bb","Type":"ContainerDied","Data":"9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737"}
Jul 30 16:14:18.988919 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.988813    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847" event={"ID":"0c1da932-4ad0-487d-b35e-4b262e99d3bb","Type":"ContainerDied","Data":"386c3dde48c1917352e1ad2a5e4d69773bfaec34623dbc9ab5b924a914031e90"}
Jul 30 16:14:18.988919 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.988834    2553 scope.go:117] "RemoveContainer" containerID="9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737"
Jul 30 16:14:18.990382 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.990359    2553 generic.go:356] "Generic (PLEG): container finished" podID="dec47294-be08-4a37-bed8-9dddf8c3a49e" containerID="8ac7788d415e9f769cf308a39fe3dca97c81768527376f366eaa0b219106e6df" exitCode=0
Jul 30 16:14:18.990536 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.990392    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn" event={"ID":"dec47294-be08-4a37-bed8-9dddf8c3a49e","Type":"ContainerDied","Data":"8ac7788d415e9f769cf308a39fe3dca97c81768527376f366eaa0b219106e6df"}
Jul 30 16:14:18.999486 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:18.999468    2553 scope.go:117] "RemoveContainer" containerID="0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"
Jul 30 16:14:19.008755 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.008737    2553 scope.go:117] "RemoveContainer" containerID="9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737"
Jul 30 16:14:19.009031 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:14:19.008981    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737\": container with ID starting with 9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737 not found: ID does not exist" containerID="9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737"
Jul 30 16:14:19.009031 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.009002    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737"} err="failed to get container status \"9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737\": rpc error: code = NotFound desc = could not find container \"9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737\": container with ID starting with 9339211f950b692aa48e4dc27e3594624501bc34265bd0865357c7de9d023737 not found: ID does not exist"
Jul 30 16:14:19.009031 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.009018    2553 scope.go:117] "RemoveContainer" containerID="0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"
Jul 30 16:14:19.009258 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:14:19.009240    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e\": container with ID starting with 0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e not found: ID does not exist" containerID="0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"
Jul 30 16:14:19.009295 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.009265    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e"} err="failed to get container status \"0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e\": rpc error: code = NotFound desc = could not find container \"0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e\": container with ID starting with 0f146a7c45f604ba9d97b9c79784818cade48084e49e79441d6226a91c87097e not found: ID does not exist"
Jul 30 16:14:19.027773 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.027740    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"]
Jul 30 16:14:19.032101 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.032077    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-812b03-openshift-default-5d4447c7fb-9t847"]
Jul 30 16:14:19.924697 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:19.924666    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" path="/var/lib/kubelet/pods/0c1da932-4ad0-487d-b35e-4b262e99d3bb/volumes"
Jul 30 16:14:20.139892 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:20.139871    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:20.229114 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:20.229024    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec47294-be08-4a37-bed8-9dddf8c3a49e-maas-api-service-ca\") pod \"dec47294-be08-4a37-bed8-9dddf8c3a49e\" (UID: \"dec47294-be08-4a37-bed8-9dddf8c3a49e\") "
Jul 30 16:14:20.229493 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:20.229468    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dec47294-be08-4a37-bed8-9dddf8c3a49e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "dec47294-be08-4a37-bed8-9dddf8c3a49e" (UID: "dec47294-be08-4a37-bed8-9dddf8c3a49e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:14:20.330781 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:20.330740    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/dec47294-be08-4a37-bed8-9dddf8c3a49e-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:21.005902 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:21.005872    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"
Jul 30 16:14:21.006069 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:21.005912    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn" event={"ID":"dec47294-be08-4a37-bed8-9dddf8c3a49e","Type":"ContainerDied","Data":"5044f8f19f0776fc4173ce2bb025d4f76cbe6b021d0144f8f330058b3f8052fc"}
Jul 30 16:14:21.006069 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:21.005962    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5044f8f19f0776fc4173ce2bb025d4f76cbe6b021d0144f8f330058b3f8052fc"
Jul 30 16:14:32.486180 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.486142    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"]
Jul 30 16:14:32.486734 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.486373    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct" podUID="4fe186d9-521b-450f-83ac-09293bb9db2b" containerName="payload-processing" containerID="cri-o://3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431" gracePeriod=30
Jul 30 16:14:32.489445 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.489397    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"]
Jul 30 16:14:32.489606 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.489580    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z" podUID="36c174ec-75e8-47ab-bb37-a7537ce8176b" containerName="payload-pre-processing" containerID="cri-o://420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59" gracePeriod=30
Jul 30 16:14:32.603758 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.603718    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"]
Jul 30 16:14:32.606613 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.606585    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-6bc161-25sjn"]
Jul 30 16:14:32.780926 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.780903    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:14:32.793307 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.793287    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:14:32.838223 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.838199    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7226\" (UniqueName: \"kubernetes.io/projected/4fe186d9-521b-450f-83ac-09293bb9db2b-kube-api-access-p7226\") pod \"4fe186d9-521b-450f-83ac-09293bb9db2b\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") "
Jul 30 16:14:32.838356 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.838262    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fe186d9-521b-450f-83ac-09293bb9db2b-plugins-config-volume\") pod \"4fe186d9-521b-450f-83ac-09293bb9db2b\" (UID: \"4fe186d9-521b-450f-83ac-09293bb9db2b\") "
Jul 30 16:14:32.838686 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.838664    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fe186d9-521b-450f-83ac-09293bb9db2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4fe186d9-521b-450f-83ac-09293bb9db2b" (UID: "4fe186d9-521b-450f-83ac-09293bb9db2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:14:32.840310 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.840289    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fe186d9-521b-450f-83ac-09293bb9db2b-kube-api-access-p7226" (OuterVolumeSpecName: "kube-api-access-p7226") pod "4fe186d9-521b-450f-83ac-09293bb9db2b" (UID: "4fe186d9-521b-450f-83ac-09293bb9db2b"). InnerVolumeSpecName "kube-api-access-p7226". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:14:32.939039 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.939014    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w89q6\" (UniqueName: \"kubernetes.io/projected/36c174ec-75e8-47ab-bb37-a7537ce8176b-kube-api-access-w89q6\") pod \"36c174ec-75e8-47ab-bb37-a7537ce8176b\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") "
Jul 30 16:14:32.939128 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.939093    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c174ec-75e8-47ab-bb37-a7537ce8176b-plugins-config-volume\") pod \"36c174ec-75e8-47ab-bb37-a7537ce8176b\" (UID: \"36c174ec-75e8-47ab-bb37-a7537ce8176b\") "
Jul 30 16:14:32.939286 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.939271    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4fe186d9-521b-450f-83ac-09293bb9db2b-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:32.939359 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.939291    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7226\" (UniqueName: \"kubernetes.io/projected/4fe186d9-521b-450f-83ac-09293bb9db2b-kube-api-access-p7226\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:32.939504 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.939483    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36c174ec-75e8-47ab-bb37-a7537ce8176b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36c174ec-75e8-47ab-bb37-a7537ce8176b" (UID: "36c174ec-75e8-47ab-bb37-a7537ce8176b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:14:32.940901 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:32.940882    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36c174ec-75e8-47ab-bb37-a7537ce8176b-kube-api-access-w89q6" (OuterVolumeSpecName: "kube-api-access-w89q6") pod "36c174ec-75e8-47ab-bb37-a7537ce8176b" (UID: "36c174ec-75e8-47ab-bb37-a7537ce8176b"). InnerVolumeSpecName "kube-api-access-w89q6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:14:33.040488 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.040398    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w89q6\" (UniqueName: \"kubernetes.io/projected/36c174ec-75e8-47ab-bb37-a7537ce8176b-kube-api-access-w89q6\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:33.040488 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.040434    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36c174ec-75e8-47ab-bb37-a7537ce8176b-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:14:33.087235 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.087203    2553 generic.go:356] "Generic (PLEG): container finished" podID="4fe186d9-521b-450f-83ac-09293bb9db2b" containerID="3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431" exitCode=0
Jul 30 16:14:33.087337 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.087248    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"
Jul 30 16:14:33.087337 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.087288    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct" event={"ID":"4fe186d9-521b-450f-83ac-09293bb9db2b","Type":"ContainerDied","Data":"3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431"}
Jul 30 16:14:33.087458 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.087336    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct" event={"ID":"4fe186d9-521b-450f-83ac-09293bb9db2b","Type":"ContainerDied","Data":"af41f2bec891cc60596fed4ab665d1efcdae2a9ddf54fbb1a7928b9c134cce2d"}
Jul 30 16:14:33.087458 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.087360    2553 scope.go:117] "RemoveContainer" containerID="3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431"
Jul 30 16:14:33.088977 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.088957    2553 generic.go:356] "Generic (PLEG): container finished" podID="36c174ec-75e8-47ab-bb37-a7537ce8176b" containerID="420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59" exitCode=0
Jul 30 16:14:33.089075 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.088993    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"
Jul 30 16:14:33.089130 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.089073    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z" event={"ID":"36c174ec-75e8-47ab-bb37-a7537ce8176b","Type":"ContainerDied","Data":"420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59"}
Jul 30 16:14:33.089130 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.089113    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z" event={"ID":"36c174ec-75e8-47ab-bb37-a7537ce8176b","Type":"ContainerDied","Data":"867fdeb39ba830d64f8f6d9cdc967068dd2d8ed1e04ea982df2f41bbae34d40e"}
Jul 30 16:14:33.109629 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.103620    2553 scope.go:117] "RemoveContainer" containerID="3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431"
Jul 30 16:14:33.109629 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:14:33.108229    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431\": container with ID starting with 3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431 not found: ID does not exist" containerID="3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431"
Jul 30 16:14:33.109629 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.108271    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431"} err="failed to get container status \"3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431\": rpc error: code = NotFound desc = could not find container \"3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431\": container with ID starting with 3d215c638483fd372c76a9a0e3e830c3858d3cdf3147d6e029174d6019733431 not found: ID does not exist"
Jul 30 16:14:33.109629 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.108296    2553 scope.go:117] "RemoveContainer" containerID="420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59"
Jul 30 16:14:33.118801 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.118776    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"]
Jul 30 16:14:33.121645 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.121630    2553 scope.go:117] "RemoveContainer" containerID="420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59"
Jul 30 16:14:33.121911 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:14:33.121891    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59\": container with ID starting with 420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59 not found: ID does not exist" containerID="420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59"
Jul 30 16:14:33.121972 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.121918    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59"} err="failed to get container status \"420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59\": rpc error: code = NotFound desc = could not find container \"420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59\": container with ID starting with 420d7f572db9ccba4d71f5352fb6481b1d531d46708fecf4979a82360e382b59 not found: ID does not exist"
Jul 30 16:14:33.123795 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.123776    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-6bc161-844979dbd4-nfcct"]
Jul 30 16:14:33.132153 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.132133    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"]
Jul 30 16:14:33.136067 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.136045    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-6bc161-7649d5854d-prq4z"]
Jul 30 16:14:33.925038 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.925010    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36c174ec-75e8-47ab-bb37-a7537ce8176b" path="/var/lib/kubelet/pods/36c174ec-75e8-47ab-bb37-a7537ce8176b/volumes"
Jul 30 16:14:33.925383 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.925342    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fe186d9-521b-450f-83ac-09293bb9db2b" path="/var/lib/kubelet/pods/4fe186d9-521b-450f-83ac-09293bb9db2b/volumes"
Jul 30 16:14:33.925688 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:14:33.925672    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dec47294-be08-4a37-bed8-9dddf8c3a49e" path="/var/lib/kubelet/pods/dec47294-be08-4a37-bed8-9dddf8c3a49e/volumes"
Jul 30 16:15:00.139477 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139407    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"]
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139859    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dec47294-be08-4a37-bed8-9dddf8c3a49e" containerName="revoke-keys"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139873    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="dec47294-be08-4a37-bed8-9dddf8c3a49e" containerName="revoke-keys"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139885    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fe186d9-521b-450f-83ac-09293bb9db2b" containerName="payload-processing"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139892    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fe186d9-521b-450f-83ac-09293bb9db2b" containerName="payload-processing"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139916    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139924    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139930    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139935    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139945    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36c174ec-75e8-47ab-bb37-a7537ce8176b" containerName="payload-pre-processing"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.139951    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="36c174ec-75e8-47ab-bb37-a7537ce8176b" containerName="payload-pre-processing"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.140014    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="36c174ec-75e8-47ab-bb37-a7537ce8176b" containerName="payload-pre-processing"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.140022    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.140028    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1da932-4ad0-487d-b35e-4b262e99d3bb" containerName="istio-proxy"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.140035    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fe186d9-521b-450f-83ac-09293bb9db2b" containerName="payload-processing"
Jul 30 16:15:00.140087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.140041    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="dec47294-be08-4a37-bed8-9dddf8c3a49e" containerName="revoke-keys"
Jul 30 16:15:00.142915 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.142895    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"]
Jul 30 16:15:00.143047 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.143024    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"
Jul 30 16:15:00.145674 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.145657    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 16:15:00.146230 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.146215    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"
Jul 30 16:15:00.159109 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.155624    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"]
Jul 30 16:15:00.159109 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.157695    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"
Jul 30 16:15:00.173103 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.168064    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"]
Jul 30 16:15:00.175735 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.175697    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"
Jul 30 16:15:00.342586 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.340882    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"]
Jul 30 16:15:00.344696 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:15:00.344666    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e9d381_8582_4e4b_af5c_085d8e14ec83.slice/crio-547d28c8752f2a696e899e03f01a88d51081494ea4eaf82df2fa0f31e723e25a WatchSource:0}: Error finding container 547d28c8752f2a696e899e03f01a88d51081494ea4eaf82df2fa0f31e723e25a: Status 404 returned error can't find the container with id 547d28c8752f2a696e899e03f01a88d51081494ea4eaf82df2fa0f31e723e25a
Jul 30 16:15:00.522857 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:00.522835    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"]
Jul 30 16:15:00.523972 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:15:00.523951    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda675d264_57b4_4e98_af3b_18731fcd37c5.slice/crio-d461923c0f0982d01f545419fcf38b9d415dee631be1a4987829e800b8e20ac9 WatchSource:0}: Error finding container d461923c0f0982d01f545419fcf38b9d415dee631be1a4987829e800b8e20ac9: Status 404 returned error can't find the container with id d461923c0f0982d01f545419fcf38b9d415dee631be1a4987829e800b8e20ac9
Jul 30 16:15:01.269084 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:01.269052    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487" event={"ID":"a675d264-57b4-4e98-af3b-18731fcd37c5","Type":"ContainerStarted","Data":"dd02322362e5ecdd2fab6b92aa7f75d0dc3ccdcc8d53d6af111be4688fb2203a"}
Jul 30 16:15:01.269481 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:01.269105    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487" event={"ID":"a675d264-57b4-4e98-af3b-18731fcd37c5","Type":"ContainerStarted","Data":"d461923c0f0982d01f545419fcf38b9d415dee631be1a4987829e800b8e20ac9"}
Jul 30 16:15:01.270641 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:01.270616    2553 generic.go:356] "Generic (PLEG): container finished" podID="45e9d381-8582-4e4b-af5c-085d8e14ec83" containerID="2f2d20e2c78cdbf420a4912c69382a4632d252dc8dd140ca3b4233b860c4c569" exitCode=0
Jul 30 16:15:01.270741 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:01.270675    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn" event={"ID":"45e9d381-8582-4e4b-af5c-085d8e14ec83","Type":"ContainerDied","Data":"2f2d20e2c78cdbf420a4912c69382a4632d252dc8dd140ca3b4233b860c4c569"}
Jul 30 16:15:01.270741 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:01.270710    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn" event={"ID":"45e9d381-8582-4e4b-af5c-085d8e14ec83","Type":"ContainerStarted","Data":"547d28c8752f2a696e899e03f01a88d51081494ea4eaf82df2fa0f31e723e25a"}
Jul 30 16:15:01.287684 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:01.287636    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487" podStartSLOduration=1.287622628 podStartE2EDuration="1.287622628s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-30 16:15:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:15:01.286010473 +0000 UTC m=+3899.891858577" watchObservedRunningTime="2026-07-30 16:15:01.287622628 +0000 UTC m=+3899.893470731"
Jul 30 16:15:02.232460 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:02.232432    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:15:02.247615 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:02.247592    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:15:02.277406 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:02.277381    2553 generic.go:356] "Generic (PLEG): container finished" podID="a675d264-57b4-4e98-af3b-18731fcd37c5" containerID="dd02322362e5ecdd2fab6b92aa7f75d0dc3ccdcc8d53d6af111be4688fb2203a" exitCode=0
Jul 30 16:15:02.277727 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:02.277466    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487" event={"ID":"a675d264-57b4-4e98-af3b-18731fcd37c5","Type":"ContainerDied","Data":"dd02322362e5ecdd2fab6b92aa7f75d0dc3ccdcc8d53d6af111be4688fb2203a"}
Jul 30 16:15:02.418474 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:02.418450    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"
Jul 30 16:15:03.285080 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.285058    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn"
Jul 30 16:15:03.285555 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.285105    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29757135-6c8kn" event={"ID":"45e9d381-8582-4e4b-af5c-085d8e14ec83","Type":"ContainerDied","Data":"547d28c8752f2a696e899e03f01a88d51081494ea4eaf82df2fa0f31e723e25a"}
Jul 30 16:15:03.285555 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.285196    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="547d28c8752f2a696e899e03f01a88d51081494ea4eaf82df2fa0f31e723e25a"
Jul 30 16:15:03.422136 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.422108    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"
Jul 30 16:15:03.483847 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.483820    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"]
Jul 30 16:15:03.487188 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.487167    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29757090-nggrh"]
Jul 30 16:15:03.926590 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:03.926558    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b5539a6-faf7-4ba1-920c-50749334b65d" path="/var/lib/kubelet/pods/8b5539a6-faf7-4ba1-920c-50749334b65d/volumes"
Jul 30 16:15:04.292983 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:04.292920    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"
Jul 30 16:15:04.292983 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:04.292943    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487" event={"ID":"a675d264-57b4-4e98-af3b-18731fcd37c5","Type":"ContainerDied","Data":"d461923c0f0982d01f545419fcf38b9d415dee631be1a4987829e800b8e20ac9"}
Jul 30 16:15:04.292983 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:04.292990    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d461923c0f0982d01f545419fcf38b9d415dee631be1a4987829e800b8e20ac9"
Jul 30 16:15:21.969350 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969316    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"]
Jul 30 16:15:21.969882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969754    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a675d264-57b4-4e98-af3b-18731fcd37c5" containerName="cleanup"
Jul 30 16:15:21.969882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969766    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="a675d264-57b4-4e98-af3b-18731fcd37c5" containerName="cleanup"
Jul 30 16:15:21.969882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969778    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="45e9d381-8582-4e4b-af5c-085d8e14ec83" containerName="cleanup"
Jul 30 16:15:21.969882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969783    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="45e9d381-8582-4e4b-af5c-085d8e14ec83" containerName="cleanup"
Jul 30 16:15:21.969882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969855    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="45e9d381-8582-4e4b-af5c-085d8e14ec83" containerName="cleanup"
Jul 30 16:15:21.969882 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.969866    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="a675d264-57b4-4e98-af3b-18731fcd37c5" containerName="cleanup"
Jul 30 16:15:21.972971 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.972953    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:21.976453 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.976410    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dg2n2\""
Jul 30 16:15:21.985684 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:21.985662    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"]
Jul 30 16:15:22.082436 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:22.082389    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/822567af-b0bf-4da7-b616-71c32f8de6c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x\" (UID: \"822567af-b0bf-4da7-b616-71c32f8de6c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:22.183815 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:22.183787    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/822567af-b0bf-4da7-b616-71c32f8de6c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x\" (UID: \"822567af-b0bf-4da7-b616-71c32f8de6c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:22.184410 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:22.184393    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/822567af-b0bf-4da7-b616-71c32f8de6c5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x\" (UID: \"822567af-b0bf-4da7-b616-71c32f8de6c5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:22.284402 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:22.284320    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:22.433353 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:22.433313    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"]
Jul 30 16:15:22.440209 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:15:22.440185    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod822567af_b0bf_4da7_b616_71c32f8de6c5.slice/crio-4f768f822895c67c847c1cb44c39a88950f61cbed9cb6f3e744f6c52d67ab81b WatchSource:0}: Error finding container 4f768f822895c67c847c1cb44c39a88950f61cbed9cb6f3e744f6c52d67ab81b: Status 404 returned error can't find the container with id 4f768f822895c67c847c1cb44c39a88950f61cbed9cb6f3e744f6c52d67ab81b
Jul 30 16:15:23.420174 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:23.420141    2553 generic.go:356] "Generic (PLEG): container finished" podID="822567af-b0bf-4da7-b616-71c32f8de6c5" containerID="3ebc01c876081c0811a3881c67a172d8f9fb97df4a32eeee3ab304ed5501100f" exitCode=0
Jul 30 16:15:23.420580 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:23.420225    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x" event={"ID":"822567af-b0bf-4da7-b616-71c32f8de6c5","Type":"ContainerDied","Data":"3ebc01c876081c0811a3881c67a172d8f9fb97df4a32eeee3ab304ed5501100f"}
Jul 30 16:15:23.420580 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:23.420279    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x" event={"ID":"822567af-b0bf-4da7-b616-71c32f8de6c5","Type":"ContainerStarted","Data":"4f768f822895c67c847c1cb44c39a88950f61cbed9cb6f3e744f6c52d67ab81b"}
Jul 30 16:15:24.559937 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:24.559909    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:24.708728 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:24.708663    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/822567af-b0bf-4da7-b616-71c32f8de6c5-maas-api-service-ca\") pod \"822567af-b0bf-4da7-b616-71c32f8de6c5\" (UID: \"822567af-b0bf-4da7-b616-71c32f8de6c5\") "
Jul 30 16:15:24.708967 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:24.708948    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/822567af-b0bf-4da7-b616-71c32f8de6c5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "822567af-b0bf-4da7-b616-71c32f8de6c5" (UID: "822567af-b0bf-4da7-b616-71c32f8de6c5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:15:24.809777 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:24.809748    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/822567af-b0bf-4da7-b616-71c32f8de6c5-maas-api-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:25.433048 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:25.433015    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"
Jul 30 16:15:25.433209 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:25.433048    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x" event={"ID":"822567af-b0bf-4da7-b616-71c32f8de6c5","Type":"ContainerDied","Data":"4f768f822895c67c847c1cb44c39a88950f61cbed9cb6f3e744f6c52d67ab81b"}
Jul 30 16:15:25.433209 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:25.433096    2553 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f768f822895c67c847c1cb44c39a88950f61cbed9cb6f3e744f6c52d67ab81b"
Jul 30 16:15:32.983086 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:32.983050    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"]
Jul 30 16:15:32.985764 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:32.985741    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-ae9970-8kc9x"]
Jul 30 16:15:33.924373 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:33.924330    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="822567af-b0bf-4da7-b616-71c32f8de6c5" path="/var/lib/kubelet/pods/822567af-b0bf-4da7-b616-71c32f8de6c5/volumes"
Jul 30 16:15:40.689719 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:40.689684    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"]
Jul 30 16:15:40.690189 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:40.689908    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy" containerID="cri-o://53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613" gracePeriod=30
Jul 30 16:15:45.946625 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.946601    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:15:45.995434 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995339    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrvqf\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-kube-api-access-rrvqf\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995577 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995456    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-data\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995577 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995496    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-envoy\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995577 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995524    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22f271dc-9801-4283-b4a7-763fb6248823-istio-podinfo\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995577 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995548    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-certs\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995577 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995565    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-credential-socket\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995863 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995591    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-socket\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.995941 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995861    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:15:45.995941 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995876    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:15:45.995941 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995917    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22f271dc-9801-4283-b4a7-763fb6248823-istiod-ca-cert\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.996086 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.995976    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-istio-token\") pod \"22f271dc-9801-4283-b4a7-763fb6248823\" (UID: \"22f271dc-9801-4283-b4a7-763fb6248823\") "
Jul 30 16:15:45.996086 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996002    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:15:45.996803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996227    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f271dc-9801-4283-b4a7-763fb6248823-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:15:45.996803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996507    2553 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-certs\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:45.996803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996528    2553 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-credential-socket\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:45.996803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996525    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-data" (OuterVolumeSpecName: "istio-data") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:15:45.996803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996542    2553 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-workload-socket\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:45.996803 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.996554    2553 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22f271dc-9801-4283-b4a7-763fb6248823-istiod-ca-cert\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:45.998049 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.998023    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 30 16:15:45.998158 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.998042    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-kube-api-access-rrvqf" (OuterVolumeSpecName: "kube-api-access-rrvqf") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "kube-api-access-rrvqf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:15:45.998406 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.998376    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22f271dc-9801-4283-b4a7-763fb6248823-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 30 16:15:45.999200 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:45.999180    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-istio-token" (OuterVolumeSpecName: "istio-token") pod "22f271dc-9801-4283-b4a7-763fb6248823" (UID: "22f271dc-9801-4283-b4a7-763fb6248823"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:15:46.097979 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.097940    2553 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-data\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:46.097979 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.097974    2553 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22f271dc-9801-4283-b4a7-763fb6248823-istio-envoy\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:46.097979 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.097982    2553 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22f271dc-9801-4283-b4a7-763fb6248823-istio-podinfo\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:46.098290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.097991    2553 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-istio-token\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:46.098290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.097999    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrvqf\" (UniqueName: \"kubernetes.io/projected/22f271dc-9801-4283-b4a7-763fb6248823-kube-api-access-rrvqf\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:46.574014 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.573980    2553 generic.go:356] "Generic (PLEG): container finished" podID="22f271dc-9801-4283-b4a7-763fb6248823" containerID="53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613" exitCode=0
Jul 30 16:15:46.574193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.574026    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"
Jul 30 16:15:46.574193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.574043    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" event={"ID":"22f271dc-9801-4283-b4a7-763fb6248823","Type":"ContainerDied","Data":"53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613"}
Jul 30 16:15:46.574193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.574088    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7" event={"ID":"22f271dc-9801-4283-b4a7-763fb6248823","Type":"ContainerDied","Data":"e1e03ee23d16997927db3ebafb1bc28f228559d5e1a1a8ae608d8268f54e2e28"}
Jul 30 16:15:46.574193 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.574109    2553 scope.go:117] "RemoveContainer" containerID="53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613"
Jul 30 16:15:46.585180 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.585158    2553 scope.go:117] "RemoveContainer" containerID="b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"
Jul 30 16:15:46.593914 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.593896    2553 scope.go:117] "RemoveContainer" containerID="53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613"
Jul 30 16:15:46.594156 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:15:46.594138    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613\": container with ID starting with 53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613 not found: ID does not exist" containerID="53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613"
Jul 30 16:15:46.594204 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.594164    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613"} err="failed to get container status \"53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613\": rpc error: code = NotFound desc = could not find container \"53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613\": container with ID starting with 53977bfe2f3cf3784ef732b643459fa1997e97fbb26488237259d4a754978613 not found: ID does not exist"
Jul 30 16:15:46.594204 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.594183    2553 scope.go:117] "RemoveContainer" containerID="b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"
Jul 30 16:15:46.594453 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:15:46.594411    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d\": container with ID starting with b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d not found: ID does not exist" containerID="b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"
Jul 30 16:15:46.594521 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.594459    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d"} err="failed to get container status \"b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d\": rpc error: code = NotFound desc = could not find container \"b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d\": container with ID starting with b425e77b6fb2d4edff87529c7dafbb174f0e18146ad5fab03f82d0de842bc07d not found: ID does not exist"
Jul 30 16:15:46.599915 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.599887    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"]
Jul 30 16:15:46.603205 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:46.603186    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-ae9970-openshift-default-55d54748b6-vdzh7"]
Jul 30 16:15:47.925689 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:47.925653    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f271dc-9801-4283-b4a7-763fb6248823" path="/var/lib/kubelet/pods/22f271dc-9801-4283-b4a7-763fb6248823/volumes"
Jul 30 16:15:51.502714 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.502679    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"]
Jul 30 16:15:51.503168 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.502926    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl" podUID="098ddd2b-2e47-41e5-8209-dc12e13dd06a" containerName="maas-api" containerID="cri-o://6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f" gracePeriod=30
Jul 30 16:15:51.536649 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.536619    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"]
Jul 30 16:15:51.541669 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.541643    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-f2cf4d-29757135-87487"]
Jul 30 16:15:51.778200 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.778164    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:15:51.854299 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.854262    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqw22\" (UniqueName: \"kubernetes.io/projected/098ddd2b-2e47-41e5-8209-dc12e13dd06a-kube-api-access-wqw22\") pod \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") "
Jul 30 16:15:51.854498 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.854309    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098ddd2b-2e47-41e5-8209-dc12e13dd06a-openshift-service-ca\") pod \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") "
Jul 30 16:15:51.854498 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.854344    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098ddd2b-2e47-41e5-8209-dc12e13dd06a-maas-api-tls\") pod \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\" (UID: \"098ddd2b-2e47-41e5-8209-dc12e13dd06a\") "
Jul 30 16:15:51.854723 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.854701    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/098ddd2b-2e47-41e5-8209-dc12e13dd06a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "098ddd2b-2e47-41e5-8209-dc12e13dd06a" (UID: "098ddd2b-2e47-41e5-8209-dc12e13dd06a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:15:51.856556 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.856530    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/098ddd2b-2e47-41e5-8209-dc12e13dd06a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "098ddd2b-2e47-41e5-8209-dc12e13dd06a" (UID: "098ddd2b-2e47-41e5-8209-dc12e13dd06a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 16:15:51.856669 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.856578    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/098ddd2b-2e47-41e5-8209-dc12e13dd06a-kube-api-access-wqw22" (OuterVolumeSpecName: "kube-api-access-wqw22") pod "098ddd2b-2e47-41e5-8209-dc12e13dd06a" (UID: "098ddd2b-2e47-41e5-8209-dc12e13dd06a"). InnerVolumeSpecName "kube-api-access-wqw22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:15:51.924330 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.924297    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a675d264-57b4-4e98-af3b-18731fcd37c5" path="/var/lib/kubelet/pods/a675d264-57b4-4e98-af3b-18731fcd37c5/volumes"
Jul 30 16:15:51.956153 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.956125    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqw22\" (UniqueName: \"kubernetes.io/projected/098ddd2b-2e47-41e5-8209-dc12e13dd06a-kube-api-access-wqw22\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:51.956153 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.956148    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/098ddd2b-2e47-41e5-8209-dc12e13dd06a-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:51.956315 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:51.956158    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/098ddd2b-2e47-41e5-8209-dc12e13dd06a-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:15:52.622913 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.622879    2553 generic.go:356] "Generic (PLEG): container finished" podID="098ddd2b-2e47-41e5-8209-dc12e13dd06a" containerID="6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f" exitCode=0
Jul 30 16:15:52.623356 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.622936    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"
Jul 30 16:15:52.623356 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.622971    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl" event={"ID":"098ddd2b-2e47-41e5-8209-dc12e13dd06a","Type":"ContainerDied","Data":"6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f"}
Jul 30 16:15:52.623356 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.623057    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl" event={"ID":"098ddd2b-2e47-41e5-8209-dc12e13dd06a","Type":"ContainerDied","Data":"f402aebd502bde13fe8231061f2885ecf3c7eb32f82e2cf1c27c4f7ea2728163"}
Jul 30 16:15:52.623356 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.623085    2553 scope.go:117] "RemoveContainer" containerID="6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f"
Jul 30 16:15:52.632702 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.632686    2553 scope.go:117] "RemoveContainer" containerID="6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f"
Jul 30 16:15:52.632971 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:15:52.632951    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f\": container with ID starting with 6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f not found: ID does not exist" containerID="6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f"
Jul 30 16:15:52.633031 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.632978    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f"} err="failed to get container status \"6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f\": rpc error: code = NotFound desc = could not find container \"6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f\": container with ID starting with 6dce67bf4623e900471a77fdbfb0f2d9a488487b6410b912684dc3794158890f not found: ID does not exist"
Jul 30 16:15:52.643246 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.643219    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"]
Jul 30 16:15:52.648330 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:52.648308    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-f2cf4d-c9478f5d5-22ztl"]
Jul 30 16:15:53.924988 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:15:53.924901    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="098ddd2b-2e47-41e5-8209-dc12e13dd06a" path="/var/lib/kubelet/pods/098ddd2b-2e47-41e5-8209-dc12e13dd06a/volumes"
Jul 30 16:16:02.619975 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:02.619944    2553 scope.go:117] "RemoveContainer" containerID="467936fd20052d49407ac3b7571f374784bee592322d3ce0bfd5abd1b95098c6"
Jul 30 16:16:09.836443 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:09.836388    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"]
Jul 30 16:16:09.837005 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:09.836627    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" podUID="fe536ebf-dba5-4413-b1c0-d7f9f461132e" containerName="maas-api" containerID="cri-o://23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab" gracePeriod=30
Jul 30 16:16:09.906665 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:09.906616    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"]
Jul 30 16:16:09.906934 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:09.906906    2553 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7" podUID="e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" containerName="payload-pre-processing" containerID="cri-o://9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f" gracePeriod=30
Jul 30 16:16:10.197360 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.197328    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:16:10.201020 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.200994    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:16:10.328276 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.328245    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrjmc\" (UniqueName: \"kubernetes.io/projected/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-kube-api-access-xrjmc\") pod \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") "
Jul 30 16:16:10.328506 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.328294    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wh572\" (UniqueName: \"kubernetes.io/projected/fe536ebf-dba5-4413-b1c0-d7f9f461132e-kube-api-access-wh572\") pod \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") "
Jul 30 16:16:10.328506 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.328339    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls\") pod \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") "
Jul 30 16:16:10.328506 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.328389    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-plugins-config-volume\") pod \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\" (UID: \"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422\") "
Jul 30 16:16:10.328506 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.328456    2553 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe536ebf-dba5-4413-b1c0-d7f9f461132e-openshift-service-ca\") pod \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\" (UID: \"fe536ebf-dba5-4413-b1c0-d7f9f461132e\") "
Jul 30 16:16:10.329919 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.329183    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" (UID: "e8551542-caa5-4e6b-b5a3-2eaf6c7d2422"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:16:10.329919 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.329255    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe536ebf-dba5-4413-b1c0-d7f9f461132e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe536ebf-dba5-4413-b1c0-d7f9f461132e" (UID: "fe536ebf-dba5-4413-b1c0-d7f9f461132e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 30 16:16:10.337922 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.337883    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe536ebf-dba5-4413-b1c0-d7f9f461132e-kube-api-access-wh572" (OuterVolumeSpecName: "kube-api-access-wh572") pod "fe536ebf-dba5-4413-b1c0-d7f9f461132e" (UID: "fe536ebf-dba5-4413-b1c0-d7f9f461132e"). InnerVolumeSpecName "kube-api-access-wh572". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:16:10.338259 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.338233    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe536ebf-dba5-4413-b1c0-d7f9f461132e" (UID: "fe536ebf-dba5-4413-b1c0-d7f9f461132e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 30 16:16:10.338371 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.338342    2553 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-kube-api-access-xrjmc" (OuterVolumeSpecName: "kube-api-access-xrjmc") pod "e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" (UID: "e8551542-caa5-4e6b-b5a3-2eaf6c7d2422"). InnerVolumeSpecName "kube-api-access-xrjmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 30 16:16:10.430075 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.430048    2553 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-plugins-config-volume\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:16:10.430075 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.430077    2553 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe536ebf-dba5-4413-b1c0-d7f9f461132e-openshift-service-ca\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:16:10.430272 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.430087    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrjmc\" (UniqueName: \"kubernetes.io/projected/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422-kube-api-access-xrjmc\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:16:10.430272 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.430095    2553 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wh572\" (UniqueName: \"kubernetes.io/projected/fe536ebf-dba5-4413-b1c0-d7f9f461132e-kube-api-access-wh572\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:16:10.430272 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.430104    2553 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe536ebf-dba5-4413-b1c0-d7f9f461132e-maas-api-tls\") on node \"ip-10-0-138-79.ec2.internal\" DevicePath \"\""
Jul 30 16:16:10.743618 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.743519    2553 generic.go:356] "Generic (PLEG): container finished" podID="e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" containerID="9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f" exitCode=0
Jul 30 16:16:10.743618 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.743587    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"
Jul 30 16:16:10.743618 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.743603    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7" event={"ID":"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422","Type":"ContainerDied","Data":"9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f"}
Jul 30 16:16:10.743921 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.743678    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7" event={"ID":"e8551542-caa5-4e6b-b5a3-2eaf6c7d2422","Type":"ContainerDied","Data":"598109fd2b94b5a04d48bbeeca117d153048df723e23bc03e99da3ac7dbe8300"}
Jul 30 16:16:10.743921 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.743708    2553 scope.go:117] "RemoveContainer" containerID="9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f"
Jul 30 16:16:10.745287 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.745259    2553 generic.go:356] "Generic (PLEG): container finished" podID="fe536ebf-dba5-4413-b1c0-d7f9f461132e" containerID="23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab" exitCode=0
Jul 30 16:16:10.745400 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.745304    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" event={"ID":"fe536ebf-dba5-4413-b1c0-d7f9f461132e","Type":"ContainerDied","Data":"23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab"}
Jul 30 16:16:10.745400 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.745310    2553 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"
Jul 30 16:16:10.745400 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.745348    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch" event={"ID":"fe536ebf-dba5-4413-b1c0-d7f9f461132e","Type":"ContainerDied","Data":"cbe4c475f9c66b7cc16177c7abd802f9ae56f6271ea0c4e15b4bf8d029660bb9"}
Jul 30 16:16:10.754755 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.754727    2553 scope.go:117] "RemoveContainer" containerID="9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f"
Jul 30 16:16:10.755069 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:16:10.755049    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f\": container with ID starting with 9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f not found: ID does not exist" containerID="9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f"
Jul 30 16:16:10.755144 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.755077    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f"} err="failed to get container status \"9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f\": rpc error: code = NotFound desc = could not find container \"9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f\": container with ID starting with 9ed4886784f44d7eeb5981e515f0478a2be7b3194ee2c18870dfb0b89259308f not found: ID does not exist"
Jul 30 16:16:10.755144 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.755095    2553 scope.go:117] "RemoveContainer" containerID="23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab"
Jul 30 16:16:10.764210 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.764192    2553 scope.go:117] "RemoveContainer" containerID="23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab"
Jul 30 16:16:10.764514 ip-10-0-138-79 kubenswrapper[2553]: E0730 16:16:10.764495    2553 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab\": container with ID starting with 23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab not found: ID does not exist" containerID="23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab"
Jul 30 16:16:10.764571 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.764522    2553 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab"} err="failed to get container status \"23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab\": rpc error: code = NotFound desc = could not find container \"23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab\": container with ID starting with 23a0ca3470721492450d7b7b39ed90bdbfe8cbdd6afdfd23fe03b08353ebdbab not found: ID does not exist"
Jul 30 16:16:10.767886 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.767863    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"]
Jul 30 16:16:10.777171 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.777149    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-5468b9-5dc85b44b4-zt7g7"]
Jul 30 16:16:10.787533 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.787507    2553 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"]
Jul 30 16:16:10.791296 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:10.791273    2553 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-5468b9-76547cc64f-wsqch"]
Jul 30 16:16:11.924297 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:11.924269    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" path="/var/lib/kubelet/pods/e8551542-caa5-4e6b-b5a3-2eaf6c7d2422/volumes"
Jul 30 16:16:11.924725 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:11.924707    2553 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe536ebf-dba5-4413-b1c0-d7f9f461132e" path="/var/lib/kubelet/pods/fe536ebf-dba5-4413-b1c0-d7f9f461132e/volumes"
Jul 30 16:16:17.700226 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:17.700194    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5797fbc4d5-h6284_d1c7754a-3519-494f-b9ae-4b1d07d1c3f6/authorino/0.log"
Jul 30 16:16:23.825586 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:23.825555    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6kgnf_1679d8e2-e7d7-4feb-a909-35a691f63f9c/manager/0.log"
Jul 30 16:16:23.959400 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:23.959374    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64966fd4f8-ct9p8_0d8aac14-71eb-49ee-a3bc-78661c6e1155/manager/0.log"
Jul 30 16:16:24.096274 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:24.096209    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ttgjv_a96bbfd4-3a24-4894-a45e-9fc33f5568c9/server/0.log"
Jul 30 16:16:24.227800 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:24.227774    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p4846_b7540d4d-477a-48f3-99dc-64cb16a8018c/manager/0.log"
Jul 30 16:16:24.357700 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:24.357636    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56444d5c7b-58k4m_94f09838-36c3-48dd-b84d-d48ce8260ed6/copy-manifests/0.log"
Jul 30 16:16:24.363761 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:24.363744    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56444d5c7b-58k4m_94f09838-36c3-48dd-b84d-d48ce8260ed6/manager/0.log"
Jul 30 16:16:25.045792 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:25.045765    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-794cfb675b-vfljz_5c9daf37-60d1-4a99-9db0-9d2510917ca8/maas-api/0.log"
Jul 30 16:16:25.180782 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:25.180759    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757105-9kswz_2a43c7e5-5c9c-4c2d-a5b1-dfd6714cd750/cleanup/0.log"
Jul 30 16:16:25.299979 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:25.299915    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757120-pv6rp_12629ef1-f131-44f5-aa56-b18721902dfc/cleanup/0.log"
Jul 30 16:16:25.450759 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:25.450740    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29757135-6c8kn_45e9d381-8582-4e4b-af5c-085d8e14ec83/cleanup/0.log"
Jul 30 16:16:25.572820 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:25.572760    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-qp4km_513ef1c0-946d-42d8-aadc-fb06372c6db0/postgres/0.log"
Jul 30 16:16:26.431043 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.431013    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q_85344533-eb46-4cdf-ad8f-fab1b580e759/util/0.log"
Jul 30 16:16:26.438349 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.438328    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q_85344533-eb46-4cdf-ad8f-fab1b580e759/pull/0.log"
Jul 30 16:16:26.445660 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.445643    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q_85344533-eb46-4cdf-ad8f-fab1b580e759/extract/0.log"
Jul 30 16:16:26.566388 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.566365    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42_c0056682-cdfa-4b0e-9176-9eded49cd7fb/util/0.log"
Jul 30 16:16:26.573197 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.573176    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42_c0056682-cdfa-4b0e-9176-9eded49cd7fb/pull/0.log"
Jul 30 16:16:26.580146 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.580123    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42_c0056682-cdfa-4b0e-9176-9eded49cd7fb/extract/0.log"
Jul 30 16:16:26.701148 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.701075    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj_f2a8e55e-fd19-42ab-a418-42199c2b75a0/extract/0.log"
Jul 30 16:16:26.707347 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.707317    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj_f2a8e55e-fd19-42ab-a418-42199c2b75a0/util/0.log"
Jul 30 16:16:26.713843 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.713824    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj_f2a8e55e-fd19-42ab-a418-42199c2b75a0/pull/0.log"
Jul 30 16:16:26.841392 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.841361    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl_7ffdf75d-36a5-42a8-8c57-add5f6af1bbf/util/0.log"
Jul 30 16:16:26.848045 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.848025    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl_7ffdf75d-36a5-42a8-8c57-add5f6af1bbf/pull/0.log"
Jul 30 16:16:26.854656 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.854638    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl_7ffdf75d-36a5-42a8-8c57-add5f6af1bbf/extract/0.log"
Jul 30 16:16:26.989600 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:26.989509    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5797fbc4d5-h6284_d1c7754a-3519-494f-b9ae-4b1d07d1c3f6/authorino/0.log"
Jul 30 16:16:27.124850 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:27.124822    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mmnhc_6b650aa8-b6ec-41f0-add4-24fea93d01b6/manager/0.log"
Jul 30 16:16:27.379007 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:27.378930    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fp9mk_1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214/kuadrant-console-plugin/0.log"
Jul 30 16:16:27.513873 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:27.513850    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tg4dn_32ce58ac-00f8-4000-a8d7-0989949eb6ad/registry-server/0.log"
Jul 30 16:16:27.652708 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:27.652641    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vjnkb_02baa9dc-e25c-4c97-b84d-8593d49fc438/manager/0.log"
Jul 30 16:16:28.746791 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:28.746757    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6976f6d894-t8w5r_e22676ba-2271-4125-951d-12202de0c52b/kube-auth-proxy/0.log"
Jul 30 16:16:29.013850 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:29.013776    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p255w_e02b63dc-c288-4188-8152-0b6568fc477b/payload-pre-processing/0.log"
Jul 30 16:16:29.153222 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:29.153194    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-qdbwx_ea16af77-73d0-4d5c-8e33-db205867a5c5/payload-processing/0.log"
Jul 30 16:16:29.679011 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:29.678981    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-879nr_88654918-03de-414b-8eb1-c330983002cc/main/0.log"
Jul 30 16:16:29.960472 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:29.960362    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-72nrl_a042b3c4-7ffe-4fe0-a288-bbbf070f3827/main/0.log"
Jul 30 16:16:30.209959 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:30.209937    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-k4v2t_06938ef9-a019-4f10-85db-0bed21a71e4f/main/0.log"
Jul 30 16:16:30.342548 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:30.342494    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-h5x54_ce6bce8b-d32c-4c1c-8fd3-bce65ac4393d/main/0.log"
Jul 30 16:16:40.523475 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:40.523445    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bc678_909befd3-0fad-48d9-b790-e76e33fb190c/global-pull-secret-syncer/0.log"
Jul 30 16:16:40.696046 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:40.696013    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j4dkq_cdf9d136-899b-421a-af75-69c5cc8ef63b/konnectivity-agent/0.log"
Jul 30 16:16:40.793978 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:40.793899    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-79.ec2.internal_9f20c5851391d507a5ecc4ac9b08f248/haproxy/0.log"
Jul 30 16:16:45.281464 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.281414    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q_85344533-eb46-4cdf-ad8f-fab1b580e759/extract/0.log"
Jul 30 16:16:45.309400 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.309372    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q_85344533-eb46-4cdf-ad8f-fab1b580e759/util/0.log"
Jul 30 16:16:45.336510 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.336483    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t5g9q_85344533-eb46-4cdf-ad8f-fab1b580e759/pull/0.log"
Jul 30 16:16:45.368370 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.368341    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42_c0056682-cdfa-4b0e-9176-9eded49cd7fb/extract/0.log"
Jul 30 16:16:45.393171 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.393147    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42_c0056682-cdfa-4b0e-9176-9eded49cd7fb/util/0.log"
Jul 30 16:16:45.413730 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.413708    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wfc42_c0056682-cdfa-4b0e-9176-9eded49cd7fb/pull/0.log"
Jul 30 16:16:45.442477 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.442454    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj_f2a8e55e-fd19-42ab-a418-42199c2b75a0/extract/0.log"
Jul 30 16:16:45.463093 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.463064    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj_f2a8e55e-fd19-42ab-a418-42199c2b75a0/util/0.log"
Jul 30 16:16:45.487787 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.487770    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qr8gj_f2a8e55e-fd19-42ab-a418-42199c2b75a0/pull/0.log"
Jul 30 16:16:45.517649 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.517629    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl_7ffdf75d-36a5-42a8-8c57-add5f6af1bbf/extract/0.log"
Jul 30 16:16:45.545572 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.545508    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl_7ffdf75d-36a5-42a8-8c57-add5f6af1bbf/util/0.log"
Jul 30 16:16:45.568399 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.568376    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1q5rnl_7ffdf75d-36a5-42a8-8c57-add5f6af1bbf/pull/0.log"
Jul 30 16:16:45.976134 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:45.976103    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5797fbc4d5-h6284_d1c7754a-3519-494f-b9ae-4b1d07d1c3f6/authorino/0.log"
Jul 30 16:16:46.038085 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:46.038055    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mmnhc_6b650aa8-b6ec-41f0-add4-24fea93d01b6/manager/0.log"
Jul 30 16:16:46.101837 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:46.101810    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-fp9mk_1a09e2c2-bd1e-416a-b7f9-eb2eb8c28214/kuadrant-console-plugin/0.log"
Jul 30 16:16:46.148036 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:46.148004    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-tg4dn_32ce58ac-00f8-4000-a8d7-0989949eb6ad/registry-server/0.log"
Jul 30 16:16:46.216338 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:46.216302    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vjnkb_02baa9dc-e25c-4c97-b84d-8593d49fc438/manager/0.log"
Jul 30 16:16:48.212054 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:48.212019    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-gt498_ab3f8bf7-9abf-4da7-a9b8-d79a3e50b073/cluster-monitoring-operator/0.log"
Jul 30 16:16:48.443137 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:48.443094    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c45lb_5a6a19c5-ac50-45ae-a01b-bc11ac846eae/node-exporter/0.log"
Jul 30 16:16:48.466773 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:48.466676    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c45lb_5a6a19c5-ac50-45ae-a01b-bc11ac846eae/kube-rbac-proxy/0.log"
Jul 30 16:16:48.488970 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:48.488948    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c45lb_5a6a19c5-ac50-45ae-a01b-bc11ac846eae/init-textfile/0.log"
Jul 30 16:16:51.164746 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.164707    2553 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"]
Jul 30 16:16:51.165359 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165335    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="822567af-b0bf-4da7-b616-71c32f8de6c5" containerName="revoke-keys"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165362    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="822567af-b0bf-4da7-b616-71c32f8de6c5" containerName="revoke-keys"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165382    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="098ddd2b-2e47-41e5-8209-dc12e13dd06a" containerName="maas-api"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165391    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="098ddd2b-2e47-41e5-8209-dc12e13dd06a" containerName="maas-api"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165402    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe536ebf-dba5-4413-b1c0-d7f9f461132e" containerName="maas-api"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165409    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe536ebf-dba5-4413-b1c0-d7f9f461132e" containerName="maas-api"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165435    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165443    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165457    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" containerName="payload-pre-processing"
Jul 30 16:16:51.165459 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165463    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" containerName="payload-pre-processing"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165470    2553 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165476    2553 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165545    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="098ddd2b-2e47-41e5-8209-dc12e13dd06a" containerName="maas-api"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165554    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f271dc-9801-4283-b4a7-763fb6248823" containerName="istio-proxy"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165560    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="822567af-b0bf-4da7-b616-71c32f8de6c5" containerName="revoke-keys"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165566    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8551542-caa5-4e6b-b5a3-2eaf6c7d2422" containerName="payload-pre-processing"
Jul 30 16:16:51.165750 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.165572    2553 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe536ebf-dba5-4413-b1c0-d7f9f461132e" containerName="maas-api"
Jul 30 16:16:51.168567 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.168552    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.171492 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.171459    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cv7vc\"/\"openshift-service-ca.crt\""
Jul 30 16:16:51.171675 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.171654    2553 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-cv7vc\"/\"default-dockercfg-jszsr\""
Jul 30 16:16:51.172877 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.172861    2553 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-cv7vc\"/\"kube-root-ca.crt\""
Jul 30 16:16:51.185469 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.185445    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"]
Jul 30 16:16:51.247856 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.247825    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/3.log"
Jul 30 16:16:51.252648 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.252626    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-cntsg_8a15885c-7aa3-4aed-8d7c-eebcfd4fc7fb/console-operator/4.log"
Jul 30 16:16:51.305360 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.305327    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-proc\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.305572 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.305376    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-podres\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.305572 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.305466    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-lib-modules\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.305572 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.305506    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-sys\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.305572 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.305564    2553 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mwfg\" (UniqueName: \"kubernetes.io/projected/bbf6a11b-2ada-4e70-a759-5ba03239b59a-kube-api-access-5mwfg\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407109 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407072    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-podres\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407120    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-lib-modules\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407145    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-sys\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407169    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mwfg\" (UniqueName: \"kubernetes.io/projected/bbf6a11b-2ada-4e70-a759-5ba03239b59a-kube-api-access-5mwfg\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407227    2553 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-proc\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407290 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407261    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-podres\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407516 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407271    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-sys\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407516 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407306    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-lib-modules\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.407516 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.407308    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/bbf6a11b-2ada-4e70-a759-5ba03239b59a-proc\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.416334 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.416262    2553 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mwfg\" (UniqueName: \"kubernetes.io/projected/bbf6a11b-2ada-4e70-a759-5ba03239b59a-kube-api-access-5mwfg\") pod \"perf-node-gather-daemonset-q44t6\" (UID: \"bbf6a11b-2ada-4e70-a759-5ba03239b59a\") " pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.478590 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.478559    2553 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:51.617087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.617058    2553 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"]
Jul 30 16:16:51.618337 ip-10-0-138-79 kubenswrapper[2553]: W0730 16:16:51.618317    2553 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podbbf6a11b_2ada_4e70_a759_5ba03239b59a.slice/crio-10455add7dce66b15eb989825918c2eae84e7086b37fd59fc0eb81d03123fa5f WatchSource:0}: Error finding container 10455add7dce66b15eb989825918c2eae84e7086b37fd59fc0eb81d03123fa5f: Status 404 returned error can't find the container with id 10455add7dce66b15eb989825918c2eae84e7086b37fd59fc0eb81d03123fa5f
Jul 30 16:16:51.771854 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:51.771824    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-648c8ccbc8-j2nd8_84085413-9518-4297-a8dd-4744911c15c9/console/0.log"
Jul 30 16:16:52.009762 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:52.009668    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6" event={"ID":"bbf6a11b-2ada-4e70-a759-5ba03239b59a","Type":"ContainerStarted","Data":"fb4a20c0ec54a464611d2403a2db6cd01120089c9725471c23c7d124f87e764c"}
Jul 30 16:16:52.009913 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:52.009839    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:52.009913 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:52.009870    2553 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6" event={"ID":"bbf6a11b-2ada-4e70-a759-5ba03239b59a","Type":"ContainerStarted","Data":"10455add7dce66b15eb989825918c2eae84e7086b37fd59fc0eb81d03123fa5f"}
Jul 30 16:16:52.028899 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:52.028847    2553 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6" podStartSLOduration=1.028831437 podStartE2EDuration="1.028831437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-30 16:16:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-30 16:16:52.026649305 +0000 UTC m=+4010.632497429" watchObservedRunningTime="2026-07-30 16:16:52.028831437 +0000 UTC m=+4010.634679541"
Jul 30 16:16:52.434251 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:52.434225    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-tgspz_1eb4ba49-637f-4261-a229-e3aa67553181/volume-data-source-validator/0.log"
Jul 30 16:16:53.611168 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:53.611140    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jf8wf_9205b071-5e6c-4644-b14a-637631d49163/dns/0.log"
Jul 30 16:16:53.630652 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:53.630621    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-jf8wf_9205b071-5e6c-4644-b14a-637631d49163/kube-rbac-proxy/0.log"
Jul 30 16:16:53.754062 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:53.754037    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-n8csv_95bf1bae-846c-45b2-b5bf-a1c186e910ed/dns-node-resolver/0.log"
Jul 30 16:16:54.324279 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:54.324252    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bnm8k_4b227c78-1fec-4950-8021-2f38835c531c/node-ca/0.log"
Jul 30 16:16:55.565217 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:55.565182    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6976f6d894-t8w5r_e22676ba-2271-4125-951d-12202de0c52b/kube-auth-proxy/0.log"
Jul 30 16:16:55.657754 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:55.657728    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p255w_e02b63dc-c288-4188-8152-0b6568fc477b/payload-pre-processing/0.log"
Jul 30 16:16:55.686939 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:55.686912    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-qdbwx_ea16af77-73d0-4d5c-8e33-db205867a5c5/payload-processing/0.log"
Jul 30 16:16:56.553451 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:56.553408    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ntn92_b3fa587a-1963-44df-9636-941c31324ef0/serve-healthcheck-canary/0.log"
Jul 30 16:16:57.064637 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:57.064605    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-rlzmh_c8b19855-054c-4406-a764-aa3856e1059c/insights-operator/0.log"
Jul 30 16:16:57.065926 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:57.065909    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-rlzmh_c8b19855-054c-4406-a764-aa3856e1059c/insights-operator/1.log"
Jul 30 16:16:57.236309 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:57.236280    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wx5tb_b7f47b2b-28fe-40c7-84aa-8b880ab14679/kube-rbac-proxy/0.log"
Jul 30 16:16:57.258458 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:57.258435    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wx5tb_b7f47b2b-28fe-40c7-84aa-8b880ab14679/exporter/0.log"
Jul 30 16:16:57.288801 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:57.288776    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wx5tb_b7f47b2b-28fe-40c7-84aa-8b880ab14679/extractor/0.log"
Jul 30 16:16:58.025871 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:58.025843    2553 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-cv7vc/perf-node-gather-daemonset-q44t6"
Jul 30 16:16:59.740568 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:59.740545    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-6kgnf_1679d8e2-e7d7-4feb-a909-35a691f63f9c/manager/0.log"
Jul 30 16:16:59.885344 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:59.885317    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-64966fd4f8-ct9p8_0d8aac14-71eb-49ee-a3bc-78661c6e1155/manager/0.log"
Jul 30 16:16:59.903690 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:59.903665    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-ttgjv_a96bbfd4-3a24-4894-a45e-9fc33f5568c9/server/0.log"
Jul 30 16:16:59.982087 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:16:59.982021    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-p4846_b7540d4d-477a-48f3-99dc-64cb16a8018c/manager/0.log"
Jul 30 16:17:00.004983 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:00.004963    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56444d5c7b-58k4m_94f09838-36c3-48dd-b84d-d48ce8260ed6/manager/0.log"
Jul 30 16:17:00.026310 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:00.026292    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-56444d5c7b-58k4m_94f09838-36c3-48dd-b84d-d48ce8260ed6/copy-manifests/0.log"
Jul 30 16:17:00.767759 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:00.767698    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6976f6d894-t8w5r_e22676ba-2271-4125-951d-12202de0c52b/kube-auth-proxy/0.log"
Jul 30 16:17:00.860108 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:00.860079    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p255w_e02b63dc-c288-4188-8152-0b6568fc477b/payload-pre-processing/0.log"
Jul 30 16:17:00.879038 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:00.879017    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-qdbwx_ea16af77-73d0-4d5c-8e33-db205867a5c5/payload-processing/0.log"
Jul 30 16:17:02.489954 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:02.489931    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6976f6d894-t8w5r_e22676ba-2271-4125-951d-12202de0c52b/kube-auth-proxy/0.log"
Jul 30 16:17:02.571818 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:02.571792    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-p255w_e02b63dc-c288-4188-8152-0b6568fc477b/payload-pre-processing/0.log"
Jul 30 16:17:02.593735 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:02.593716    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-qdbwx_ea16af77-73d0-4d5c-8e33-db205867a5c5/payload-processing/0.log"
Jul 30 16:17:08.054635 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.054606    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/kube-multus-additional-cni-plugins/0.log"
Jul 30 16:17:08.076186 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.076162    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/egress-router-binary-copy/0.log"
Jul 30 16:17:08.105817 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.105787    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/cni-plugins/0.log"
Jul 30 16:17:08.130097 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.130073    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/bond-cni-plugin/0.log"
Jul 30 16:17:08.150662 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.150639    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/routeoverride-cni/0.log"
Jul 30 16:17:08.170209 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.170191    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/whereabouts-cni-bincopy/0.log"
Jul 30 16:17:08.192910 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.192887    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-m2z6f_8b8a4368-edf6-4c26-b301-c855ca3ea41e/whereabouts-cni/0.log"
Jul 30 16:17:08.464039 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.464008    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-zb47k_b6597c1c-2cff-4a02-827f-482bdf341713/kube-multus/0.log"
Jul 30 16:17:08.487204 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.487178    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4ql6h_2e81b505-63c6-4eee-8942-9b954f9ecb8a/network-metrics-daemon/0.log"
Jul 30 16:17:08.504236 ip-10-0-138-79 kubenswrapper[2553]: I0730 16:17:08.504208    2553 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-4ql6h_2e81b505-63c6-4eee-8942-9b954f9ecb8a/kube-rbac-proxy/0.log"